-- Logs begin at Mon 2022-08-29 20:44:31 UTC, end at Mon 2022-08-29 22:07:47 UTC. -- Aug 29 21:26:09.859644 dv-cinder-854266-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 21:26:09.872579 dv-cinder-854266-3-smb devstack@keystone.service[81942]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 21:26:09 2022] *** Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: nodename: dv-cinder-854266-3-smb Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: machine: x86_64 Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: clock source: unix Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: pcre jit disabled Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: detected number of CPU cores: 4 Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: current working directory: / Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: detected binary path: /usr/bin/uwsgi-core Aug 29 21:26:09.875577 dv-cinder-854266-3-smb devstack@keystone.service[81942]: your processes number limit is 47680 Aug 29 21:26:09.876980 dv-cinder-854266-3-smb devstack@keystone.service[81942]: your memory page size is 4096 bytes Aug 29 21:26:09.876980 dv-cinder-854266-3-smb devstack@keystone.service[81942]: detected max file descriptor number: 2048 Aug 29 21:26:09.876980 dv-cinder-854266-3-smb devstack@keystone.service[81942]: lock engine: pthread robust mutexes Aug 29 21:26:09.876980 dv-cinder-854266-3-smb devstack@keystone.service[81942]: thunder lock: enabled Aug 29 21:26:09.876980 dv-cinder-854266-3-smb devstack@keystone.service[81942]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 21:26:09.876980 dv-cinder-854266-3-smb devstack@keystone.service[81942]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 21:26:09.920293 dv-cinder-854266-3-smb devstack@keystone.service[81942]: Python main interpreter initialized at 0x5637e11d49c0 Aug 29 21:26:09.920293 dv-cinder-854266-3-smb devstack@keystone.service[81942]: python threads support enabled Aug 29 21:26:09.920293 dv-cinder-854266-3-smb devstack@keystone.service[81942]: your server socket listen backlog is limited to 100 connections Aug 29 21:26:09.920293 dv-cinder-854266-3-smb devstack@keystone.service[81942]: your mercy for graceful operations on workers is 90 seconds Aug 29 21:26:09.921078 dv-cinder-854266-3-smb devstack@keystone.service[81942]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 21:26:09.921078 dv-cinder-854266-3-smb devstack@keystone.service[81942]: *** Operational MODE: preforking *** Aug 29 21:26:09.921278 dv-cinder-854266-3-smb devstack@keystone.service[81942]: *** uWSGI is running in multiple interpreter mode *** Aug 29 21:26:09.921278 dv-cinder-854266-3-smb devstack@keystone.service[81942]: spawned uWSGI master process (pid: 81942) Aug 29 21:26:09.921539 dv-cinder-854266-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 21:26:09.922483 dv-cinder-854266-3-smb devstack@keystone.service[81942]: spawned uWSGI worker 1 (pid: 81953, cores: 1) Aug 29 21:26:09.922935 dv-cinder-854266-3-smb devstack@keystone.service[81942]: spawned uWSGI worker 2 (pid: 81954, cores: 1) Aug 29 21:26:09.924923 dv-cinder-854266-3-smb devstack@keystone.service[81942]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 21:26:14.569810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:26:14.569810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: from cryptography.utils import int_from_bytes Aug 29 21:26:14.570917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:26:14.570917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: from cryptography.utils import int_from_bytes Aug 29 21:26:14.623617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:26:14.623907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:26:14.624053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] command line args: [] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:26:14.624223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:26:14.624399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ================================================================================ {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:26:14.624741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] admin_token = **** {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.624910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] config_dir = [] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.625110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.625298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] config_source = [] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.625482 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] debug = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.625666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.626073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.626230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.626472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.626717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.626947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] list_limit = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.627134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] log_config_append = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.627309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.627484 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] log_dir = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.627621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] log_file = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.627868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.628109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.628354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.628619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.628824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.628959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.629206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.629472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.629682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.629915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.630152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.630381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.630624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.630875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.631175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.632236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.632416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] publish_errors = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.632684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.632919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.633098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.633345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.633585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.633822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] standard_threads = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.634052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.634310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.634468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.634644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] use_journal = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.634959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] use_json = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.635152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] use_stderr = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.635408 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] use_syslog = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.635881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:14.636235 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.636601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.636877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.637123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.637375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.637621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.637871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.638115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.638364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.638616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.638868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.639102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.639352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.639590 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.639838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.640085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.640324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.640602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.640864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.641109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.641343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.641600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.641865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.642115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.642364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.642596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.642824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.643053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.643289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.643540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.643787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.644017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.644249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.644521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.644761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.645000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.645244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.645464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.645699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.646043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.646500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.646642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.646843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.647163 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.647414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.647666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.647898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.648135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.648364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.648733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.648870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.649097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.649327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.649565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.649800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.650035 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.650270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.650505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.650738 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.650984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.651217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.651455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.651683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.651943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.652177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.652407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.652668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.652906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.653176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.653414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.653661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.653911 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.654154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.654387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.654621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.654883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.655149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.655439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.655756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.656177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.656442 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.656710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.656948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.657190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.657431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.657693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.657919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.658159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.658421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.658653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.658890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.659134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.659374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.659607 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.659847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.660080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.660310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.660560 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.660810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.661041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.661285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.661515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.661769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.662008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.662265 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.662552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.662808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.663138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] auth.external = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.663502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.663918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.664203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.664512 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] auth.password = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.664793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] auth.token = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.665040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.665275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.665533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.665767 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.666017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.666268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.666501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.666739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] credential.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.666992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.667286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.667480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.667721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.667966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.668200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.668446 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.668737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.668975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.669230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.669516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.669762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.670078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.670260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.670535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.670974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] federation.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.671202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.671387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.671647 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.671871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.672061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.672301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.672583 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.672864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.673161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.673403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.673605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.673840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.674241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.674505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.674845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.675139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.675390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.675650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.675875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.676253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.676566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.676853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.677089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.677322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.677572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.677817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.679188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.679188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.679188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.679588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.679721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.679942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.680178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.680445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.680709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.680948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.681194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.681430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.681676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.681914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.682159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.682407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.682642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.682910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.683158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.683388 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.683650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.683878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.684152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.684389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.684841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.684979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.685117 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.685348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.685596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.685826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.686073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.686290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.686553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.686760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.687085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.687226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.687435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.687675 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.687931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.688160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.688407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.688703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.688922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.689156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.689387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.689622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.689855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.690093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.690324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.690569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.690818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.691061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.691301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.691546 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.691800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.692120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.692537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.692856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.693175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.693432 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.693680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.694506 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.694731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.694986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.695250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.695496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.695736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.696000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.696186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.696614 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.696862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.697098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.697338 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.697583 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] resource.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.697839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.698130 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.698366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.698618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.698871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.699107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.699355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.699595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.699836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.700070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] role.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.700320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] role.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.700576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.700833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.701082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.701329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.701576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.701817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.702063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.702308 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.702556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.702787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.703032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.703276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.703521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.703766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.704199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.704493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.704779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.705028 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.705276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.705526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.705761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.706017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.706268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.706509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.706743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.706972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.707205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.707455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.707711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.707961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.708198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.708433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.708692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.708929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] token.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.709170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.709446 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.709781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.710013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.710265 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.710505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.710754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.711000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.711243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.711483 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.711718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.711955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.712201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.712508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.712736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.712980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.713226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.713496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.connection = **** {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.713740 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.713986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.714224 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.714463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.714698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.714933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.715172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.715433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.715734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.715974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.716243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.716499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.716748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.716982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.717233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.717461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.717702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.717936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:14.718107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81953) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:26:14.751892 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:14.752252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:14.752469 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:14.761435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:14.793844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:14.794105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:14.852054 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:14.909323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:14.909620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.075885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.076159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.076304 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.076600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.076783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.077005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.103422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.103714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.103858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.104024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.104156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.104383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.104628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.129463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.152909 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.153283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.153535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.153912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.154297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.154670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.155057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81953) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.184454 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.184800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:26:15.185300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.185498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:26:15.185807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.186226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.186678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.187142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.205237 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.205237 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.205660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.206036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.219194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.224518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.224822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.225853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.226298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.226690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.226975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.227364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.227852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.228338 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.228864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.229339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.256581 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.258135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.258419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.263480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.263780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.264067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.270913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.277201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.277201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.277201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.277201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.277201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.277201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.279466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.279761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.280068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.297120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.297414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.301421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.304705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.305016 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.309405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.312657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.315815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.316119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.316404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.316719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.317055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.325183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.333511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.333821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.334090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.334353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.342055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.343769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.345357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.345633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.348286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.348591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.348883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.349166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.349464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.361880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.362095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.362392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.362678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.362962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.363272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.363613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.379570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.382738 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.385692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.387144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.388695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.388982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.389263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.395853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.397930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.400876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.401181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.401471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.401910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.410194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.410503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.410787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.418689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81953) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:15.418978 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.419264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.419537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.419812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.420091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.420367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.420671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.420947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.421277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.421550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.421809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.422073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.422359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81953) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:15.457274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637e11d49c0 pid: 81953 (default app) Aug 29 21:26:15.461819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534832d-ed35-4d7c-be15-bbe7c7b06193 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:15.462105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534832d-ed35-4d7c-be15-bbe7c7b06193 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:15.462381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534832d-ed35-4d7c-be15-bbe7c7b06193 None None] PATH_INFO: `/v3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:15.466826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 791 bytes} [Mon Aug 29 21:26:15 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:15.639942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:26:15.639942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: from cryptography.utils import int_from_bytes Aug 29 21:26:15.640702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 21:26:15.640702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: from cryptography.utils import int_from_bytes Aug 29 21:26:15.710339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 21:26:15.710594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 21:26:15.710868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] command line args: [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 21:26:15.711284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 21:26:15.711554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ================================================================================ {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 21:26:15.711951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] admin_token = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.712286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] config_dir = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.712672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] config_source = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.712855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] debug = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.713098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.713341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.713523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.713781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.714031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.714294 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.714519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_config_append = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.714664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.714826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_dir = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.714985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_file = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.715233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.715525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.715782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.716036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.716215 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.716397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.716674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.716923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.718988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.718988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.718988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.718988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.718988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.718988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.718988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.719826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.719826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] publish_errors = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.719826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.720189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.720189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.720513 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.720863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.721215 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] standard_threads = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.721571 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.721935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.722218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.722488 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] use_journal = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.722735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] use_json = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.722977 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] use_stderr = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.723226 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] use_syslog = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.723557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 21:26:15.723955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.724321 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.724753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.725182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.725445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.725698 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.725952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.726195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.726452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.726706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.726993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.727234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.727512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.727756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.728010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.728293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.728590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.728988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.729876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.729876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.729876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.730431 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.730652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.730855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.731237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.731598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.731946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.732308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.732714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.733068 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.733423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.733758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.734118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.734498 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.734878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.735283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.735542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.735782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.736026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.736268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.736525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.736751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.736987 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.737221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.737465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.737728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.737990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.738335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.738517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.738706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.738930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.739182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.739421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.739663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.739904 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.740143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.740385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.740687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.740908 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.741165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.741403 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.741645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.741882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.742149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.742388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.742654 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.742900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.743140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.743705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.743958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.744218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.744475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.744820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.744995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.745216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.745470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.747601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.747601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.747601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.747601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.747601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.747601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.747601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.747601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.747601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.749332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.749332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.749332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.749332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.749332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.749332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.749332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.750508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.750508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.750508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.750508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.750508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.751371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.751371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.751371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.751371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.752057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.752057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.752057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.752733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.752733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.753106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.753106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.external = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.753470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.753658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.753844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.754034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.password = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.754235 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] auth.token = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.754422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.754607 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.754856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.755092 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.755350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.755632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.755984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.756181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.756940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.757127 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.757379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.757644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.757893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.758131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.758379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.758635 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.758901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.759159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.759454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.759703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.759975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.760298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.760589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.760910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.761082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.761329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.761579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.761816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.762099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.762345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.762604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.762873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.763136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.763404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.763660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.763900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.764180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.764417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.764663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.764914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.765164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.765401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.765647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.766035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.766295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.766533 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.766770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.767008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.767263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.767545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.767798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.768083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.768334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.768639 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.768885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.769131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.769369 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.769616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.769857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.770101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.770350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.770594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.770849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.771086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.771339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.771591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.771832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.772673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.772929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.773213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.773462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.773697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.773945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.774189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.774441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.774684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.774928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.775183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.775445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.775690 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.776099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.776384 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.777264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.777264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.777264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.777795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.777795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.778147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.778337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.778529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.778715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.778930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.779205 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.779470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.779780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.780023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.780266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.780561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.780756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.781013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.781265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.781516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.781767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.782018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.782324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.782581 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.782836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.783083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.783326 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.783568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.783821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.784075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.784320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.784644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.784880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.785135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.785376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.785617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.785859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.786113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.786362 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.786598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.786841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.787087 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.787343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.787630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.787891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.788147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.788404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.788656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.788911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.789153 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.789398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.789637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] role.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.789895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] role.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.790129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.790410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.790662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.790915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.791168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.791419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.791668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.791919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.792172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.792410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.792708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.792973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.793228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.793480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.793926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.794167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.794421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.794675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.795466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.795466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.795466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.796013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.796200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.796384 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.796641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.796834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.797020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.797278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.797542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.797798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.798067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.798310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.798548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.798792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.799035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.799290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.799532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.799801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.800275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.800524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.800787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.801077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.804897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.804897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.804897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.804897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.804897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.804897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.804897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.804897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.804897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.806642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.connection = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.806642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.806642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.806642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.806642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.806642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.806642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.806642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.806642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.808168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.808168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.808168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.808168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.808168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.808168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.808168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.809623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.809623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.809623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 21:26:15.809623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81954) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 21:26:15.837970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.838226 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.838505 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.847788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.873645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.873941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.916740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.960113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:15.960450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.013792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.014060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.014237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.014474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.014702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.014942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.029709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.030075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.030396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.030712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.031053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.031365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.031680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.050719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.155223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.155539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.155846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.156137 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.156421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.156742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.157034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81954) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 21:26:16.168256 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.168524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:26:16.168880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.169155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 21:26:16.169503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.169952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.170167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.170507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.181678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.182056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.182380 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.182723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.190392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.193714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.194710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.195092 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.195472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.195849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.196222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.196664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.197039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.197412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.197783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.198182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.223859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.226263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.226712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.231758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.232166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.232593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.239907 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.240321 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.245546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.245989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.246378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.246811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.247210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.247633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.248028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.248567 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.265935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.266352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.270749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.274488 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.274930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.280163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.283763 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.287206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.288182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.288612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.289004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.289386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.289774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.306928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.307235 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.307523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.307791 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.314891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.317989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.322037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.322343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.325103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.325395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.325697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.325984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.326281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.338101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.338401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.338700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.338996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.339288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.339611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.339859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.361418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.365878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.369689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.371155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.372732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.373027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.373320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.379984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.381532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.384608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.384915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.385274 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.385697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.393919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.394230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.394523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.401618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81954) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 21:26:16.401929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.402240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.402491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.402879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.403233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.403534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.403824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.404104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.404379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.404715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.405009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.405311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.405578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81954) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 21:26:16.441624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5637e11d49c0 pid: 81954 (default app) Aug 29 21:26:24.596522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc955-e649-4f00-9e44-081bd229c608 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.597316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc955-e649-4f00-9e44-081bd229c608 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.597316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61dc955-e649-4f00-9e44-081bd229c608 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.598416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 2/2] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:24.610151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:24.610773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:24.611290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:24.689393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: INFO dbcounter [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] Registered counter for database keystone Aug 29 21:26:24.715315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG oslo_db.sqlalchemy.engines [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81954) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:26:24.723371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writer thread running {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:26:24.929129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG passlib.handlers.bcrypt [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81954) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 21:26:24.929448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG passlib.handlers.bcrypt [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81954) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 21:26:24.991379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:24.993305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:25.167550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1/3] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 564 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 21:26:25.773807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc955-e649-4f00-9e44-081bd229c608 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:25.848210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: INFO dbcounter [None req-b61dc955-e649-4f00-9e44-081bd229c608 None None] Registered counter for database keystone Aug 29 21:26:25.869240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG oslo_db.sqlalchemy.engines [None req-b61dc955-e649-4f00-9e44-081bd229c608 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81953) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 21:26:25.876403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writer thread running {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 21:26:26.001132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61dc955-e649-4f00-9e44-081bd229c608 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:26.006457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170b78b-09f1-4274-b704-bdafb26dd22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:26.008151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170b78b-09f1-4274-b704-bdafb26dd22f admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:26.008449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170b78b-09f1-4274-b704-bdafb26dd22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:26.008864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170b78b-09f1-4274-b704-bdafb26dd22f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:26.018790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170b78b-09f1-4274-b704-bdafb26dd22f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:26.073598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f170b78b-09f1-4274-b704-bdafb26dd22f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 21:26:26.073995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170b78b-09f1-4274-b704-bdafb26dd22f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:26.085892 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 3/4] 10.222.0.83 () {58 vars in 1324 bytes} [Mon Aug 29 21:26:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:26:26.095340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:26.111920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e082bb2-f8fc-4880-94f1-e39a1f996fce None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:26.117143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d2760-1bc2-4dd0-a13f-be5ce7ab3fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:26.118522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d2760-1bc2-4dd0-a13f-be5ce7ab3fec admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:26.119061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d2760-1bc2-4dd0-a13f-be5ce7ab3fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:26.119348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d2760-1bc2-4dd0-a13f-be5ce7ab3fec admin admin] PATH_INFO: `/v3/projects/f1c71f7fdbf248fba40d8efd925d9546` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:26.121056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d2760-1bc2-4dd0-a13f-be5ce7ab3fec admin admin] RBAC: Authorizing `identity:get_project(project_id=f1c71f7fdbf248fba40d8efd925d9546)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:26.175634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5b3d2760-1bc2-4dd0-a13f-be5ce7ab3fec admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 21:26:26.176038 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d2760-1bc2-4dd0-a13f-be5ce7ab3fec admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:26.181075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 2/5] 10.222.0.83 () {56 vars in 1207 bytes} [Mon Aug 29 21:26:26 2022] GET /identity/v3/projects/f1c71f7fdbf248fba40d8efd925d9546 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:28.194787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ebaac-cefe-4633-aa4d-190c6969e0bb None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.195507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ebaac-cefe-4633-aa4d-190c6969e0bb None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.196568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ebaac-cefe-4633-aa4d-190c6969e0bb None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.203219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 4/6] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:28.210966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cde605-4eab-4a32-a6b7-48f049078a60 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.211494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cde605-4eab-4a32-a6b7-48f049078a60 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.211494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cde605-4eab-4a32-a6b7-48f049078a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.242605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e4cde605-4eab-4a32-a6b7-48f049078a60 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:28.245665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e4cde605-4eab-4a32-a6b7-48f049078a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:28.258474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 3/7] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 21:26:28.537657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ebaac-cefe-4633-aa4d-190c6969e0bb None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.552253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ebaac-cefe-4633-aa4d-190c6969e0bb None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:28.557536 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91846e-787e-486b-b703-42134c5d1813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:28.558203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91846e-787e-486b-b703-42134c5d1813 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.558532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91846e-787e-486b-b703-42134c5d1813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.558854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91846e-787e-486b-b703-42134c5d1813 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.568246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91846e-787e-486b-b703-42134c5d1813 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:28.570161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91846e-787e-486b-b703-42134c5d1813 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:28.580918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 5/8] 10.222.0.83 () {58 vars in 1324 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:26:28.587605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cde605-4eab-4a32-a6b7-48f049078a60 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:28.597742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cde605-4eab-4a32-a6b7-48f049078a60 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:28.603263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4c7d6-51c9-4a40-ba6a-fd02aa62dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:28.603956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4c7d6-51c9-4a40-ba6a-fd02aa62dda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:28.604293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4c7d6-51c9-4a40-ba6a-fd02aa62dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:28.604858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4c7d6-51c9-4a40-ba6a-fd02aa62dda9 admin admin] PATH_INFO: `/v3/users/19faba1f83d443dbaca1d7f5b1b4a452` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:28.606415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4c7d6-51c9-4a40-ba6a-fd02aa62dda9 admin admin] RBAC: Authorizing `identity:get_user(user_id=19faba1f83d443dbaca1d7f5b1b4a452)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:28.608365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4c7d6-51c9-4a40-ba6a-fd02aa62dda9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:28.610074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 4/9] 10.222.0.83 () {56 vars in 1198 bytes} [Mon Aug 29 21:26:28 2022] GET /identity/v3/users/19faba1f83d443dbaca1d7f5b1b4a452 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:30.703521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72be49-18c0-4794-882f-8cfc7c44dbf8 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.704429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72be49-18c0-4794-882f-8cfc7c44dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.704956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72be49-18c0-4794-882f-8cfc7c44dbf8 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.707534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 6/10] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:30.716873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931fda0-0c90-4a25-ad4e-2308384d2984 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:30.717646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931fda0-0c90-4a25-ad4e-2308384d2984 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:30.717646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931fda0-0c90-4a25-ad4e-2308384d2984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:30.738532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7931fda0-0c90-4a25-ad4e-2308384d2984 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:30.739793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7931fda0-0c90-4a25-ad4e-2308384d2984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:30.842689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 5/11] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:31.120403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72be49-18c0-4794-882f-8cfc7c44dbf8 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.401321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72be49-18c0-4794-882f-8cfc7c44dbf8 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:31.469675 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509fe9f-374b-40cf-bc3d-7f37d1bf9bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:31.471254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509fe9f-374b-40cf-bc3d-7f37d1bf9bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.471745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509fe9f-374b-40cf-bc3d-7f37d1bf9bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.472224 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509fe9f-374b-40cf-bc3d-7f37d1bf9bb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.497343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509fe9f-374b-40cf-bc3d-7f37d1bf9bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-f509fe9f-374b-40cf-bc3d-7f37d1bf9bb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:31.517571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:31.519290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:31.521907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:26:31.532698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 7/12] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:31.532954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931fda0-0c90-4a25-ad4e-2308384d2984 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.581405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:31.597169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d360916-c156-4c78-8381-7e7a83a473ba None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.597643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d360916-c156-4c78-8381-7e7a83a473ba None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.598124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d360916-c156-4c78-8381-7e7a83a473ba None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.601157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 8/13] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:31.610176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ae323-b693-42e1-9d1a-414eb713efc3 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.620123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ae323-b693-42e1-9d1a-414eb713efc3 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.620123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ae323-b693-42e1-9d1a-414eb713efc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.636863 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG passlib.handlers.bcrypt [None req-b24ae323-b693-42e1-9d1a-414eb713efc3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81953) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 21:26:31.637528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG passlib.handlers.bcrypt [None req-b24ae323-b693-42e1-9d1a-414eb713efc3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81953) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 21:26:31.689091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b24ae323-b693-42e1-9d1a-414eb713efc3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:31.690729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b24ae323-b693-42e1-9d1a-414eb713efc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:31.741680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931fda0-0c90-4a25-ad4e-2308384d2984 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:31.742496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:31.809073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382aba5-3266-4046-b2ca-af466b00d263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:31.810149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382aba5-3266-4046-b2ca-af466b00d263 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:31.810667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382aba5-3266-4046-b2ca-af466b00d263 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:31.811171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382aba5-3266-4046-b2ca-af466b00d263 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:31.812426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382aba5-3266-4046-b2ca-af466b00d263 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:31.813013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382aba5-3266-4046-b2ca-af466b00d263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:31.813905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 9/14] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:31.815825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382aba5-3266-4046-b2ca-af466b00d263 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:31.839596 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 6/15] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:31.846162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ae323-b693-42e1-9d1a-414eb713efc3 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:31.987373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ae323-b693-42e1-9d1a-414eb713efc3 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.037838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d342c2-84d8-4413-8e9b-85160227d440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.038810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d342c2-84d8-4413-8e9b-85160227d440 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.039096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d342c2-84d8-4413-8e9b-85160227d440 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.039369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d342c2-84d8-4413-8e9b-85160227d440 None admin] PATH_INFO: `/v3/users/19faba1f83d443dbaca1d7f5b1b4a452` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.041183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d342c2-84d8-4413-8e9b-85160227d440 None admin] RBAC: Authorizing `identity:get_user(user_id=19faba1f83d443dbaca1d7f5b1b4a452)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.042872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d342c2-84d8-4413-8e9b-85160227d440 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:32.044675 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 10/16] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:26:31 2022] GET /identity/v3/users/19faba1f83d443dbaca1d7f5b1b4a452 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:32.050781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382aba5-3266-4046-b2ca-af466b00d263 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:32.166735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:32.191250 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382aba5-3266-4046-b2ca-af466b00d263 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.241076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbce0a-5234-4fba-a447-ac3bb49350e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.241626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbce0a-5234-4fba-a447-ac3bb49350e8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.241895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbce0a-5234-4fba-a447-ac3bb49350e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.242156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbce0a-5234-4fba-a447-ac3bb49350e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.243942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbce0a-5234-4fba-a447-ac3bb49350e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.245822 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbce0a-5234-4fba-a447-ac3bb49350e8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:32.248651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 7/17] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:32.255052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d342c2-84d8-4413-8e9b-85160227d440 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:32.312627 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:32.330828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbce0a-5234-4fba-a447-ac3bb49350e8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:32.446560 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d342c2-84d8-4413-8e9b-85160227d440 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.465015 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbce0a-5234-4fba-a447-ac3bb49350e8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.501396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b10ff-78e8-4a82-a7e2-3395d8cb2699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.502409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b10ff-78e8-4a82-a7e2-3395d8cb2699 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.502878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b10ff-78e8-4a82-a7e2-3395d8cb2699 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.503352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b10ff-78e8-4a82-a7e2-3395d8cb2699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.504726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b10ff-78e8-4a82-a7e2-3395d8cb2699 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.domain.id=default, user.id=19faba1f83d443dbaca1d7f5b1b4a452) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:32.505260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b10ff-78e8-4a82-a7e2-3395d8cb2699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.508718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b10ff-78e8-4a82-a7e2-3395d8cb2699 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:32.520826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda95000-bfc5-4340-82db-f29d4e59169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.521530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda95000-bfc5-4340-82db-f29d4e59169e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.521884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda95000-bfc5-4340-82db-f29d4e59169e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.522261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda95000-bfc5-4340-82db-f29d4e59169e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.525227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 11/18] 10.222.0.83 () {56 vars in 1322 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/role_assignments?user.id=19faba1f83d443dbaca1d7f5b1b4a452&scope.domain.id=default&role.id=c0316e22a13a4034846c451753b4c14e => generated 233 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:32.549903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:32.617726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda95000-bfc5-4340-82db-f29d4e59169e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.621034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda95000-bfc5-4340-82db-f29d4e59169e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:32.767413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 8/19] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:26:32.773984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b10ff-78e8-4a82-a7e2-3395d8cb2699 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:32.905138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:32.912005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b10ff-78e8-4a82-a7e2-3395d8cb2699 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:32.953840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b271439-fd7f-436f-8383-c2d517071495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:32.954562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b271439-fd7f-436f-8383-c2d517071495 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:32.954918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b271439-fd7f-436f-8383-c2d517071495 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:32.955317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b271439-fd7f-436f-8383-c2d517071495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:32.978840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b271439-fd7f-436f-8383-c2d517071495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:32.981115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b271439-fd7f-436f-8383-c2d517071495 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-8b271439-fd7f-436f-8383-c2d517071495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:33.000401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:33.002090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:33.003766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:33.003766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:33.003766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:26:33.003766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 12/20] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:26:33.012758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda95000-bfc5-4340-82db-f29d4e59169e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:33.075464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:33.132688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda95000-bfc5-4340-82db-f29d4e59169e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:33.175119 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae28ab-5119-46a8-afc9-a2411e2588f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:33.175750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae28ab-5119-46a8-afc9-a2411e2588f6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:33.176024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae28ab-5119-46a8-afc9-a2411e2588f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:33.176290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae28ab-5119-46a8-afc9-a2411e2588f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:33.176985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae28ab-5119-46a8-afc9-a2411e2588f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:33.177284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae28ab-5119-46a8-afc9-a2411e2588f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:33.178746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae28ab-5119-46a8-afc9-a2411e2588f6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:33.199894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 9/21] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:35.789110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949fb60-9e07-4504-920a-ec22711a697e None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.790692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949fb60-9e07-4504-920a-ec22711a697e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.791422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949fb60-9e07-4504-920a-ec22711a697e None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.794181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 13/22] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:35.801031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f87e57-875b-4814-8690-4e5cd8b73ee1 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:35.802523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f87e57-875b-4814-8690-4e5cd8b73ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:35.803302 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f87e57-875b-4814-8690-4e5cd8b73ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:35.846510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-97f87e57-875b-4814-8690-4e5cd8b73ee1 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:35.849299 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-97f87e57-875b-4814-8690-4e5cd8b73ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:36.025059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 10/23] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:36.219243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3693659-47a6-4877-a5fd-6fdaca0cea35 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.220241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3693659-47a6-4877-a5fd-6fdaca0cea35 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.221085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3693659-47a6-4877-a5fd-6fdaca0cea35 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.223969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 14/24] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:36.238806 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b339e-4921-4f7f-85cd-102a3c0fc836 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.239772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b339e-4921-4f7f-85cd-102a3c0fc836 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.240541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b339e-4921-4f7f-85cd-102a3c0fc836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.284763 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a76b339e-4921-4f7f-85cd-102a3c0fc836 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:36.287336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a76b339e-4921-4f7f-85cd-102a3c0fc836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:36.373921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:36.427061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 11/25] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:36.458821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331876e9-9fc6-4777-9ce3-fca4ba51ff73 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.459563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331876e9-9fc6-4777-9ce3-fca4ba51ff73 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.460076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331876e9-9fc6-4777-9ce3-fca4ba51ff73 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.461788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 15/26] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:36.472436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f35e0-cc00-4bb5-8bad-ee9f3d926a09 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.472744 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f35e0-cc00-4bb5-8bad-ee9f3d926a09 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.472990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f35e0-cc00-4bb5-8bad-ee9f3d926a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:36.499347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-758f35e0-cc00-4bb5-8bad-ee9f3d926a09 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:36.500746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-758f35e0-cc00-4bb5-8bad-ee9f3d926a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:36.627279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 12/27] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:36.735677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331876e9-9fc6-4777-9ce3-fca4ba51ff73 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.896251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f35e0-cc00-4bb5-8bad-ee9f3d926a09 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:36.921251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331876e9-9fc6-4777-9ce3-fca4ba51ff73 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:36.995540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2baa71-4920-43e2-a70f-539180c1d2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:36.996709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2baa71-4920-43e2-a70f-539180c1d2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:36.997201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2baa71-4920-43e2-a70f-539180c1d2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:36.997889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2baa71-4920-43e2-a70f-539180c1d2f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.020600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2baa71-4920-43e2-a70f-539180c1d2f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-5c2baa71-4920-43e2-a70f-539180c1d2f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:37.039387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:37.040322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:37.041140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:26:37.044010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 16/28] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:37.050297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2baa71-4920-43e2-a70f-539180c1d2f1 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.064753 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.090175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f35e0-cc00-4bb5-8bad-ee9f3d926a09 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.095101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.161317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b03eb4-0c4d-436f-9a98-367b58e48417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.162821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b03eb4-0c4d-436f-9a98-367b58e48417 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.163685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b03eb4-0c4d-436f-9a98-367b58e48417 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.164517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b03eb4-0c4d-436f-9a98-367b58e48417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.192408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b03eb4-0c4d-436f-9a98-367b58e48417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.195788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b03eb4-0c4d-436f-9a98-367b58e48417 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.195983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2baa71-4920-43e2-a70f-539180c1d2f1 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.238533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ab7b3-672e-4963-b8e1-c4e47efb8117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.239431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ab7b3-672e-4963-b8e1-c4e47efb8117 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.239843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ab7b3-672e-4963-b8e1-c4e47efb8117 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.240256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ab7b3-672e-4963-b8e1-c4e47efb8117 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.241668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ab7b3-672e-4963-b8e1-c4e47efb8117 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:37.242123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ab7b3-672e-4963-b8e1-c4e47efb8117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.243712 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ab7b3-672e-4963-b8e1-c4e47efb8117 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-63b03eb4-0c4d-436f-9a98-367b58e48417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:26:37.257090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:37.258011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:26:37.258839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:26:37.258839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:26:37.258839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:26:37.259838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 13/29] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:37.262031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 17/30] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:37.266909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b03eb4-0c4d-436f-9a98-367b58e48417 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.268342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ab7b3-672e-4963-b8e1-c4e47efb8117 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.358688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.407404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ab7b3-672e-4963-b8e1-c4e47efb8117 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.497209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1734739-4cdb-40b6-9658-b627da18a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.497873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1734739-4cdb-40b6-9658-b627da18a95c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.498156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1734739-4cdb-40b6-9658-b627da18a95c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.498436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1734739-4cdb-40b6-9658-b627da18a95c None admin] PATH_INFO: `/v3/users/19faba1f83d443dbaca1d7f5b1b4a452` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.499701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1734739-4cdb-40b6-9658-b627da18a95c None admin] RBAC: Authorizing `identity:get_user(user_id=19faba1f83d443dbaca1d7f5b1b4a452)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.501577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1734739-4cdb-40b6-9658-b627da18a95c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.513443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 18/31] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/users/19faba1f83d443dbaca1d7f5b1b4a452 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:37.517430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b03eb4-0c4d-436f-9a98-367b58e48417 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.519497 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1734739-4cdb-40b6-9658-b627da18a95c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.588066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417cf5-1626-48cc-a356-8fec090b87a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.589721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417cf5-1626-48cc-a356-8fec090b87a3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.590446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417cf5-1626-48cc-a356-8fec090b87a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.591142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84417cf5-1626-48cc-a356-8fec090b87a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.592638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84417cf5-1626-48cc-a356-8fec090b87a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:37.593417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84417cf5-1626-48cc-a356-8fec090b87a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.596389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84417cf5-1626-48cc-a356-8fec090b87a3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.620532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 14/32] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:37.622024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417cf5-1626-48cc-a356-8fec090b87a3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.644835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.731292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1734739-4cdb-40b6-9658-b627da18a95c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.757951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84417cf5-1626-48cc-a356-8fec090b87a3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:37.781879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1193d4a9-e82d-446d-8002-e4c5fecb2370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.782796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193d4a9-e82d-446d-8002-e4c5fecb2370 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.783255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193d4a9-e82d-446d-8002-e4c5fecb2370 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.783701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1193d4a9-e82d-446d-8002-e4c5fecb2370 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.784695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193d4a9-e82d-446d-8002-e4c5fecb2370 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.786366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1193d4a9-e82d-446d-8002-e4c5fecb2370 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.806349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3e3d7-4ae9-4e08-aa91-7d2ce4d8d2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:37.807163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3e3d7-4ae9-4e08-aa91-7d2ce4d8d2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.807559 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3e3d7-4ae9-4e08-aa91-7d2ce4d8d2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.808013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3e3d7-4ae9-4e08-aa91-7d2ce4d8d2e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.809524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3e3d7-4ae9-4e08-aa91-7d2ce4d8d2e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:37.811132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3e3d7-4ae9-4e08-aa91-7d2ce4d8d2e8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:37.812848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 15/33] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:37.814319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca83a2-626c-4eb6-93ca-2ad1c7b6b9b5 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:37.814616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca83a2-626c-4eb6-93ca-2ad1c7b6b9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:37.814874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca83a2-626c-4eb6-93ca-2ad1c7b6b9b5 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:37.816610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 16/34] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:37.819966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca83a2-626c-4eb6-93ca-2ad1c7b6b9b5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:37.896529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.933704 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:37.961618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca83a2-626c-4eb6-93ca-2ad1c7b6b9b5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.019201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9570544-fc11-4991-9a1b-f418be90fd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.020028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9570544-fc11-4991-9a1b-f418be90fd3a None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.020434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9570544-fc11-4991-9a1b-f418be90fd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.020905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9570544-fc11-4991-9a1b-f418be90fd3a None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.021711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9570544-fc11-4991-9a1b-f418be90fd3a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.023826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9570544-fc11-4991-9a1b-f418be90fd3a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.055178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 19/35] 10.222.0.83 () {60 vars in 1131 bytes} [Mon Aug 29 21:26:37 2022] POST /identity/v3/roles => generated 219 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:38.058641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27a1a-d028-4085-8a5d-2ef3bdb13f7c None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.058641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27a1a-d028-4085-8a5d-2ef3bdb13f7c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.058641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde27a1a-d028-4085-8a5d-2ef3bdb13f7c None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.061434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 20/36] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:38.062145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27a1a-d028-4085-8a5d-2ef3bdb13f7c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:38.263349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde27a1a-d028-4085-8a5d-2ef3bdb13f7c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:38.330489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 17/37] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:26:37 2022] POST /identity/v3/projects => generated 301 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:38.333233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c35c0-ccb6-4f77-aed9-37f68e27ec8e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.333724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c35c0-ccb6-4f77-aed9-37f68e27ec8e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.334266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c35c0-ccb6-4f77-aed9-37f68e27ec8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.337963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246bea5-7174-4ab9-9456-0bb5060b5dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:38.339816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246bea5-7174-4ab9-9456-0bb5060b5dc4 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.340990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246bea5-7174-4ab9-9456-0bb5060b5dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.341810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246bea5-7174-4ab9-9456-0bb5060b5dc4 None admin] PATH_INFO: `/v3/domains/default/users/19faba1f83d443dbaca1d7f5b1b4a452/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.346690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246bea5-7174-4ab9-9456-0bb5060b5dc4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=19faba1f83d443dbaca1d7f5b1b4a452, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:38.350637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246bea5-7174-4ab9-9456-0bb5060b5dc4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:38.370530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2c2c35c0-ccb6-4f77-aed9-37f68e27ec8e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:38.371905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2c2c35c0-ccb6-4f77-aed9-37f68e27ec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:38.468517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 21/38] 10.222.0.83 () {58 vars in 1361 bytes} [Mon Aug 29 21:26:38 2022] PUT /identity/v3/domains/default/users/19faba1f83d443dbaca1d7f5b1b4a452/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:26:38.470538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08b0b4-34a3-42a8-b4d4-08ad63de1d67 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.471062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08b0b4-34a3-42a8-b4d4-08ad63de1d67 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.471602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08b0b4-34a3-42a8-b4d4-08ad63de1d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.495252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-8a08b0b4-34a3-42a8-b4d4-08ad63de1d67 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:38.497311 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8a08b0b4-34a3-42a8-b4d4-08ad63de1d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:38.515692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 18/39] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:38.518659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e91dc1-3cb7-43da-be78-0d279139f836 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.518966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e91dc1-3cb7-43da-be78-0d279139f836 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.519417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e91dc1-3cb7-43da-be78-0d279139f836 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.522290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 19/40] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:38.531062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c1a12-9b5a-4e5d-967c-fb0322b4f014 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:38.531580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c1a12-9b5a-4e5d-967c-fb0322b4f014 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:38.532105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c1a12-9b5a-4e5d-967c-fb0322b4f014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:38.565558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-227c1a12-9b5a-4e5d-967c-fb0322b4f014 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:38.567775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-227c1a12-9b5a-4e5d-967c-fb0322b4f014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:38.602473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:38.620918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 22/41] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:38.689766 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:38.702037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 20/42] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:38.909249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08b0b4-34a3-42a8-b4d4-08ad63de1d67 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:39.006796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c1a12-9b5a-4e5d-967c-fb0322b4f014 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:39.037070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08b0b4-34a3-42a8-b4d4-08ad63de1d67 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:39.088010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb524ac-1db8-4381-91dc-f7ab2c612b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:39.088726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb524ac-1db8-4381-91dc-f7ab2c612b4e None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:39.089176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb524ac-1db8-4381-91dc-f7ab2c612b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:39.089533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb524ac-1db8-4381-91dc-f7ab2c612b4e None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:39.090345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb524ac-1db8-4381-91dc-f7ab2c612b4e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:39.091789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb524ac-1db8-4381-91dc-f7ab2c612b4e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:39.172441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 23/43] 10.222.0.83 () {60 vars in 1131 bytes} [Mon Aug 29 21:26:38 2022] POST /identity/v3/roles => generated 225 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:26:39.173259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb524ac-1db8-4381-91dc-f7ab2c612b4e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:39.181126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c1a12-9b5a-4e5d-967c-fb0322b4f014 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:39.240927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e32844-d7f8-433e-8e44-e33f42be7c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:39.243874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e32844-d7f8-433e-8e44-e33f42be7c3c None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:39.244891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e32844-d7f8-433e-8e44-e33f42be7c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:39.245375 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e32844-d7f8-433e-8e44-e33f42be7c3c None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:39.246363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e32844-d7f8-433e-8e44-e33f42be7c3c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:39.249098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e32844-d7f8-433e-8e44-e33f42be7c3c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:39.266172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:39.369415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 21/44] 10.222.0.83 () {60 vars in 1131 bytes} [Mon Aug 29 21:26:39 2022] POST /identity/v3/roles => generated 223 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:39.378377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb524ac-1db8-4381-91dc-f7ab2c612b4e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:39.428412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37ba1d-7ed6-4e25-99fd-a66a39749c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:39.429395 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37ba1d-7ed6-4e25-99fd-a66a39749c4e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:39.429846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37ba1d-7ed6-4e25-99fd-a66a39749c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:39.430274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37ba1d-7ed6-4e25-99fd-a66a39749c4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:39.431943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37ba1d-7ed6-4e25-99fd-a66a39749c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:39.433802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37ba1d-7ed6-4e25-99fd-a66a39749c4e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:39.435806 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 24/45] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:39.444097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e32844-d7f8-433e-8e44-e33f42be7c3c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:39.725440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:39.810432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e32844-d7f8-433e-8e44-e33f42be7c3c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:39.873791 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd1ee0-aa3a-4ac2-99d0-6be4950388e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:39.874838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd1ee0-aa3a-4ac2-99d0-6be4950388e6 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:39.875336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd1ee0-aa3a-4ac2-99d0-6be4950388e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:39.875820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd1ee0-aa3a-4ac2-99d0-6be4950388e6 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:39.877130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd1ee0-aa3a-4ac2-99d0-6be4950388e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:39.879937 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd1ee0-aa3a-4ac2-99d0-6be4950388e6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:39.983815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 22/46] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:26:39 2022] POST /identity/v3/projects => generated 312 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:41.220099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccf6d7-b166-4ba5-92a9-7096d27179e1 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.220748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccf6d7-b166-4ba5-92a9-7096d27179e1 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.221160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccf6d7-b166-4ba5-92a9-7096d27179e1 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.223942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 25/47] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:41.233102 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914e1b0-8cb4-46e4-b0bc-a5ff878cd329 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.233973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914e1b0-8cb4-46e4-b0bc-a5ff878cd329 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.233973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914e1b0-8cb4-46e4-b0bc-a5ff878cd329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.255892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5914e1b0-8cb4-46e4-b0bc-a5ff878cd329 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:41.300280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5914e1b0-8cb4-46e4-b0bc-a5ff878cd329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:41.346065 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 23/48] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:41.639720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccf6d7-b166-4ba5-92a9-7096d27179e1 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:41.843939 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccf6d7-b166-4ba5-92a9-7096d27179e1 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:41.877604 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:41.910789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcb3fb-0381-4f2d-9ecb-38c9f79d6266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:41.911480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcb3fb-0381-4f2d-9ecb-38c9f79d6266 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:41.911860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcb3fb-0381-4f2d-9ecb-38c9f79d6266 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:41.912247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcb3fb-0381-4f2d-9ecb-38c9f79d6266 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:41.925668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcb3fb-0381-4f2d-9ecb-38c9f79d6266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-78dcb3fb-0381-4f2d-9ecb-38c9f79d6266 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:41.930799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:41.932641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:26:41.934195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 26/49] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:41.938914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914e1b0-8cb4-46e4-b0bc-a5ff878cd329 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.004281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:42.143584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914e1b0-8cb4-46e4-b0bc-a5ff878cd329 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.215109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95581034-1e36-48af-ab7b-99ff98f6b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.216071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95581034-1e36-48af-ab7b-99ff98f6b987 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.216597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95581034-1e36-48af-ab7b-99ff98f6b987 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.217088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95581034-1e36-48af-ab7b-99ff98f6b987 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.218301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95581034-1e36-48af-ab7b-99ff98f6b987 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:42.218803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95581034-1e36-48af-ab7b-99ff98f6b987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.221649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95581034-1e36-48af-ab7b-99ff98f6b987 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.243367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 24/50] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:42.245569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcb3fb-0381-4f2d-9ecb-38c9f79d6266 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.352806 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5d2d2-0905-46b7-9906-8103e7602b97 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.353268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5d2d2-0905-46b7-9906-8103e7602b97 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.353652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5d2d2-0905-46b7-9906-8103e7602b97 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.355784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 25/51] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:42.364007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518ddb7-aa2b-46f3-b2e9-3fbaba92b29a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.364358 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518ddb7-aa2b-46f3-b2e9-3fbaba92b29a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.364775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518ddb7-aa2b-46f3-b2e9-3fbaba92b29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.389660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7518ddb7-aa2b-46f3-b2e9-3fbaba92b29a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:42.391093 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7518ddb7-aa2b-46f3-b2e9-3fbaba92b29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:42.415227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcb3fb-0381-4f2d-9ecb-38c9f79d6266 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.459684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82004aa2-b017-494a-8160-c6dc8c9dd94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.460556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82004aa2-b017-494a-8160-c6dc8c9dd94c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.460976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82004aa2-b017-494a-8160-c6dc8c9dd94c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.461317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82004aa2-b017-494a-8160-c6dc8c9dd94c None admin] PATH_INFO: `/v3/users/19faba1f83d443dbaca1d7f5b1b4a452` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.462725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82004aa2-b017-494a-8160-c6dc8c9dd94c None admin] RBAC: Authorizing `identity:get_user(user_id=19faba1f83d443dbaca1d7f5b1b4a452)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.464391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82004aa2-b017-494a-8160-c6dc8c9dd94c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.466707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 27/52] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/users/19faba1f83d443dbaca1d7f5b1b4a452 => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:42.473161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82004aa2-b017-494a-8160-c6dc8c9dd94c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.487027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 26/53] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:42.540352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:42.635818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82004aa2-b017-494a-8160-c6dc8c9dd94c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.695636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98767982-28a1-4f5b-9fda-95eda7c75e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.696752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98767982-28a1-4f5b-9fda-95eda7c75e8a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.697234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98767982-28a1-4f5b-9fda-95eda7c75e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.697717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98767982-28a1-4f5b-9fda-95eda7c75e8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.700046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98767982-28a1-4f5b-9fda-95eda7c75e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.702656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98767982-28a1-4f5b-9fda-95eda7c75e8a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.705894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 28/54] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:42.712777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518ddb7-aa2b-46f3-b2e9-3fbaba92b29a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.762353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:42.827565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98767982-28a1-4f5b-9fda-95eda7c75e8a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:42.901161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518ddb7-aa2b-46f3-b2e9-3fbaba92b29a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:42.966313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e3bf-c231-4d55-bddd-df06e76a0de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:42.967229 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e3bf-c231-4d55-bddd-df06e76a0de8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:42.967653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e3bf-c231-4d55-bddd-df06e76a0de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:42.968105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e3bf-c231-4d55-bddd-df06e76a0de8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:42.969460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5e3bf-c231-4d55-bddd-df06e76a0de8 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.domain.id=default, user.id=19faba1f83d443dbaca1d7f5b1b4a452) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:42.969977 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5e3bf-c231-4d55-bddd-df06e76a0de8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:42.972515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5e3bf-c231-4d55-bddd-df06e76a0de8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:42.986827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 27/55] 10.222.0.83 () {56 vars in 1322 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/role_assignments?user.id=19faba1f83d443dbaca1d7f5b1b4a452&scope.domain.id=default&role.id=c0316e22a13a4034846c451753b4c14e => generated 530 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:42.997575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98767982-28a1-4f5b-9fda-95eda7c75e8a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:43.033723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:43.074529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a541dd-2d5d-44b3-937b-e87a558d9ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:43.075480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a541dd-2d5d-44b3-937b-e87a558d9ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:43.075914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a541dd-2d5d-44b3-937b-e87a558d9ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:43.076334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a541dd-2d5d-44b3-937b-e87a558d9ab3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:43.078678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a541dd-2d5d-44b3-937b-e87a558d9ab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:43.081531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a541dd-2d5d-44b3-937b-e87a558d9ab3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:43.084743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 29/56] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:43.094280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e3bf-c231-4d55-bddd-df06e76a0de8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:43.240173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:43.253598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e3bf-c231-4d55-bddd-df06e76a0de8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:43.296844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492e627-44c0-475d-a2af-423581de2e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:43.297396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492e627-44c0-475d-a2af-423581de2e22 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:43.297673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492e627-44c0-475d-a2af-423581de2e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:43.297945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492e627-44c0-475d-a2af-423581de2e22 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:43.298626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492e627-44c0-475d-a2af-423581de2e22 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:43.300118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492e627-44c0-475d-a2af-423581de2e22 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:43.452043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 28/57] 10.222.0.83 () {60 vars in 1140 bytes} [Mon Aug 29 21:26:43 2022] POST /identity/v3/projects => generated 298 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:26:45.484981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc28a-f303-4bca-bd5f-827d195e98c0 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:45.485508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc28a-f303-4bca-bd5f-827d195e98c0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:45.485508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcc28a-f303-4bca-bd5f-827d195e98c0 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:45.486827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 30/58] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:45.493039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6e8a6-6ac2-4af0-a29c-71d6ded72d43 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:45.493602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6e8a6-6ac2-4af0-a29c-71d6ded72d43 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:45.493602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6e8a6-6ac2-4af0-a29c-71d6ded72d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:45.514171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3be6e8a6-6ac2-4af0-a29c-71d6ded72d43 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:45.515480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3be6e8a6-6ac2-4af0-a29c-71d6ded72d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:45.592653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 29/59] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:46.013484 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcc28a-f303-4bca-bd5f-827d195e98c0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:46.247975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcc28a-f303-4bca-bd5f-827d195e98c0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:46.289296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7979a-af76-4f44-bb49-5cbd73defc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:46.289833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7979a-af76-4f44-bb49-5cbd73defc24 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.290106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7979a-af76-4f44-bb49-5cbd73defc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.290379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7979a-af76-4f44-bb49-5cbd73defc24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.291680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7979a-af76-4f44-bb49-5cbd73defc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:46.293174 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7979a-af76-4f44-bb49-5cbd73defc24 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:46.294961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 31/60] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:46.304199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6e8a6-6ac2-4af0-a29c-71d6ded72d43 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:46.445655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:46.488995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6e8a6-6ac2-4af0-a29c-71d6ded72d43 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:46.553549 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5c267-4ad3-48ca-97e5-3b0bd021306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:46.555055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5c267-4ad3-48ca-97e5-3b0bd021306a None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:46.555360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5c267-4ad3-48ca-97e5-3b0bd021306a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:46.555727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5c267-4ad3-48ca-97e5-3b0bd021306a None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:46.556551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5c267-4ad3-48ca-97e5-3b0bd021306a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:46.558155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5c267-4ad3-48ca-97e5-3b0bd021306a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:46.684593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 30/61] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:26:46 2022] POST /identity/v3/users => generated 275 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:50.702899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c64fc-333d-44bb-9c68-8438d7f72904 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.704318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c64fc-333d-44bb-9c68-8438d7f72904 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.705154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c64fc-333d-44bb-9c68-8438d7f72904 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.707736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 32/62] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:50.714728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457eaf-ec21-4b69-9558-04fb302e56ac None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:50.715437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457eaf-ec21-4b69-9558-04fb302e56ac None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:50.715437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f457eaf-ec21-4b69-9558-04fb302e56ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:50.751293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-8f457eaf-ec21-4b69-9558-04fb302e56ac None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:50.753873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8f457eaf-ec21-4b69-9558-04fb302e56ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:50.859175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 31/63] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:51.229188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa2f96-c0cd-42b0-96c5-1d8d4883ed6b None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.230368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa2f96-c0cd-42b0-96c5-1d8d4883ed6b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.231178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa2f96-c0cd-42b0-96c5-1d8d4883ed6b None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.234081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 33/64] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:51.244274 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0db088-f4b9-401e-931b-fdead31a473a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.245776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0db088-f4b9-401e-931b-fdead31a473a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.246861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0db088-f4b9-401e-931b-fdead31a473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.295677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1a0db088-f4b9-401e-931b-fdead31a473a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:51.298443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1a0db088-f4b9-401e-931b-fdead31a473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:51.377175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850f58-22b7-492b-9e39-94f6c4cfb748 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.378146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850f58-22b7-492b-9e39-94f6c4cfb748 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.379200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850f58-22b7-492b-9e39-94f6c4cfb748 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.382356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 34/65] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:51.410046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95850f58-22b7-492b-9e39-94f6c4cfb748 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:51.421905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:51.438132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 32/66] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:51.439494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60e9ab-2438-4062-b919-adf138044324 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.439810 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60e9ab-2438-4062-b919-adf138044324 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.440091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60e9ab-2438-4062-b919-adf138044324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.477493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2f60e9ab-2438-4062-b919-adf138044324 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:51.478840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2f60e9ab-2438-4062-b919-adf138044324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:51.552825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:51.580390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 33/67] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:51.582127 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf2485-98a3-4dc9-b179-5825d3705867 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.582844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf2485-98a3-4dc9-b179-5825d3705867 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.583331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf2485-98a3-4dc9-b179-5825d3705867 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.586260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 34/68] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:51.596007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998298-b165-45b8-9e1f-27e15e6eab1f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.596510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998298-b165-45b8-9e1f-27e15e6eab1f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.597027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8998298-b165-45b8-9e1f-27e15e6eab1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.663704 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c8998298-b165-45b8-9e1f-27e15e6eab1f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:51.667421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c8998298-b165-45b8-9e1f-27e15e6eab1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:51.721970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95850f58-22b7-492b-9e39-94f6c4cfb748 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:51.812554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab46518-fe49-44d3-87ee-538f6df2b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:51.813443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab46518-fe49-44d3-87ee-538f6df2b2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.813894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab46518-fe49-44d3-87ee-538f6df2b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.814405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab46518-fe49-44d3-87ee-538f6df2b2e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.832828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 35/69] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:51.836795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92bcb7-3201-4d9a-8879-d37f7f76f6cc None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.837611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92bcb7-3201-4d9a-8879-d37f7f76f6cc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.838136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab46518-fe49-44d3-87ee-538f6df2b2e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:51.838477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be92bcb7-3201-4d9a-8879-d37f7f76f6cc None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.841156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 36/70] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-9ab46518-fe49-44d3-87ee-538f6df2b2e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:51.849350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:51.851902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:26:51.853756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:26:51.855103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d61bff-dc90-4ce9-be1a-3de62031741f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:51.855579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d61bff-dc90-4ce9-be1a-3de62031741f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:51.856194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d61bff-dc90-4ce9-be1a-3de62031741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:51.858746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 35/71] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:51.868301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab46518-fe49-44d3-87ee-538f6df2b2e8 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:51.900789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-29d61bff-dc90-4ce9-be1a-3de62031741f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:51.902854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-29d61bff-dc90-4ce9-be1a-3de62031741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:51.988985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:52.026169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 37/72] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:52.027149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d61bff-dc90-4ce9-be1a-3de62031741f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.103946 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab46518-fe49-44d3-87ee-538f6df2b2e8 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.145157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:52.173107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62615-6b8c-4c63-8786-2e3c27fee864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.174616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62615-6b8c-4c63-8786-2e3c27fee864 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.175428 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62615-6b8c-4c63-8786-2e3c27fee864 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.176136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb62615-6b8c-4c63-8786-2e3c27fee864 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.177828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb62615-6b8c-4c63-8786-2e3c27fee864 None admin] RBAC: Adding query filter params (name=member) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:52.178575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb62615-6b8c-4c63-8786-2e3c27fee864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.178887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d61bff-dc90-4ce9-be1a-3de62031741f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.180503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb62615-6b8c-4c63-8786-2e3c27fee864 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.191567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 36/73] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:26:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:52.192743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62615-6b8c-4c63-8786-2e3c27fee864 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.234048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9607ce-923f-46a4-bd38-ea223f13ecf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.234966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9607ce-923f-46a4-bd38-ea223f13ecf6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.235355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9607ce-923f-46a4-bd38-ea223f13ecf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.235847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9607ce-923f-46a4-bd38-ea223f13ecf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.258378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9607ce-923f-46a4-bd38-ea223f13ecf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-5d9607ce-923f-46a4-bd38-ea223f13ecf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:52.271848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:52.273487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:26:52.274252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:26:52.274830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 38/74] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:52.276933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9607ce-923f-46a4-bd38-ea223f13ecf6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.325002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb62615-6b8c-4c63-8786-2e3c27fee864 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.361494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:52.365202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c7fb-61ea-4f23-a7fb-256f0271fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.366238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c7fb-61ea-4f23-a7fb-256f0271fd07 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.366765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c7fb-61ea-4f23-a7fb-256f0271fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.367237 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6c7fb-61ea-4f23-a7fb-256f0271fd07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.380700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6c7fb-61ea-4f23-a7fb-256f0271fd07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-92d6c7fb-61ea-4f23-a7fb-256f0271fd07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:52.386808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:52.387817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:26:52.388633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:26:52.391051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 37/75] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:52.396990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c7fb-61ea-4f23-a7fb-256f0271fd07 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.434262 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:52.476901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9607ce-923f-46a4-bd38-ea223f13ecf6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.522020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6af071-ba2d-4bc4-b77c-04c202e67bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.523352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6af071-ba2d-4bc4-b77c-04c202e67bae None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.523667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6af071-ba2d-4bc4-b77c-04c202e67bae None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.523952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6af071-ba2d-4bc4-b77c-04c202e67bae None admin] PATH_INFO: `/v3/users/688f54c8b16b4188b4bc42b526a8f4c5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.541176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6af071-ba2d-4bc4-b77c-04c202e67bae None admin] RBAC: Authorizing `identity:get_user(user_id=688f54c8b16b4188b4bc42b526a8f4c5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.542778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6af071-ba2d-4bc4-b77c-04c202e67bae None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.544619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 39/76] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/users/688f54c8b16b4188b4bc42b526a8f4c5 => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:52.545661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6af071-ba2d-4bc4-b77c-04c202e67bae None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.558580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6c7fb-61ea-4f23-a7fb-256f0271fd07 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.615122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c9c94-c5e4-4851-a233-c394fe43203b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.616211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c9c94-c5e4-4851-a233-c394fe43203b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.617137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c9c94-c5e4-4851-a233-c394fe43203b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.617473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c9c94-c5e4-4851-a233-c394fe43203b None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.618249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c9c94-c5e4-4851-a233-c394fe43203b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:52.618681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c9c94-c5e4-4851-a233-c394fe43203b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.621211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c9c94-c5e4-4851-a233-c394fe43203b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.637189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 38/77] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:52.638115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c9c94-c5e4-4851-a233-c394fe43203b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.724161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:52.729079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6af071-ba2d-4bc4-b77c-04c202e67bae None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.774348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17f674-e8a3-4afb-afea-3dc07338b6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.775432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17f674-e8a3-4afb-afea-3dc07338b6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.775940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17f674-e8a3-4afb-afea-3dc07338b6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.776449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17f674-e8a3-4afb-afea-3dc07338b6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.777769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17f674-e8a3-4afb-afea-3dc07338b6b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:52.778314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17f674-e8a3-4afb-afea-3dc07338b6b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:52.781128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17f674-e8a3-4afb-afea-3dc07338b6b7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:52.793887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:52.796367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 40/78] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:52.808296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17f674-e8a3-4afb-afea-3dc07338b6b7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.809598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c9c94-c5e4-4851-a233-c394fe43203b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:52.854651 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8190e-8892-44c9-8036-6a12fc4549f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:52.855632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8190e-8892-44c9-8036-6a12fc4549f0 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:52.856082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8190e-8892-44c9-8036-6a12fc4549f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:52.856531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8190e-8892-44c9-8036-6a12fc4549f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:52.877477 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8190e-8892-44c9-8036-6a12fc4549f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-fcb8190e-8892-44c9-8036-6a12fc4549f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:52.887166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:52.889036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 39/79] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:52.894098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8190e-8892-44c9-8036-6a12fc4549f0 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:52.957442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17f674-e8a3-4afb-afea-3dc07338b6b7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:53.002508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574c464-6003-4524-83de-1180ace2a3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:53.003174 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574c464-6003-4524-83de-1180ace2a3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.003454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574c464-6003-4524-83de-1180ace2a3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.003733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574c464-6003-4524-83de-1180ace2a3f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.005052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574c464-6003-4524-83de-1180ace2a3f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:53.006563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574c464-6003-4524-83de-1180ace2a3f2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:53.008678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 41/80] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:53.009250 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574c464-6003-4524-83de-1180ace2a3f2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:53.047348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:53.072069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8190e-8892-44c9-8036-6a12fc4549f0 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:53.122090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b1b07-dc3f-4ea5-9770-edfe9bed42b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:53.122844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b1b07-dc3f-4ea5-9770-edfe9bed42b7 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.123257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b1b07-dc3f-4ea5-9770-edfe9bed42b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.123623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b1b07-dc3f-4ea5-9770-edfe9bed42b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.143629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574c464-6003-4524-83de-1180ace2a3f2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:53.151978 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:53.206142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48193fa-c903-4c8a-a477-760d4dd84454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:53.207458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48193fa-c903-4c8a-a477-760d4dd84454 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.207458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48193fa-c903-4c8a-a477-760d4dd84454 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.207838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48193fa-c903-4c8a-a477-760d4dd84454 None admin] PATH_INFO: `/v3/users/19faba1f83d443dbaca1d7f5b1b4a452` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.209298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48193fa-c903-4c8a-a477-760d4dd84454 None admin] RBAC: Authorizing `identity:get_user(user_id=19faba1f83d443dbaca1d7f5b1b4a452)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:53.211008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48193fa-c903-4c8a-a477-760d4dd84454 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:53.213447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 42/81] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:26:53 2022] GET /identity/v3/users/19faba1f83d443dbaca1d7f5b1b4a452 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:53.214202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48193fa-c903-4c8a-a477-760d4dd84454 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:53.232013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b1b07-dc3f-4ea5-9770-edfe9bed42b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:53.234402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b1b07-dc3f-4ea5-9770-edfe9bed42b7 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:53.359653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:53.366040 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48193fa-c903-4c8a-a477-760d4dd84454 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:53.411823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 40/82] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:53.412059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c42e7b-533f-4663-a9c3-8a3c36320382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:53.412059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c42e7b-533f-4663-a9c3-8a3c36320382 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.412059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c42e7b-533f-4663-a9c3-8a3c36320382 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.412059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c42e7b-533f-4663-a9c3-8a3c36320382 None admin] PATH_INFO: `/v3/users/688f54c8b16b4188b4bc42b526a8f4c5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.412405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b1b07-dc3f-4ea5-9770-edfe9bed42b7 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:53.412877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c42e7b-533f-4663-a9c3-8a3c36320382 None admin] RBAC: Authorizing `identity:get_user(user_id=688f54c8b16b4188b4bc42b526a8f4c5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:53.412877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c42e7b-533f-4663-a9c3-8a3c36320382 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:53.412877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 43/83] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:26:53 2022] GET /identity/v3/users/688f54c8b16b4188b4bc42b526a8f4c5 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:53.413962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c42e7b-533f-4663-a9c3-8a3c36320382 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:53.482733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:53.552030 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b1b07-dc3f-4ea5-9770-edfe9bed42b7 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:53.564090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c42e7b-533f-4663-a9c3-8a3c36320382 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:53.594907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8bbe2-e5f7-4ad1-b7e8-704164187255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:53.595754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8bbe2-e5f7-4ad1-b7e8-704164187255 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.596175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8bbe2-e5f7-4ad1-b7e8-704164187255 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.596586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8bbe2-e5f7-4ad1-b7e8-704164187255 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.597450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8bbe2-e5f7-4ad1-b7e8-704164187255 None admin] RBAC: Adding query filter params (name=member) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:53.597860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8bbe2-e5f7-4ad1-b7e8-704164187255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:53.599434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8bbe2-e5f7-4ad1-b7e8-704164187255 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:53.610920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 41/84] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:26:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:53.614148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8bbe2-e5f7-4ad1-b7e8-704164187255 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:53.618129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe7614-8e93-4ca4-b9e6-e1cb9a784c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:53.619017 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe7614-8e93-4ca4-b9e6-e1cb9a784c75 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.620614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe7614-8e93-4ca4-b9e6-e1cb9a784c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.620614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe7614-8e93-4ca4-b9e6-e1cb9a784c75 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.621816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe7614-8e93-4ca4-b9e6-e1cb9a784c75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:53.624531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe7614-8e93-4ca4-b9e6-e1cb9a784c75 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:53.743930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8bbe2-e5f7-4ad1-b7e8-704164187255 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:53.761153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:53.777515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 44/85] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:26:53 2022] POST /identity/v3/users => generated 289 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:26:53.778584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe7614-8e93-4ca4-b9e6-e1cb9a784c75 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:53.798685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40273a-b9b8-4d01-9f3b-a78fe0bd0a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:53.800752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40273a-b9b8-4d01-9f3b-a78fe0bd0a0f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:53.801503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40273a-b9b8-4d01-9f3b-a78fe0bd0a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:53.802082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40273a-b9b8-4d01-9f3b-a78fe0bd0a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:53.817669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:53.930798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40273a-b9b8-4d01-9f3b-a78fe0bd0a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:53.933800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40273a-b9b8-4d01-9f3b-a78fe0bd0a0f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:53.962872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe7614-8e93-4ca4-b9e6-e1cb9a784c75 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:54.027277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd992c0-8491-4543-8c2c-efdcfb04c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:54.027951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd992c0-8491-4543-8c2c-efdcfb04c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.028231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd992c0-8491-4543-8c2c-efdcfb04c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.028539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd992c0-8491-4543-8c2c-efdcfb04c3c2 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.029969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd992c0-8491-4543-8c2c-efdcfb04c3c2 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:54.031292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd992c0-8491-4543-8c2c-efdcfb04c3c2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:54.033501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 45/86] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:26:53 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:54.034053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd992c0-8491-4543-8c2c-efdcfb04c3c2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:54.153667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 42/87] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:54.154933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40273a-b9b8-4d01-9f3b-a78fe0bd0a0f None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:54.178843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:54.207030 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:54.235904 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd992c0-8491-4543-8c2c-efdcfb04c3c2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:54.312670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5c632-e554-45c0-a259-cbc855c92625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:54.313609 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5c632-e554-45c0-a259-cbc855c92625 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.314103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5c632-e554-45c0-a259-cbc855c92625 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.314587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb5c632-e554-45c0-a259-cbc855c92625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.356515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40273a-b9b8-4d01-9f3b-a78fe0bd0a0f None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:54.442818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee29fd-8c35-49e7-ad71-0f6cfa75ac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:54.443921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee29fd-8c35-49e7-ad71-0f6cfa75ac52 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.444425 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee29fd-8c35-49e7-ad71-0f6cfa75ac52 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.445867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee29fd-8c35-49e7-ad71-0f6cfa75ac52 None admin] PATH_INFO: `/v3/users/688f54c8b16b4188b4bc42b526a8f4c5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.449103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee29fd-8c35-49e7-ad71-0f6cfa75ac52 None admin] RBAC: Authorizing `identity:get_user(user_id=688f54c8b16b4188b4bc42b526a8f4c5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:54.451744 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5c632-e554-45c0-a259-cbc855c92625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:54.452337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee29fd-8c35-49e7-ad71-0f6cfa75ac52 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:54.454661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb5c632-e554-45c0-a259-cbc855c92625 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:54.456008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 43/88] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:26:54 2022] GET /identity/v3/users/688f54c8b16b4188b4bc42b526a8f4c5 => generated 275 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:54.457400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee29fd-8c35-49e7-ad71-0f6cfa75ac52 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:54.635618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:54.680400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee29fd-8c35-49e7-ad71-0f6cfa75ac52 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:54.691298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:54.718589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 46/89] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:54.720412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5c632-e554-45c0-a259-cbc855c92625 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:54.762650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc76c6-b0a9-4f64-b4e3-faaa78382bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:54.763704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc76c6-b0a9-4f64-b4e3-faaa78382bfc None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:54.764414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc76c6-b0a9-4f64-b4e3-faaa78382bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:54.764938 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc76c6-b0a9-4f64-b4e3-faaa78382bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:54.766348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc76c6-b0a9-4f64-b4e3-faaa78382bfc None admin] RBAC: Adding query filter params (role.id=23bfcdf883144a0b8740e12c6a6de7e3, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc, user.id=688f54c8b16b4188b4bc42b526a8f4c5) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:54.766881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc76c6-b0a9-4f64-b4e3-faaa78382bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:54.769920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bc76c6-b0a9-4f64-b4e3-faaa78382bfc None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:54.781606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 44/90] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:54 2022] GET /identity/v3/role_assignments?user.id=688f54c8b16b4188b4bc42b526a8f4c5&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 259 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:54.788240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc76c6-b0a9-4f64-b4e3-faaa78382bfc None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:54.995067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb5c632-e554-45c0-a259-cbc855c92625 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.058033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc76c6-b0a9-4f64-b4e3-faaa78382bfc None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.123925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65a368-9316-4b8f-b2b3-12930256e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.124979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65a368-9316-4b8f-b2b3-12930256e5cc None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.125467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65a368-9316-4b8f-b2b3-12930256e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.125947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65a368-9316-4b8f-b2b3-12930256e5cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.133611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699d14d-7202-41a2-a033-89f454ab337a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.134680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699d14d-7202-41a2-a033-89f454ab337a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.135178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699d14d-7202-41a2-a033-89f454ab337a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.135676 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699d14d-7202-41a2-a033-89f454ab337a None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.140782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699d14d-7202-41a2-a033-89f454ab337a None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.143509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699d14d-7202-41a2-a033-89f454ab337a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.146674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 47/91] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:26:54 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:55.159423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699d14d-7202-41a2-a033-89f454ab337a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.197133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:55.308638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:55.375197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65a368-9316-4b8f-b2b3-12930256e5cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.376945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65a368-9316-4b8f-b2b3-12930256e5cc None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.401956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699d14d-7202-41a2-a033-89f454ab337a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.476950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb27192-b9f8-4fff-ac89-22009f97cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.478891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27192-b9f8-4fff-ac89-22009f97cf72 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.479390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27192-b9f8-4fff-ac89-22009f97cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.479887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb27192-b9f8-4fff-ac89-22009f97cf72 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.482037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb27192-b9f8-4fff-ac89-22009f97cf72 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.485046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb27192-b9f8-4fff-ac89-22009f97cf72 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.488627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 48/92] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:55.491454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb27192-b9f8-4fff-ac89-22009f97cf72 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.664437 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 45/93] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 882 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:26:55.665038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65a368-9316-4b8f-b2b3-12930256e5cc None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.733593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb27192-b9f8-4fff-ac89-22009f97cf72 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:55.789171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:55.806798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a951cb-05bf-45b3-b0cb-3e42c2cf0189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:55.808426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a951cb-05bf-45b3-b0cb-3e42c2cf0189 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:55.810048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a951cb-05bf-45b3-b0cb-3e42c2cf0189 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:55.810048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a951cb-05bf-45b3-b0cb-3e42c2cf0189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:55.811024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a951cb-05bf-45b3-b0cb-3e42c2cf0189 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc, user.id=19faba1f83d443dbaca1d7f5b1b4a452) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:55.811568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a951cb-05bf-45b3-b0cb-3e42c2cf0189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:55.815271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a951cb-05bf-45b3-b0cb-3e42c2cf0189 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:55.828994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 49/94] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/role_assignments?user.id=19faba1f83d443dbaca1d7f5b1b4a452&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=c0316e22a13a4034846c451753b4c14e => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:55.830834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a951cb-05bf-45b3-b0cb-3e42c2cf0189 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:55.867220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:56.047003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65a368-9316-4b8f-b2b3-12930256e5cc None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:56.053075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a951cb-05bf-45b3-b0cb-3e42c2cf0189 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:56.128548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57864605-b49c-40c1-8d14-cecdf78f6e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:56.129854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57864605-b49c-40c1-8d14-cecdf78f6e22 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.130355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57864605-b49c-40c1-8d14-cecdf78f6e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.130848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57864605-b49c-40c1-8d14-cecdf78f6e22 None admin] PATH_INFO: `/v3/projects/3b83fad5d1224553b0b862d4f56147bf` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.133956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57864605-b49c-40c1-8d14-cecdf78f6e22 None admin] RBAC: Authorizing `identity:get_project(project_id=3b83fad5d1224553b0b862d4f56147bf)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:56.136777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57864605-b49c-40c1-8d14-cecdf78f6e22 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:56.140959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 50/95] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/projects/3b83fad5d1224553b0b862d4f56147bf => generated 312 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:56.151884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57864605-b49c-40c1-8d14-cecdf78f6e22 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:56.181713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ea8e8-e3f3-4868-99f5-70d3c85ea2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:56.182547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea8e8-e3f3-4868-99f5-70d3c85ea2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.182901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea8e8-e3f3-4868-99f5-70d3c85ea2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.183245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ea8e8-e3f3-4868-99f5-70d3c85ea2e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.183975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ea8e8-e3f3-4868-99f5-70d3c85ea2e2 None admin] RBAC: Adding query filter params (role.id=971e130ba91d4b7ab75b8e33d322760b, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc, user.id=688f54c8b16b4188b4bc42b526a8f4c5) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:56.184291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ea8e8-e3f3-4868-99f5-70d3c85ea2e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:56.185841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ea8e8-e3f3-4868-99f5-70d3c85ea2e2 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:56.207046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 46/96] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:55 2022] GET /identity/v3/role_assignments?user.id=688f54c8b16b4188b4bc42b526a8f4c5&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=971e130ba91d4b7ab75b8e33d322760b => generated 259 bytes in 542 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:56.273873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:56.372021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57864605-b49c-40c1-8d14-cecdf78f6e22 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:56.443111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f605f-1a42-41fc-a914-0a8bd1dc7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:56.444185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f605f-1a42-41fc-a914-0a8bd1dc7594 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:56.445303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f605f-1a42-41fc-a914-0a8bd1dc7594 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:56.445817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f605f-1a42-41fc-a914-0a8bd1dc7594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:56.447286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f605f-1a42-41fc-a914-0a8bd1dc7594 None admin] RBAC: Adding query filter params (role.id=23bfcdf883144a0b8740e12c6a6de7e3, scope.project.id=3b83fad5d1224553b0b862d4f56147bf, user.id=688f54c8b16b4188b4bc42b526a8f4c5) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:56.447854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f605f-1a42-41fc-a914-0a8bd1dc7594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:56.450775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f605f-1a42-41fc-a914-0a8bd1dc7594 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:56.462564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 51/97] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:26:56 2022] GET /identity/v3/role_assignments?user.id=688f54c8b16b4188b4bc42b526a8f4c5&scope.project.id=3b83fad5d1224553b0b862d4f56147bf&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:57.176980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba95a6-e23f-4f52-8225-842df32c053e None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:57.177471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba95a6-e23f-4f52-8225-842df32c053e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:57.177966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba95a6-e23f-4f52-8225-842df32c053e None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:57.181064 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 47/98] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:26:57.190190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d564e9-88d7-4ffe-b1dc-1ee6a0566222 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:57.191784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d564e9-88d7-4ffe-b1dc-1ee6a0566222 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:57.191784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d564e9-88d7-4ffe-b1dc-1ee6a0566222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:57.233496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-98d564e9-88d7-4ffe-b1dc-1ee6a0566222 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:57.238401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-98d564e9-88d7-4ffe-b1dc-1ee6a0566222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:57.451594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 52/99] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:26:58.075566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba95a6-e23f-4f52-8225-842df32c053e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:58.233634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d4345-7856-459e-942b-5ff86ddd6c89 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:58.234632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d4345-7856-459e-942b-5ff86ddd6c89 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:58.235115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d4345-7856-459e-942b-5ff86ddd6c89 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:58.237051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 53/100] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:58.243835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a095f-3c15-4657-af3f-42829fb28d17 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:58.244710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a095f-3c15-4657-af3f-42829fb28d17 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:58.245367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a095f-3c15-4657-af3f-42829fb28d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:58.306295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-798a095f-3c15-4657-af3f-42829fb28d17 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:58.312421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-798a095f-3c15-4657-af3f-42829fb28d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:58.344950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba95a6-e23f-4f52-8225-842df32c053e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:58.359322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:58.390057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5806a1-5d6e-4112-b6a7-e75e3a5e23a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:58.391091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5806a1-5d6e-4112-b6a7-e75e3a5e23a6 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:58.391699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5806a1-5d6e-4112-b6a7-e75e3a5e23a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:58.392231 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5806a1-5d6e-4112-b6a7-e75e3a5e23a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:58.393774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5806a1-5d6e-4112-b6a7-e75e3a5e23a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:58.395584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5806a1-5d6e-4112-b6a7-e75e3a5e23a6 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:58.397874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 48/101] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:26:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:58.406882 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5806a1-5d6e-4112-b6a7-e75e3a5e23a6 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:58.461508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:58.529838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 54/102] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:58.604453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5806a1-5d6e-4112-b6a7-e75e3a5e23a6 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:58.706327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415a753-c6eb-4879-953f-22279c3652a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:58.707382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a753-c6eb-4879-953f-22279c3652a5 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:58.707895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a753-c6eb-4879-953f-22279c3652a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:58.708400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415a753-c6eb-4879-953f-22279c3652a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:58.709677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415a753-c6eb-4879-953f-22279c3652a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:58.713322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b415a753-c6eb-4879-953f-22279c3652a5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:58.868102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 49/103] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:26:58 2022] POST /identity/v3/projects => generated 302 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:26:59.011295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a095f-3c15-4657-af3f-42829fb28d17 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:59.205595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a095f-3c15-4657-af3f-42829fb28d17 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:59.255522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa86b5-665b-4526-b292-5047fdd3e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:59.257071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa86b5-665b-4526-b292-5047fdd3e278 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.257598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa86b5-665b-4526-b292-5047fdd3e278 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.258076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa86b5-665b-4526-b292-5047fdd3e278 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.274769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfa86b5-665b-4526-b292-5047fdd3e278 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-cbfa86b5-665b-4526-b292-5047fdd3e278 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:26:59.280706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:26:59.281634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:26:59.282442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:26:59.284871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 55/104] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:26:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:26:59.292089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415a753-c6eb-4879-953f-22279c3652a5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:59.351990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:59.358589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d3736-789c-4f86-a500-39a6e58b6257 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.359089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d3736-789c-4f86-a500-39a6e58b6257 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.359583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d3736-789c-4f86-a500-39a6e58b6257 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.362280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 56/105] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:26:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:26:59.381359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cbced-24e3-40fa-9fc5-7c2d873f138c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.381860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cbced-24e3-40fa-9fc5-7c2d873f138c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.382390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cbced-24e3-40fa-9fc5-7c2d873f138c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.417672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-379cbced-24e3-40fa-9fc5-7c2d873f138c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:26:59.419637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-379cbced-24e3-40fa-9fc5-7c2d873f138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:26:59.490507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:26:59.502992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b415a753-c6eb-4879-953f-22279c3652a5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:59.552712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 57/106] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:26:59.594963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c77b-35ac-4c89-9cba-efa1feec4ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:59.596026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c77b-35ac-4c89-9cba-efa1feec4ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.596544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c77b-35ac-4c89-9cba-efa1feec4ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.597103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24c77b-35ac-4c89-9cba-efa1feec4ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.598090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24c77b-35ac-4c89-9cba-efa1feec4ed5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:26:59.598622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24c77b-35ac-4c89-9cba-efa1feec4ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:59.600372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24c77b-35ac-4c89-9cba-efa1feec4ed5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:59.614773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 50/107] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:26:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:26:59.621955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cbced-24e3-40fa-9fc5-7c2d873f138c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:26:59.834455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cbced-24e3-40fa-9fc5-7c2d873f138c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:26:59.899958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eb1ae-9df3-4cd8-ae42-e1e588e15c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:26:59.901047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eb1ae-9df3-4cd8-ae42-e1e588e15c55 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:26:59.901513 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eb1ae-9df3-4cd8-ae42-e1e588e15c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:26:59.901990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758eb1ae-9df3-4cd8-ae42-e1e588e15c55 None admin] PATH_INFO: `/v3/users/4bd591d0bbfd4f2b9675b7428c974ea1` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:26:59.928026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758eb1ae-9df3-4cd8-ae42-e1e588e15c55 None admin] RBAC: Authorizing `identity:get_user(user_id=4bd591d0bbfd4f2b9675b7428c974ea1)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:26:59.931046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758eb1ae-9df3-4cd8-ae42-e1e588e15c55 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:26:59.936714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 58/108] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:26:59 2022] GET /identity/v3/users/4bd591d0bbfd4f2b9675b7428c974ea1 => generated 289 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:26:59.943313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c77b-35ac-4c89-9cba-efa1feec4ed5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:00.135943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eb1ae-9df3-4cd8-ae42-e1e588e15c55 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:00.218310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:00.222295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:00.236672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24c77b-35ac-4c89-9cba-efa1feec4ed5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:00.295377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec503673-1fbc-4bee-89ec-b7046ce49b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:00.295377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec503673-1fbc-4bee-89ec-b7046ce49b29 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.295377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec503673-1fbc-4bee-89ec-b7046ce49b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.295377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec503673-1fbc-4bee-89ec-b7046ce49b29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.427047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758eb1ae-9df3-4cd8-ae42-e1e588e15c55 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:00.479009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec503673-1fbc-4bee-89ec-b7046ce49b29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:00.481449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec503673-1fbc-4bee-89ec-b7046ce49b29 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:00.508705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e7c25-6829-4afe-ac45-e6bdd7677e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:00.509945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7c25-6829-4afe-ac45-e6bdd7677e75 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.510465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7c25-6829-4afe-ac45-e6bdd7677e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.510921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e7c25-6829-4afe-ac45-e6bdd7677e75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.540771 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e7c25-6829-4afe-ac45-e6bdd7677e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-0b4e7c25-6829-4afe-ac45-e6bdd7677e75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:00.546444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:00.547485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:00.548249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:00.551167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 59/109] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:00.552869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981feb3e-d30a-4f1f-afaf-9acc706d7416 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.553335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981feb3e-d30a-4f1f-afaf-9acc706d7416 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.553769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981feb3e-d30a-4f1f-afaf-9acc706d7416 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.556659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 60/110] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:00.562289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d77bd1-5d06-4329-9083-df5fef2891cf None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.563150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d77bd1-5d06-4329-9083-df5fef2891cf None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.563646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d77bd1-5d06-4329-9083-df5fef2891cf None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.565374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 61/111] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:00.566788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256bf0d-7005-405b-acf5-45f6a7cebdcf None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.567341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256bf0d-7005-405b-acf5-45f6a7cebdcf None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.567836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256bf0d-7005-405b-acf5-45f6a7cebdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.602836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e256bf0d-7005-405b-acf5-45f6a7cebdcf None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:00.606312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e256bf0d-7005-405b-acf5-45f6a7cebdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:00.656120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:00.684824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 51/112] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 742 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:00.688321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ae1cb-0f9d-4e6a-912c-eb55ad830079 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:00.689079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ae1cb-0f9d-4e6a-912c-eb55ad830079 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:00.689803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ae1cb-0f9d-4e6a-912c-eb55ad830079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:00.729758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 62/113] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:00.736524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256bf0d-7005-405b-acf5-45f6a7cebdcf None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:00.736769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-f27ae1cb-0f9d-4e6a-912c-eb55ad830079 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:00.736769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f27ae1cb-0f9d-4e6a-912c-eb55ad830079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:00.784519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:00.910731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 52/114] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:00.910731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ae1cb-0f9d-4e6a-912c-eb55ad830079 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:01.058899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256bf0d-7005-405b-acf5-45f6a7cebdcf None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:01.119666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ae1cb-0f9d-4e6a-912c-eb55ad830079 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:01.182716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:01.191301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56d492-db07-4917-a8a9-6d720e356456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:01.192194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56d492-db07-4917-a8a9-6d720e356456 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.192333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56d492-db07-4917-a8a9-6d720e356456 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.192617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56d492-db07-4917-a8a9-6d720e356456 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.193228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56d492-db07-4917-a8a9-6d720e356456 None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:01.193529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56d492-db07-4917-a8a9-6d720e356456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:01.195576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56d492-db07-4917-a8a9-6d720e356456 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:01.206696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007690fd-d99e-4315-957e-6757e78fbfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:01.206997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 63/115] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:01.208320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007690fd-d99e-4315-957e-6757e78fbfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.208850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007690fd-d99e-4315-957e-6757e78fbfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.209413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007690fd-d99e-4315-957e-6757e78fbfc0 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.212285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007690fd-d99e-4315-957e-6757e78fbfc0 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:01.213447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e6f9c-eff6-49c1-90be-64331f645eeb None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.213735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e6f9c-eff6-49c1-90be-64331f645eeb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.214014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e6f9c-eff6-49c1-90be-64331f645eeb None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.215213 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007690fd-d99e-4315-957e-6757e78fbfc0 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:01.215747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 64/116] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:01.216253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e6f9c-eff6-49c1-90be-64331f645eeb None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:01.218766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 53/117] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:00 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:01.220161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007690fd-d99e-4315-957e-6757e78fbfc0 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:01.341866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007690fd-d99e-4315-957e-6757e78fbfc0 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:01.349439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:01.381216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e6f9c-eff6-49c1-90be-64331f645eeb None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:01.383710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1bea7-1f90-4754-843a-5e3b71e26e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:01.384370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1bea7-1f90-4754-843a-5e3b71e26e67 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.384947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1bea7-1f90-4754-843a-5e3b71e26e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.385379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1bea7-1f90-4754-843a-5e3b71e26e67 None admin] PATH_INFO: `/v3/users/688f54c8b16b4188b4bc42b526a8f4c5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.386780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1bea7-1f90-4754-843a-5e3b71e26e67 None admin] RBAC: Authorizing `identity:get_user(user_id=688f54c8b16b4188b4bc42b526a8f4c5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:01.388502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1bea7-1f90-4754-843a-5e3b71e26e67 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:01.390462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 54/118] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:01 2022] GET /identity/v3/users/688f54c8b16b4188b4bc42b526a8f4c5 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:01.391927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59e44f-f5d1-42dc-95a4-23154bfb4639 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.392356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59e44f-f5d1-42dc-95a4-23154bfb4639 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.392792 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59e44f-f5d1-42dc-95a4-23154bfb4639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.415204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9c59e44f-f5d1-42dc-95a4-23154bfb4639 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:01.416720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9c59e44f-f5d1-42dc-95a4-23154bfb4639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:01.430779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a208f12-11fa-401a-a297-bc23b1761c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:01.431443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208f12-11fa-401a-a297-bc23b1761c38 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.431722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208f12-11fa-401a-a297-bc23b1761c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.432076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a208f12-11fa-401a-a297-bc23b1761c38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.445755 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a208f12-11fa-401a-a297-bc23b1761c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-5a208f12-11fa-401a-a297-bc23b1761c38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:01.452011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:01.453051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 65/119] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:27:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:01.454025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a208f12-11fa-401a-a297-bc23b1761c38 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:01.486645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:01.502261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 55/120] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:01.503505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59e44f-f5d1-42dc-95a4-23154bfb4639 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:01.655075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a208f12-11fa-401a-a297-bc23b1761c38 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:01.702933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59e44f-f5d1-42dc-95a4-23154bfb4639 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:01.721021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5850ab-a291-424d-a70e-352f6a5adc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:01.722432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5850ab-a291-424d-a70e-352f6a5adc48 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.723216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5850ab-a291-424d-a70e-352f6a5adc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.724058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5850ab-a291-424d-a70e-352f6a5adc48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.725438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5850ab-a291-424d-a70e-352f6a5adc48 None admin] RBAC: Adding query filter params (role.id=a88f94e8d7794f1b8513bad8de38ebb9, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc, user.id=4bd591d0bbfd4f2b9675b7428c974ea1) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:01.726208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5850ab-a291-424d-a70e-352f6a5adc48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:01.729455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5850ab-a291-424d-a70e-352f6a5adc48 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:01.748673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 66/121] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:01 2022] GET /identity/v3/role_assignments?user.id=4bd591d0bbfd4f2b9675b7428c974ea1&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=a88f94e8d7794f1b8513bad8de38ebb9 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:01.751081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5850ab-a291-424d-a70e-352f6a5adc48 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:01.762535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:01.788576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f4503-c7dd-4ba1-816f-b69591fd3c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:01.789733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4503-c7dd-4ba1-816f-b69591fd3c99 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:01.790337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4503-c7dd-4ba1-816f-b69591fd3c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:01.790836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f4503-c7dd-4ba1-816f-b69591fd3c99 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:01.795759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f4503-c7dd-4ba1-816f-b69591fd3c99 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:01.803083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f4503-c7dd-4ba1-816f-b69591fd3c99 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:01.812289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 56/122] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:01 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:01.813411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f4503-c7dd-4ba1-816f-b69591fd3c99 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:01.917476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:01.969564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f4503-c7dd-4ba1-816f-b69591fd3c99 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:01.973384 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5850ab-a291-424d-a70e-352f6a5adc48 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:02.032599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e003d3-191f-4895-9dc7-1f6687425cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.033415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e003d3-191f-4895-9dc7-1f6687425cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.033696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f8e48-bce3-4c09-893a-3a5fc1ca9627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.033876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e003d3-191f-4895-9dc7-1f6687425cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.034295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e003d3-191f-4895-9dc7-1f6687425cb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.034783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f8e48-bce3-4c09-893a-3a5fc1ca9627 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.035216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f8e48-bce3-4c09-893a-3a5fc1ca9627 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.035643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f8e48-bce3-4c09-893a-3a5fc1ca9627 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.036567 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f8e48-bce3-4c09-893a-3a5fc1ca9627 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:02.037155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f8e48-bce3-4c09-893a-3a5fc1ca9627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:02.039410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f8e48-bce3-4c09-893a-3a5fc1ca9627 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:02.049962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e003d3-191f-4895-9dc7-1f6687425cb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:02.052411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 67/123] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:02.053662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f8e48-bce3-4c09-893a-3a5fc1ca9627 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-04e003d3-191f-4895-9dc7-1f6687425cb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:02.061065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:02.062084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:02.062854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:02.066501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 57/124] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:02.067653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e003d3-191f-4895-9dc7-1f6687425cb4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.207194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:02.211679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e003d3-191f-4895-9dc7-1f6687425cb4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:02.239433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:02.275450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd6bd3-6b47-4411-af85-40fc7ecfb5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.277768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd6bd3-6b47-4411-af85-40fc7ecfb5ad None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.283513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd6bd3-6b47-4411-af85-40fc7ecfb5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.283513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd6bd3-6b47-4411-af85-40fc7ecfb5ad None admin] PATH_INFO: `/v3/users/688f54c8b16b4188b4bc42b526a8f4c5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.283513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd6bd3-6b47-4411-af85-40fc7ecfb5ad None admin] RBAC: Authorizing `identity:get_user(user_id=688f54c8b16b4188b4bc42b526a8f4c5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:02.283926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f8e48-bce3-4c09-893a-3a5fc1ca9627 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:02.284305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd6bd3-6b47-4411-af85-40fc7ecfb5ad None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:02.288274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 58/125] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:02 2022] GET /identity/v3/users/688f54c8b16b4188b4bc42b526a8f4c5 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:02.291525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd6bd3-6b47-4411-af85-40fc7ecfb5ad None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.343243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b120af-3062-421c-bfe8-42c98cf88448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.344951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b120af-3062-421c-bfe8-42c98cf88448 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.346002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b120af-3062-421c-bfe8-42c98cf88448 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.346937 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b120af-3062-421c-bfe8-42c98cf88448 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/users/688f54c8b16b4188b4bc42b526a8f4c5/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.350898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b120af-3062-421c-bfe8-42c98cf88448 None admin] RBAC: Authorizing `identity:create_grant(project_id=87dc8cdee5be43449bfb5448b4d713cc, user_id=688f54c8b16b4188b4bc42b526a8f4c5, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:02.354106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b120af-3062-421c-bfe8-42c98cf88448 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:02.464135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 68/126] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:02 2022] PUT /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/users/688f54c8b16b4188b4bc42b526a8f4c5/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:02.468880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b120af-3062-421c-bfe8-42c98cf88448 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.547861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd6bd3-6b47-4411-af85-40fc7ecfb5ad None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:02.663410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb1ef8-2092-46be-a250-3d68ea32c513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.665084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1ef8-2092-46be-a250-3d68ea32c513 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.665575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1ef8-2092-46be-a250-3d68ea32c513 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.666209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb1ef8-2092-46be-a250-3d68ea32c513 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.701024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb1ef8-2092-46be-a250-3d68ea32c513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:02.714625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b120af-3062-421c-bfe8-42c98cf88448 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-85fb1ef8-2092-46be-a250-3d68ea32c513 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:02.721020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:02.722747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:02.724277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 59/127] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:02.728848 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb1ef8-2092-46be-a250-3d68ea32c513 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.781602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:02.802207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c779d-0f84-457c-8fe7-4cacfccce62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:02.803906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c779d-0f84-457c-8fe7-4cacfccce62b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:02.804878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c779d-0f84-457c-8fe7-4cacfccce62b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:02.805683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c779d-0f84-457c-8fe7-4cacfccce62b None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:02.808287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c779d-0f84-457c-8fe7-4cacfccce62b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:02.809478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c779d-0f84-457c-8fe7-4cacfccce62b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:02.812806 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c779d-0f84-457c-8fe7-4cacfccce62b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:02.835211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 69/128] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:02.840248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c779d-0f84-457c-8fe7-4cacfccce62b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:02.902931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:03.018698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb1ef8-2092-46be-a250-3d68ea32c513 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:03.086528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c779d-0f84-457c-8fe7-4cacfccce62b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:03.097678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff7892-0349-4512-a2ba-3b2e4f3f3c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:03.098751 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff7892-0349-4512-a2ba-3b2e4f3f3c7a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:03.099250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff7892-0349-4512-a2ba-3b2e4f3f3c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:03.099754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff7892-0349-4512-a2ba-3b2e4f3f3c7a None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:03.101518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff7892-0349-4512-a2ba-3b2e4f3f3c7a None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:03.105158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff7892-0349-4512-a2ba-3b2e4f3f3c7a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:03.108153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 60/129] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:02 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:03.109449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff7892-0349-4512-a2ba-3b2e4f3f3c7a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:03.152984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbeb15-3cff-471b-9dbd-6df2d22fa9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:03.154113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbeb15-3cff-471b-9dbd-6df2d22fa9f0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:03.155094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbeb15-3cff-471b-9dbd-6df2d22fa9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:03.155605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbeb15-3cff-471b-9dbd-6df2d22fa9f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:03.156629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbeb15-3cff-471b-9dbd-6df2d22fa9f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:03.157494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbeb15-3cff-471b-9dbd-6df2d22fa9f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:03.159992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbeb15-3cff-471b-9dbd-6df2d22fa9f0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:03.174891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 70/130] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:03.177099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158e51-4663-48db-89c2-7cc7706cd61c None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:03.177900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158e51-4663-48db-89c2-7cc7706cd61c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:03.180031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9158e51-4663-48db-89c2-7cc7706cd61c None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:03.181727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 71/131] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:03.182870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158e51-4663-48db-89c2-7cc7706cd61c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:03.293864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:03.337068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff7892-0349-4512-a2ba-3b2e4f3f3c7a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:03.357373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:03.390499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab9d41-0087-4765-b051-1924cb7d16cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:03.392730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab9d41-0087-4765-b051-1924cb7d16cd None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:03.394054 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9158e51-4663-48db-89c2-7cc7706cd61c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:03.394485 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab9d41-0087-4765-b051-1924cb7d16cd None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:03.395214 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab9d41-0087-4765-b051-1924cb7d16cd None admin] PATH_INFO: `/v3/users/19faba1f83d443dbaca1d7f5b1b4a452` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:03.398211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab9d41-0087-4765-b051-1924cb7d16cd None admin] RBAC: Authorizing `identity:get_user(user_id=19faba1f83d443dbaca1d7f5b1b4a452)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:03.402822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab9d41-0087-4765-b051-1924cb7d16cd None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:03.406229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 61/132] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:03 2022] GET /identity/v3/users/19faba1f83d443dbaca1d7f5b1b4a452 => generated 247 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:03.407684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab9d41-0087-4765-b051-1924cb7d16cd None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:03.481143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110080e3-3968-4fff-afca-1307019f1d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:03.484748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110080e3-3968-4fff-afca-1307019f1d01 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:03.485585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110080e3-3968-4fff-afca-1307019f1d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:03.486315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110080e3-3968-4fff-afca-1307019f1d01 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/users/688f54c8b16b4188b4bc42b526a8f4c5/roles/971e130ba91d4b7ab75b8e33d322760b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:03.490661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110080e3-3968-4fff-afca-1307019f1d01 None admin] RBAC: Authorizing `identity:create_grant(project_id=87dc8cdee5be43449bfb5448b4d713cc, user_id=688f54c8b16b4188b4bc42b526a8f4c5, role_id=971e130ba91d4b7ab75b8e33d322760b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:03.495622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110080e3-3968-4fff-afca-1307019f1d01 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:03.620347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab9d41-0087-4765-b051-1924cb7d16cd None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:03.637288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 72/133] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:03 2022] PUT /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/users/688f54c8b16b4188b4bc42b526a8f4c5/roles/971e130ba91d4b7ab75b8e33d322760b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:03.641386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bf590-d4a4-41f2-b3bc-76d7af673577 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:03.642486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bf590-d4a4-41f2-b3bc-76d7af673577 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:03.643276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bf590-d4a4-41f2-b3bc-76d7af673577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:03.699773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a04bf590-d4a4-41f2-b3bc-76d7af673577 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:03.703447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a04bf590-d4a4-41f2-b3bc-76d7af673577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:03.769407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc23886-dd42-4a8c-9245-92c43a244454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:03.770100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc23886-dd42-4a8c-9245-92c43a244454 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:03.770381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc23886-dd42-4a8c-9245-92c43a244454 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:03.770660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc23886-dd42-4a8c-9245-92c43a244454 None admin] PATH_INFO: `/v3/users/688f54c8b16b4188b4bc42b526a8f4c5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:03.772573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc23886-dd42-4a8c-9245-92c43a244454 None admin] RBAC: Authorizing `identity:get_user(user_id=688f54c8b16b4188b4bc42b526a8f4c5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:03.774831 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc23886-dd42-4a8c-9245-92c43a244454 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:03.777086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 62/134] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:03 2022] GET /identity/v3/users/688f54c8b16b4188b4bc42b526a8f4c5 => generated 275 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:03.777733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc23886-dd42-4a8c-9245-92c43a244454 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:03.855808 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 73/135] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:03.860123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bf590-d4a4-41f2-b3bc-76d7af673577 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:03.901327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:03.993213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:04.037080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bf590-d4a4-41f2-b3bc-76d7af673577 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:04.041898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc23886-dd42-4a8c-9245-92c43a244454 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:04.118179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422cc05-256c-4745-b060-f352e58c6dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:04.118845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422cc05-256c-4745-b060-f352e58c6dbc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:04.119122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422cc05-256c-4745-b060-f352e58c6dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:04.119393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422cc05-256c-4745-b060-f352e58c6dbc None admin] PATH_INFO: `/v3/projects/3b83fad5d1224553b0b862d4f56147bf` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:04.125395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422cc05-256c-4745-b060-f352e58c6dbc None admin] RBAC: Authorizing `identity:get_project(project_id=3b83fad5d1224553b0b862d4f56147bf)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:04.125683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d05919-7f5d-41b4-9e1f-577211b92813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:04.126800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d05919-7f5d-41b4-9e1f-577211b92813 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:04.126905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422cc05-256c-4745-b060-f352e58c6dbc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:04.127296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d05919-7f5d-41b4-9e1f-577211b92813 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:04.127799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d05919-7f5d-41b4-9e1f-577211b92813 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:04.128731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 74/136] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:03 2022] GET /identity/v3/projects/3b83fad5d1224553b0b862d4f56147bf => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:04.130227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d05919-7f5d-41b4-9e1f-577211b92813 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:04.133943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d05919-7f5d-41b4-9e1f-577211b92813 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:04.138775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422cc05-256c-4745-b060-f352e58c6dbc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:04.144186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 63/137] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:03 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:04.147465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d05919-7f5d-41b4-9e1f-577211b92813 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:04.458562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422cc05-256c-4745-b060-f352e58c6dbc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:04.462117 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d05919-7f5d-41b4-9e1f-577211b92813 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:04.474485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:04.520158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:04.521848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd36d-df15-4024-9db6-16f55afba5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:04.522577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd36d-df15-4024-9db6-16f55afba5f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:04.522859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd36d-df15-4024-9db6-16f55afba5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:04.523106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdd36d-df15-4024-9db6-16f55afba5f6 None admin] PATH_INFO: `/v3/projects/3b83fad5d1224553b0b862d4f56147bf/users/688f54c8b16b4188b4bc42b526a8f4c5/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:04.530198 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdd36d-df15-4024-9db6-16f55afba5f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b83fad5d1224553b0b862d4f56147bf, user_id=688f54c8b16b4188b4bc42b526a8f4c5, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:04.531691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdd36d-df15-4024-9db6-16f55afba5f6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:04.575342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13a5ea-dcf8-4f85-bb1c-cc628cc27a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:04.577000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13a5ea-dcf8-4f85-bb1c-cc628cc27a02 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:04.577778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13a5ea-dcf8-4f85-bb1c-cc628cc27a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:04.578513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13a5ea-dcf8-4f85-bb1c-cc628cc27a02 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/users/19faba1f83d443dbaca1d7f5b1b4a452/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:04.585148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13a5ea-dcf8-4f85-bb1c-cc628cc27a02 None admin] RBAC: Authorizing `identity:create_grant(project_id=87dc8cdee5be43449bfb5448b4d713cc, user_id=19faba1f83d443dbaca1d7f5b1b4a452, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:04.589152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af13a5ea-dcf8-4f85-bb1c-cc628cc27a02 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:04.663389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 75/138] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:04 2022] PUT /identity/v3/projects/3b83fad5d1224553b0b862d4f56147bf/users/688f54c8b16b4188b4bc42b526a8f4c5/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:27:04.713948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd36d-df15-4024-9db6-16f55afba5f6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:04.714439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 64/139] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:04 2022] PUT /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/users/19faba1f83d443dbaca1d7f5b1b4a452/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:04.883387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdd36d-df15-4024-9db6-16f55afba5f6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:04.940238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38bf2e-0157-4216-8e77-5da9349877f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:04.940986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38bf2e-0157-4216-8e77-5da9349877f9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:04.941261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38bf2e-0157-4216-8e77-5da9349877f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:04.941541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38bf2e-0157-4216-8e77-5da9349877f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:04.943035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38bf2e-0157-4216-8e77-5da9349877f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:04.944728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38bf2e-0157-4216-8e77-5da9349877f9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:04.947203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 76/140] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:04.957665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13a5ea-dcf8-4f85-bb1c-cc628cc27a02 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:05.083276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeb6c1-a656-43b7-bafe-a2ac4ac2bc82 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.083706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeb6c1-a656-43b7-bafe-a2ac4ac2bc82 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.083846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeb6c1-a656-43b7-bafe-a2ac4ac2bc82 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.085573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 77/141] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:05.091772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d76adb-f0b2-4bee-b075-997c61c0fcae None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.092152 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d76adb-f0b2-4bee-b075-997c61c0fcae None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.092373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d76adb-f0b2-4bee-b075-997c61c0fcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.142458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-00d76adb-f0b2-4bee-b075-997c61c0fcae None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:05.144749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-00d76adb-f0b2-4bee-b075-997c61c0fcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:05.229218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:05.276414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13a5ea-dcf8-4f85-bb1c-cc628cc27a02 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:05.307474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 78/142] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:27:05.341498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8cba5-cd6e-42af-a985-22d3ebf99f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:05.342409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8cba5-cd6e-42af-a985-22d3ebf99f4a None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.342820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8cba5-cd6e-42af-a985-22d3ebf99f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.343213 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8cba5-cd6e-42af-a985-22d3ebf99f4a None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.344204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8cba5-cd6e-42af-a985-22d3ebf99f4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:05.346498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8cba5-cd6e-42af-a985-22d3ebf99f4a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:05.509388 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 65/143] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:27:04 2022] POST /identity/v3/users => generated 283 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:05.753466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85564355-89cf-44e3-ae17-fb6e49e675ed None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.754240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85564355-89cf-44e3-ae17-fb6e49e675ed None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.754371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85564355-89cf-44e3-ae17-fb6e49e675ed None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.756804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 79/144] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:05.781123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bffdf-c519-4dd2-8acb-f098f67c1310 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:05.781914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bffdf-c519-4dd2-8acb-f098f67c1310 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:05.782082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bffdf-c519-4dd2-8acb-f098f67c1310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:05.810473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-123bffdf-c519-4dd2-8acb-f098f67c1310 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:05.811979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-123bffdf-c519-4dd2-8acb-f098f67c1310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:05.854798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:05.900390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85564355-89cf-44e3-ae17-fb6e49e675ed None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:05.925326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 66/145] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:27:06.042353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85564355-89cf-44e3-ae17-fb6e49e675ed None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:06.090516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e9aec-025d-4723-954b-8aa4aa157785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:06.091258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e9aec-025d-4723-954b-8aa4aa157785 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:06.091572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e9aec-025d-4723-954b-8aa4aa157785 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:06.091811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e9aec-025d-4723-954b-8aa4aa157785 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:06.111337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e9aec-025d-4723-954b-8aa4aa157785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a12e9aec-025d-4723-954b-8aa4aa157785 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:06.116469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:06.118637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:06.121445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 80/146] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:06.128720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bffdf-c519-4dd2-8acb-f098f67c1310 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:06.328920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bffdf-c519-4dd2-8acb-f098f67c1310 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:06.382762 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e9aec-025d-4723-954b-8aa4aa157785 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:06.396233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0de99-0a87-49f1-86a8-104bd54e88c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:06.397283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0de99-0a87-49f1-86a8-104bd54e88c4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:06.397771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0de99-0a87-49f1-86a8-104bd54e88c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:06.398775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a0de99-0a87-49f1-86a8-104bd54e88c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:06.399921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0de99-0a87-49f1-86a8-104bd54e88c4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:06.400718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0de99-0a87-49f1-86a8-104bd54e88c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:06.402658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a0de99-0a87-49f1-86a8-104bd54e88c4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:06.415773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 67/147] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:06.421541 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0de99-0a87-49f1-86a8-104bd54e88c4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:06.470558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:06.477677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:06.586833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a0de99-0a87-49f1-86a8-104bd54e88c4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:06.642739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbbe76-7502-4be7-b82e-8ddd28ecc353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:06.644292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbbe76-7502-4be7-b82e-8ddd28ecc353 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:06.646601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbbe76-7502-4be7-b82e-8ddd28ecc353 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:06.647434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbbe76-7502-4be7-b82e-8ddd28ecc353 None admin] PATH_INFO: `/v3/users/4bd591d0bbfd4f2b9675b7428c974ea1` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:06.650102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbbe76-7502-4be7-b82e-8ddd28ecc353 None admin] RBAC: Authorizing `identity:get_user(user_id=4bd591d0bbfd4f2b9675b7428c974ea1)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:06.655621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbbe76-7502-4be7-b82e-8ddd28ecc353 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:06.659361 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 68/148] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:06 2022] GET /identity/v3/users/4bd591d0bbfd4f2b9675b7428c974ea1 => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:06.668223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbbe76-7502-4be7-b82e-8ddd28ecc353 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:06.673887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e9aec-025d-4723-954b-8aa4aa157785 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:06.786172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b5b3-1f8f-4b44-8955-6f7b2825c972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:06.787217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b5b3-1f8f-4b44-8955-6f7b2825c972 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:06.787660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b5b3-1f8f-4b44-8955-6f7b2825c972 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:06.788147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97b5b3-1f8f-4b44-8955-6f7b2825c972 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:06.845615 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97b5b3-1f8f-4b44-8955-6f7b2825c972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-9c97b5b3-1f8f-4b44-8955-6f7b2825c972 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:06.851543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:06.852507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:06.853312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 81/149] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 471 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:06.861233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:06.865572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b5b3-1f8f-4b44-8955-6f7b2825c972 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:06.873794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbbe76-7502-4be7-b82e-8ddd28ecc353 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:06.927078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84ebd-615c-45f0-bad8-a3737024681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:06.928276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84ebd-615c-45f0-bad8-a3737024681f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:06.928935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84ebd-615c-45f0-bad8-a3737024681f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:06.930021 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84ebd-615c-45f0-bad8-a3737024681f None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:06.931700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84ebd-615c-45f0-bad8-a3737024681f None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:06.933647 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84ebd-615c-45f0-bad8-a3737024681f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:06.936102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 69/150] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:06 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:06.948144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84ebd-615c-45f0-bad8-a3737024681f None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:07.088727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:07.112154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97b5b3-1f8f-4b44-8955-6f7b2825c972 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:07.156938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d80b0-892c-414b-b1f5-7ed4e5eaffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:07.157577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d80b0-892c-414b-b1f5-7ed4e5eaffe2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.157895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d80b0-892c-414b-b1f5-7ed4e5eaffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.158185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d80b0-892c-414b-b1f5-7ed4e5eaffe2 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.158945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d80b0-892c-414b-b1f5-7ed4e5eaffe2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:07.159246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d80b0-892c-414b-b1f5-7ed4e5eaffe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:07.161682 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d80b0-892c-414b-b1f5-7ed4e5eaffe2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:07.174892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 82/151] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:07.177306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c82022-97b2-454b-8803-9e2c81c00b3e None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.177939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c82022-97b2-454b-8803-9e2c81c00b3e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.178271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c82022-97b2-454b-8803-9e2c81c00b3e None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.181348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 83/152] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:07.187911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c82022-97b2-454b-8803-9e2c81c00b3e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:07.275916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84ebd-615c-45f0-bad8-a3737024681f None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:07.337658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fd350-c93e-4dd1-8c84-e2859b268a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:07.338351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fd350-c93e-4dd1-8c84-e2859b268a82 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.338635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fd350-c93e-4dd1-8c84-e2859b268a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.338924 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fd350-c93e-4dd1-8c84-e2859b268a82 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/users/4bd591d0bbfd4f2b9675b7428c974ea1/roles/a88f94e8d7794f1b8513bad8de38ebb9` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.344029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fd350-c93e-4dd1-8c84-e2859b268a82 None admin] RBAC: Authorizing `identity:create_grant(project_id=87dc8cdee5be43449bfb5448b4d713cc, user_id=4bd591d0bbfd4f2b9675b7428c974ea1, role_id=a88f94e8d7794f1b8513bad8de38ebb9)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:07.350942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fd350-c93e-4dd1-8c84-e2859b268a82 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:07.397497 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c82022-97b2-454b-8803-9e2c81c00b3e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:07.458976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 70/153] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:06 2022] PUT /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/users/4bd591d0bbfd4f2b9675b7428c974ea1/roles/a88f94e8d7794f1b8513bad8de38ebb9 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:27:07.461745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116142ab-dfd2-419e-aedc-57bc6c3b6596 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.462239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116142ab-dfd2-419e-aedc-57bc6c3b6596 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.462718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116142ab-dfd2-419e-aedc-57bc6c3b6596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.490204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46047e-3b9e-4cb3-a5a2-633d46313944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:07.493105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46047e-3b9e-4cb3-a5a2-633d46313944 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.494368 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46047e-3b9e-4cb3-a5a2-633d46313944 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.494926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46047e-3b9e-4cb3-a5a2-633d46313944 None admin] PATH_INFO: `/v3/users/688f54c8b16b4188b4bc42b526a8f4c5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.499915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46047e-3b9e-4cb3-a5a2-633d46313944 None admin] RBAC: Authorizing `identity:get_user(user_id=688f54c8b16b4188b4bc42b526a8f4c5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:07.508222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46047e-3b9e-4cb3-a5a2-633d46313944 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:07.511579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 84/154] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:07 2022] GET /identity/v3/users/688f54c8b16b4188b4bc42b526a8f4c5 => generated 275 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:07.529111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46047e-3b9e-4cb3-a5a2-633d46313944 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:07.531228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-116142ab-dfd2-419e-aedc-57bc6c3b6596 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:07.537521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-116142ab-dfd2-419e-aedc-57bc6c3b6596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:07.597183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:07.604991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:07.754569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 71/155] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:07.777748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46047e-3b9e-4cb3-a5a2-633d46313944 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:07.833967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546187a-48c6-4eb7-8e7f-d6cfe6d6ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:07.834938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546187a-48c6-4eb7-8e7f-d6cfe6d6ace0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:07.834938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546187a-48c6-4eb7-8e7f-d6cfe6d6ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:07.835159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546187a-48c6-4eb7-8e7f-d6cfe6d6ace0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:07.958941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546187a-48c6-4eb7-8e7f-d6cfe6d6ace0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:07.962350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546187a-48c6-4eb7-8e7f-d6cfe6d6ace0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:07.988690 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.149862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 85/156] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:08.156727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116142ab-dfd2-419e-aedc-57bc6c3b6596 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.382081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116142ab-dfd2-419e-aedc-57bc6c3b6596 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.466226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1fd76-314b-4b4f-9c8f-5a49faaf0129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.467894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1fd76-314b-4b4f-9c8f-5a49faaf0129 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.468718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1fd76-314b-4b4f-9c8f-5a49faaf0129 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.469472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1fd76-314b-4b4f-9c8f-5a49faaf0129 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.474789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1fd76-314b-4b4f-9c8f-5a49faaf0129 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:08.478221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1fd76-314b-4b4f-9c8f-5a49faaf0129 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:08.482795 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 72/157] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:08 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:08.492357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546187a-48c6-4eb7-8e7f-d6cfe6d6ace0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.500048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1fd76-314b-4b4f-9c8f-5a49faaf0129 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:08.552360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.780361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546187a-48c6-4eb7-8e7f-d6cfe6d6ace0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.810184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1fd76-314b-4b4f-9c8f-5a49faaf0129 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:08.830181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:08.907615 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678df98-976c-4c91-8914-16c57789ce9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.909904 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678df98-976c-4c91-8914-16c57789ce9c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.910665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678df98-976c-4c91-8914-16c57789ce9c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.911337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678df98-976c-4c91-8914-16c57789ce9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.915644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678df98-976c-4c91-8914-16c57789ce9c None admin] RBAC: Adding query filter params (role.id=23bfcdf883144a0b8740e12c6a6de7e3, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc, user.id=688f54c8b16b4188b4bc42b526a8f4c5) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:08.916557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678df98-976c-4c91-8914-16c57789ce9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:08.921374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678df98-976c-4c91-8914-16c57789ce9c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:08.939719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 86/158] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:08 2022] GET /identity/v3/role_assignments?user.id=688f54c8b16b4188b4bc42b526a8f4c5&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 608 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:08.942868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b2b48-e1b8-4a37-90e7-110bb0a04b5b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.943722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b2b48-e1b8-4a37-90e7-110bb0a04b5b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.944775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b2b48-e1b8-4a37-90e7-110bb0a04b5b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.947598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 87/159] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:08.954287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001aa3-1718-49d4-b24a-53e70c47b434 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.955119 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001aa3-1718-49d4-b24a-53e70c47b434 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.955816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42001aa3-1718-49d4-b24a-53e70c47b434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:08.967102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecab1fe-964c-4f7e-8cc1-037fedf390e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:08.968527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecab1fe-964c-4f7e-8cc1-037fedf390e3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:08.969205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecab1fe-964c-4f7e-8cc1-037fedf390e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:08.969884 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecab1fe-964c-4f7e-8cc1-037fedf390e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:09.000394 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-42001aa3-1718-49d4-b24a-53e70c47b434 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:09.002920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-42001aa3-1718-49d4-b24a-53e70c47b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:09.016523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecab1fe-964c-4f7e-8cc1-037fedf390e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-8ecab1fe-964c-4f7e-8cc1-037fedf390e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:09.022350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:09.023377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:09.024166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:09.032046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 73/160] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:27:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 526 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:09.033914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecab1fe-964c-4f7e-8cc1-037fedf390e3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:09.206844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 88/161] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:09.291664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:09.343896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecab1fe-964c-4f7e-8cc1-037fedf390e3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:09.425452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae8d2-4fe8-45d1-9a06-5089bf974ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:09.426142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae8d2-4fe8-45d1-9a06-5089bf974ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:09.426502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae8d2-4fe8-45d1-9a06-5089bf974ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:09.426933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ae8d2-4fe8-45d1-9a06-5089bf974ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:09.428066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ae8d2-4fe8-45d1-9a06-5089bf974ea6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:09.428553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ae8d2-4fe8-45d1-9a06-5089bf974ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:09.430763 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ae8d2-4fe8-45d1-9a06-5089bf974ea6 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:09.452011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 74/162] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:09.462235 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001aa3-1718-49d4-b24a-53e70c47b434 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:09.706912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42001aa3-1718-49d4-b24a-53e70c47b434 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:09.736167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:09.786281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8f25c-c623-4fc5-99bb-027b2391ec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:09.787368 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f25c-c623-4fc5-99bb-027b2391ec04 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:09.787849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f25c-c623-4fc5-99bb-027b2391ec04 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:09.788332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f25c-c623-4fc5-99bb-027b2391ec04 None admin] PATH_INFO: `/v3/users/688f54c8b16b4188b4bc42b526a8f4c5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:09.793793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8f25c-c623-4fc5-99bb-027b2391ec04 None admin] RBAC: Authorizing `identity:get_user(user_id=688f54c8b16b4188b4bc42b526a8f4c5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:09.796633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8f25c-c623-4fc5-99bb-027b2391ec04 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:09.799722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 89/163] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:09 2022] GET /identity/v3/users/688f54c8b16b4188b4bc42b526a8f4c5 => generated 275 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:09.807126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae8d2-4fe8-45d1-9a06-5089bf974ea6 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:10.028527 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8f25c-c623-4fc5-99bb-027b2391ec04 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:10.065239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ae8d2-4fe8-45d1-9a06-5089bf974ea6 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:10.183373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d34a90-651b-4e2d-836e-f7d03d101874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:10.184354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d34a90-651b-4e2d-836e-f7d03d101874 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:10.184852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d34a90-651b-4e2d-836e-f7d03d101874 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:10.185321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d34a90-651b-4e2d-836e-f7d03d101874 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:10.221241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:10.398117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8f25c-c623-4fc5-99bb-027b2391ec04 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:10.445803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d34a90-651b-4e2d-836e-f7d03d101874 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:10.448564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d34a90-651b-4e2d-836e-f7d03d101874 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:10.530829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c0f75-e00a-48b9-84d0-50b9d36297bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:10.531835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c0f75-e00a-48b9-84d0-50b9d36297bb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:10.532291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c0f75-e00a-48b9-84d0-50b9d36297bb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:10.532772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c0f75-e00a-48b9-84d0-50b9d36297bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:10.588636 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c0f75-e00a-48b9-84d0-50b9d36297bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-c63c0f75-e00a-48b9-84d0-50b9d36297bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:10.617319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:10.619004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:10.620843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 90/164] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 592 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:10.626737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d93dd-5ce2-4d12-b6a1-2bf2bb3768f5 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:10.627191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d93dd-5ce2-4d12-b6a1-2bf2bb3768f5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:10.627674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d93dd-5ce2-4d12-b6a1-2bf2bb3768f5 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:10.630166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 91/165] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:10.641793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b8cf-e2bd-4148-b1cd-3cc09485a703 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:10.642223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b8cf-e2bd-4148-b1cd-3cc09485a703 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:10.642683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b8cf-e2bd-4148-b1cd-3cc09485a703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:10.713902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7077b8cf-e2bd-4148-b1cd-3cc09485a703 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:10.715916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7077b8cf-e2bd-4148-b1cd-3cc09485a703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:10.846260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:10.881961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 75/166] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1076 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:10.884080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d34a90-651b-4e2d-836e-f7d03d101874 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:10.984713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 92/167] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:10.986319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b8cf-e2bd-4148-b1cd-3cc09485a703 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.043897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.301569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d34a90-651b-4e2d-836e-f7d03d101874 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:11.361055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b8cf-e2bd-4148-b1cd-3cc09485a703 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:11.400390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e0bc4-c27b-435c-b01d-5b71d5c20c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:11.401619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0bc4-c27b-435c-b01d-5b71d5c20c85 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.402171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0bc4-c27b-435c-b01d-5b71d5c20c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.402677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0bc4-c27b-435c-b01d-5b71d5c20c85 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.403567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e0bc4-c27b-435c-b01d-5b71d5c20c85 None admin] RBAC: Adding query filter params (name=member) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:11.404249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e0bc4-c27b-435c-b01d-5b71d5c20c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:11.406118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e0bc4-c27b-435c-b01d-5b71d5c20c85 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:11.422329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 76/168] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 539 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:11.423977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5faee5-1e8e-45ee-bb2b-0b83da0dfdcc None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.424518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5faee5-1e8e-45ee-bb2b-0b83da0dfdcc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.424994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5faee5-1e8e-45ee-bb2b-0b83da0dfdcc None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.427185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 77/169] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:11.432595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5faee5-1e8e-45ee-bb2b-0b83da0dfdcc None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.490859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c30d7-a9ad-4d3e-8d27-08f62f8bfc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:11.491909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c30d7-a9ad-4d3e-8d27-08f62f8bfc35 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.492411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c30d7-a9ad-4d3e-8d27-08f62f8bfc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.496748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c30d7-a9ad-4d3e-8d27-08f62f8bfc35 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.497824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c30d7-a9ad-4d3e-8d27-08f62f8bfc35 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:11.500441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c30d7-a9ad-4d3e-8d27-08f62f8bfc35 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:11.508666 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 93/170] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:10 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:11.511893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08a24-f98b-4613-bfc1-5bc71ad1e89d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.511893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08a24-f98b-4613-bfc1-5bc71ad1e89d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.512196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08a24-f98b-4613-bfc1-5bc71ad1e89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.566369 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b7b08a24-f98b-4613-bfc1-5bc71ad1e89d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:11.568178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b7b08a24-f98b-4613-bfc1-5bc71ad1e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:11.681036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.701712 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5faee5-1e8e-45ee-bb2b-0b83da0dfdcc None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:11.704837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:11.730650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 94/171] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:11.731976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08a24-f98b-4613-bfc1-5bc71ad1e89d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.859347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c3ce6-6fe8-4f4c-b81a-f0ca9fd33a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:11.860356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3ce6-6fe8-4f4c-b81a-f0ca9fd33a71 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:11.860956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3ce6-6fe8-4f4c-b81a-f0ca9fd33a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:11.861460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3ce6-6fe8-4f4c-b81a-f0ca9fd33a71 None admin] PATH_INFO: `/v3/users/688f54c8b16b4188b4bc42b526a8f4c5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:11.867581 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c3ce6-6fe8-4f4c-b81a-f0ca9fd33a71 None admin] RBAC: Authorizing `identity:get_user(user_id=688f54c8b16b4188b4bc42b526a8f4c5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:11.870618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c3ce6-6fe8-4f4c-b81a-f0ca9fd33a71 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:11.883310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 78/172] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:11 2022] GET /identity/v3/users/688f54c8b16b4188b4bc42b526a8f4c5 => generated 275 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:11.884993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c3ce6-6fe8-4f4c-b81a-f0ca9fd33a71 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:11.953058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08a24-f98b-4613-bfc1-5bc71ad1e89d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.102629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa7363-96c1-4d3f-9436-f5a5277e96f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.103277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7363-96c1-4d3f-9436-f5a5277e96f7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.103652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7363-96c1-4d3f-9436-f5a5277e96f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.104210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7363-96c1-4d3f-9436-f5a5277e96f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.105027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa7363-96c1-4d3f-9436-f5a5277e96f7 None admin] RBAC: Adding query filter params (role.id=971e130ba91d4b7ab75b8e33d322760b, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc, user.id=688f54c8b16b4188b4bc42b526a8f4c5) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:12.105337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa7363-96c1-4d3f-9436-f5a5277e96f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.106911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa7363-96c1-4d3f-9436-f5a5277e96f7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.133534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 95/173] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:11 2022] GET /identity/v3/role_assignments?user.id=688f54c8b16b4188b4bc42b526a8f4c5&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=971e130ba91d4b7ab75b8e33d322760b => generated 608 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:12.134674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa7363-96c1-4d3f-9436-f5a5277e96f7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.184976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c3ce6-6fe8-4f4c-b81a-f0ca9fd33a71 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.220318 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:12.295091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69950a-baa0-432a-a127-263fa5bea00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.296258 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69950a-baa0-432a-a127-263fa5bea00d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.296805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69950a-baa0-432a-a127-263fa5bea00d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.297310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69950a-baa0-432a-a127-263fa5bea00d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.345025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69950a-baa0-432a-a127-263fa5bea00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-0f69950a-baa0-432a-a127-263fa5bea00d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:12.357533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:12.360092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:12.362769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 79/174] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 476 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:12.371696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69950a-baa0-432a-a127-263fa5bea00d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.391267 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa7363-96c1-4d3f-9436-f5a5277e96f7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.462731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:12.471166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79338f81-f7b7-497f-951a-6d354c68b80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.472911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79338f81-f7b7-497f-951a-6d354c68b80b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.473245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79338f81-f7b7-497f-951a-6d354c68b80b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.473491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79338f81-f7b7-497f-951a-6d354c68b80b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.613388 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69950a-baa0-432a-a127-263fa5bea00d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.630456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79338f81-f7b7-497f-951a-6d354c68b80b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.632036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79338f81-f7b7-497f-951a-6d354c68b80b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.688964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b013fc6-9717-48cd-807d-979198cbe3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.689486 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b013fc6-9717-48cd-807d-979198cbe3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.689763 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b013fc6-9717-48cd-807d-979198cbe3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.690035 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b013fc6-9717-48cd-807d-979198cbe3d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.690723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b013fc6-9717-48cd-807d-979198cbe3d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:12.691026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b013fc6-9717-48cd-807d-979198cbe3d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:12.692578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b013fc6-9717-48cd-807d-979198cbe3d3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:12.701026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:12.702856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 80/175] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:12.704200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6afff-bdcc-44a3-bfb1-d545f6d893ac None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.704505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6afff-bdcc-44a3-bfb1-d545f6d893ac None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.704805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6afff-bdcc-44a3-bfb1-d545f6d893ac None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.706265 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 81/176] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:12.707346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e690c51-9395-4cd3-b73b-685ce9750628 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.707624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e690c51-9395-4cd3-b73b-685ce9750628 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.707903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e690c51-9395-4cd3-b73b-685ce9750628 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.710004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 82/177] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:12.710004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e690c51-9395-4cd3-b73b-685ce9750628 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:12.826527 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 96/178] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:12.827619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b59b8-a9bf-4bfc-999f-4c98648520e4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.833350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b59b8-a9bf-4bfc-999f-4c98648520e4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.833350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b59b8-a9bf-4bfc-999f-4c98648520e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.853290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:12.858098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-be9b59b8-a9bf-4bfc-999f-4c98648520e4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:12.860197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-be9b59b8-a9bf-4bfc-999f-4c98648520e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:12.863664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e690c51-9395-4cd3-b73b-685ce9750628 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:12.919475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715edb7-de8b-4764-9b86-548fe80ad1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:12.920292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715edb7-de8b-4764-9b86-548fe80ad1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.920748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715edb7-de8b-4764-9b86-548fe80ad1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.921140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715edb7-de8b-4764-9b86-548fe80ad1f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.935235 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715edb7-de8b-4764-9b86-548fe80ad1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-9715edb7-de8b-4764-9b86-548fe80ad1f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:12.941816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:12.943623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:12.945810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 83/179] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:12.947118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5e433-eadd-4b90-9f2c-df55c9fba44a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:12.947118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5e433-eadd-4b90-9f2c-df55c9fba44a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:12.948161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5e433-eadd-4b90-9f2c-df55c9fba44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:12.968219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-59c5e433-eadd-4b90-9f2c-df55c9fba44a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:12.969484 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-59c5e433-eadd-4b90-9f2c-df55c9fba44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:12.979978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 97/180] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:12.979978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b59b8-a9bf-4bfc-999f-4c98648520e4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.085708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 84/181] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:13.087257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5e433-eadd-4b90-9f2c-df55c9fba44a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.103357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.204697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b59b8-a9bf-4bfc-999f-4c98648520e4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.285718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.288339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4443ee7-dfd6-41b3-b14c-9b0ceab3c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.290623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4443ee7-dfd6-41b3-b14c-9b0ceab3c991 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.291338 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4443ee7-dfd6-41b3-b14c-9b0ceab3c991 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.292270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4443ee7-dfd6-41b3-b14c-9b0ceab3c991 None admin] PATH_INFO: `/v3/users/19faba1f83d443dbaca1d7f5b1b4a452` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.295074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4443ee7-dfd6-41b3-b14c-9b0ceab3c991 None admin] RBAC: Authorizing `identity:get_user(user_id=19faba1f83d443dbaca1d7f5b1b4a452)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:13.298446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4443ee7-dfd6-41b3-b14c-9b0ceab3c991 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:13.305336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 98/182] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:12 2022] GET /identity/v3/users/19faba1f83d443dbaca1d7f5b1b4a452 => generated 247 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:13.307810 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982c568-77b0-4dc5-bdec-8725573207de None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.309139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982c568-77b0-4dc5-bdec-8725573207de None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.309950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982c568-77b0-4dc5-bdec-8725573207de None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.313558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 99/183] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:13.315468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982c568-77b0-4dc5-bdec-8725573207de None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.336145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5e433-eadd-4b90-9f2c-df55c9fba44a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.419275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911cf71-a52c-4de3-bb8f-ea431e6844aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.420911 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911cf71-a52c-4de3-bb8f-ea431e6844aa None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.421735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911cf71-a52c-4de3-bb8f-ea431e6844aa None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.422726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911cf71-a52c-4de3-bb8f-ea431e6844aa None admin] PATH_INFO: `/v3/projects/3b83fad5d1224553b0b862d4f56147bf` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.424463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911cf71-a52c-4de3-bb8f-ea431e6844aa None admin] RBAC: Authorizing `identity:get_project(project_id=3b83fad5d1224553b0b862d4f56147bf)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:13.426601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911cf71-a52c-4de3-bb8f-ea431e6844aa None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:13.429059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 85/184] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:13 2022] GET /identity/v3/projects/3b83fad5d1224553b0b862d4f56147bf => generated 312 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:13.431088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911cf71-a52c-4de3-bb8f-ea431e6844aa None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.528360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982c568-77b0-4dc5-bdec-8725573207de None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.573491 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911cf71-a52c-4de3-bb8f-ea431e6844aa None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.578438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.591742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2489b-1394-4554-8ccd-d28d55d83c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.592847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2489b-1394-4554-8ccd-d28d55d83c5d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.593313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2489b-1394-4554-8ccd-d28d55d83c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.593802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2489b-1394-4554-8ccd-d28d55d83c5d None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.595057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2489b-1394-4554-8ccd-d28d55d83c5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:13.595511 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2489b-1394-4554-8ccd-d28d55d83c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:13.597707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2489b-1394-4554-8ccd-d28d55d83c5d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:13.612526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 100/185] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:13.614761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce03104-bc99-4020-a81c-016e37d77444 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.615225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce03104-bc99-4020-a81c-016e37d77444 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.615683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce03104-bc99-4020-a81c-016e37d77444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.629680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726df5b-bb47-43c4-8c59-96726235fc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.630542 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726df5b-bb47-43c4-8c59-96726235fc3b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.630915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726df5b-bb47-43c4-8c59-96726235fc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.631280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726df5b-bb47-43c4-8c59-96726235fc3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.648214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bce03104-bc99-4020-a81c-016e37d77444 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:13.650296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bce03104-bc99-4020-a81c-016e37d77444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:13.658351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.726551 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726df5b-bb47-43c4-8c59-96726235fc3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:13.729257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726df5b-bb47-43c4-8c59-96726235fc3b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:13.735968 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 101/186] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:13.741661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce03104-bc99-4020-a81c-016e37d77444 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.878712 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 86/187] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:13.880788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726df5b-bb47-43c4-8c59-96726235fc3b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:13.908148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce03104-bc99-4020-a81c-016e37d77444 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:13.939179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.957624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296bd0c-33a5-473f-ae35-087f622fecdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:13.958737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296bd0c-33a5-473f-ae35-087f622fecdc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:13.959199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296bd0c-33a5-473f-ae35-087f622fecdc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:13.959692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296bd0c-33a5-473f-ae35-087f622fecdc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:13.961217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:13.979241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296bd0c-33a5-473f-ae35-087f622fecdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-4296bd0c-33a5-473f-ae35-087f622fecdc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:13.986111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:13.987886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 102/188] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:27:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:13.990555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296bd0c-33a5-473f-ae35-087f622fecdc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:14.073443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726df5b-bb47-43c4-8c59-96726235fc3b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:14.139815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d09f89-eea5-4b1f-ab51-92cf0af54664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:14.140373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d09f89-eea5-4b1f-ab51-92cf0af54664 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:14.140736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d09f89-eea5-4b1f-ab51-92cf0af54664 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:14.141160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d09f89-eea5-4b1f-ab51-92cf0af54664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:14.142427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d09f89-eea5-4b1f-ab51-92cf0af54664 None admin] RBAC: Adding query filter params (role.id=23bfcdf883144a0b8740e12c6a6de7e3, scope.project.id=3b83fad5d1224553b0b862d4f56147bf, user.id=688f54c8b16b4188b4bc42b526a8f4c5) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:14.142921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d09f89-eea5-4b1f-ab51-92cf0af54664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:14.145500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d09f89-eea5-4b1f-ab51-92cf0af54664 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:14.156119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 87/189] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:13 2022] GET /identity/v3/role_assignments?user.id=688f54c8b16b4188b4bc42b526a8f4c5&scope.project.id=3b83fad5d1224553b0b862d4f56147bf&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:14.157574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d09f89-eea5-4b1f-ab51-92cf0af54664 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:14.202450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296bd0c-33a5-473f-ae35-087f622fecdc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:14.277914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48d325-11ce-43aa-b29b-29191d9de4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:14.279646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d325-11ce-43aa-b29b-29191d9de4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:14.280129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d325-11ce-43aa-b29b-29191d9de4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:14.280738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d325-11ce-43aa-b29b-29191d9de4e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:14.283008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48d325-11ce-43aa-b29b-29191d9de4e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:14.285895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48d325-11ce-43aa-b29b-29191d9de4e7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:14.290080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 103/190] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:14.292606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48d325-11ce-43aa-b29b-29191d9de4e7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:14.380633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d09f89-eea5-4b1f-ab51-92cf0af54664 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:14.400234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:14.408102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:14.448698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa7dd7-20aa-45b8-bbc3-3b7daacb7504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:14.450051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7dd7-20aa-45b8-bbc3-3b7daacb7504 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:14.450691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7dd7-20aa-45b8-bbc3-3b7daacb7504 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:14.451330 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa7dd7-20aa-45b8-bbc3-3b7daacb7504 None admin] PATH_INFO: `/v3/users/905112d3ae3c494ab6374fe585f27c57` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:14.472827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa7dd7-20aa-45b8-bbc3-3b7daacb7504 None admin] RBAC: Authorizing `identity:get_user(user_id=905112d3ae3c494ab6374fe585f27c57)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:14.475716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa7dd7-20aa-45b8-bbc3-3b7daacb7504 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:14.479825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 88/191] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:14 2022] GET /identity/v3/users/905112d3ae3c494ab6374fe585f27c57 => generated 283 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:14.481481 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa7dd7-20aa-45b8-bbc3-3b7daacb7504 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:14.505250 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48d325-11ce-43aa-b29b-29191d9de4e7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:14.574621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c15f89-8f19-4ccd-8724-f40ff181cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:14.575648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15f89-8f19-4ccd-8724-f40ff181cfbe None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:14.576156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15f89-8f19-4ccd-8724-f40ff181cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:14.576687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c15f89-8f19-4ccd-8724-f40ff181cfbe None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:14.578862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c15f89-8f19-4ccd-8724-f40ff181cfbe None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:14.581812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c15f89-8f19-4ccd-8724-f40ff181cfbe None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:14.591801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 104/192] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:14 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:14.591801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c15f89-8f19-4ccd-8724-f40ff181cfbe None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:14.642611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa7dd7-20aa-45b8-bbc3-3b7daacb7504 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:14.707992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2a2cc-c86f-49b3-bb53-079ff6237445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:14.708909 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2a2cc-c86f-49b3-bb53-079ff6237445 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:14.709401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2a2cc-c86f-49b3-bb53-079ff6237445 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:14.709884 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2a2cc-c86f-49b3-bb53-079ff6237445 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:14.711709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2a2cc-c86f-49b3-bb53-079ff6237445 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:14.712259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2a2cc-c86f-49b3-bb53-079ff6237445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:14.715032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2a2cc-c86f-49b3-bb53-079ff6237445 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:14.727860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 89/193] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:14.729415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2a2cc-c86f-49b3-bb53-079ff6237445 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:14.777584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c15f89-8f19-4ccd-8724-f40ff181cfbe None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:14.777878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:14.799668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:14.821254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d78065-4f40-4e66-8bcb-8fea7d4087d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:14.822015 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78065-4f40-4e66-8bcb-8fea7d4087d0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:14.822257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78065-4f40-4e66-8bcb-8fea7d4087d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:14.822489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d78065-4f40-4e66-8bcb-8fea7d4087d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:14.838091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d78065-4f40-4e66-8bcb-8fea7d4087d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-45d78065-4f40-4e66-8bcb-8fea7d4087d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:14.844263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:14.846156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 105/194] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:14.850487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d78065-4f40-4e66-8bcb-8fea7d4087d0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:14.878378 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2a2cc-c86f-49b3-bb53-079ff6237445 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:14.921589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc8ddc-b5b0-4aef-ba6b-3018e8903c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:14.922347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc8ddc-b5b0-4aef-ba6b-3018e8903c07 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:14.922713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc8ddc-b5b0-4aef-ba6b-3018e8903c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:14.923126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc8ddc-b5b0-4aef-ba6b-3018e8903c07 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:14.923894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc8ddc-b5b0-4aef-ba6b-3018e8903c07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:14.925661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc8ddc-b5b0-4aef-ba6b-3018e8903c07 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:14.976815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d78065-4f40-4e66-8bcb-8fea7d4087d0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.024030 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab3f4e-293d-46d6-8535-96ffbc973b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:15.024786 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab3f4e-293d-46d6-8535-96ffbc973b1b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.025128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab3f4e-293d-46d6-8535-96ffbc973b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.025469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab3f4e-293d-46d6-8535-96ffbc973b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.036228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 90/195] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:27:14 2022] POST /identity/v3/users => generated 297 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:15.036228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc8ddc-b5b0-4aef-ba6b-3018e8903c07 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:15.125534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:15.165290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab3f4e-293d-46d6-8535-96ffbc973b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:15.168972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab3f4e-293d-46d6-8535-96ffbc973b1b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:15.205701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:15.218859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc8ddc-b5b0-4aef-ba6b-3018e8903c07 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.278597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68a2bb-e6b0-4886-bfc0-dd045eb2940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:15.279661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a2bb-e6b0-4886-bfc0-dd045eb2940e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.280165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a2bb-e6b0-4886-bfc0-dd045eb2940e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.280713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68a2bb-e6b0-4886-bfc0-dd045eb2940e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.282799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68a2bb-e6b0-4886-bfc0-dd045eb2940e None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc, user.id=19faba1f83d443dbaca1d7f5b1b4a452) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:15.282799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68a2bb-e6b0-4886-bfc0-dd045eb2940e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:15.285663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68a2bb-e6b0-4886-bfc0-dd045eb2940e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:15.297657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 91/196] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:15 2022] GET /identity/v3/role_assignments?user.id=19faba1f83d443dbaca1d7f5b1b4a452&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=c0316e22a13a4034846c451753b4c14e => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:15.298741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68a2bb-e6b0-4886-bfc0-dd045eb2940e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:15.462697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 106/197] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:15.464386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab3f4e-293d-46d6-8535-96ffbc973b1b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:15.494455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68a2bb-e6b0-4886-bfc0-dd045eb2940e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.557960 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489adb7-3b6c-47e6-9db1-7f3ede896b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:15.559239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489adb7-3b6c-47e6-9db1-7f3ede896b3a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.559695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489adb7-3b6c-47e6-9db1-7f3ede896b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.560150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489adb7-3b6c-47e6-9db1-7f3ede896b3a None admin] PATH_INFO: `/v3/users/905112d3ae3c494ab6374fe585f27c57` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.563089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489adb7-3b6c-47e6-9db1-7f3ede896b3a None admin] RBAC: Authorizing `identity:get_user(user_id=905112d3ae3c494ab6374fe585f27c57)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:15.566429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489adb7-3b6c-47e6-9db1-7f3ede896b3a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:15.570242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 92/198] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:15 2022] GET /identity/v3/users/905112d3ae3c494ab6374fe585f27c57 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:15.572633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489adb7-3b6c-47e6-9db1-7f3ede896b3a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:15.606753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:15.627720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:15.650172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab3f4e-293d-46d6-8535-96ffbc973b1b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.718824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b694f-b710-4e17-b7b6-76b92e322642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:15.719898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b694f-b710-4e17-b7b6-76b92e322642 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.720361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b694f-b710-4e17-b7b6-76b92e322642 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.720859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b694f-b710-4e17-b7b6-76b92e322642 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.722033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b694f-b710-4e17-b7b6-76b92e322642 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:15.722576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b694f-b710-4e17-b7b6-76b92e322642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:15.725165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87b694f-b710-4e17-b7b6-76b92e322642 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:15.737671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489adb7-3b6c-47e6-9db1-7f3ede896b3a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.743337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 107/199] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:15.750312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b694f-b710-4e17-b7b6-76b92e322642 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:15.786188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e796d5-9756-4d9f-a970-a9224706e6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:15.787446 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e796d5-9756-4d9f-a970-a9224706e6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.787972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e796d5-9756-4d9f-a970-a9224706e6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.788612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e796d5-9756-4d9f-a970-a9224706e6b5 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.790763 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e796d5-9756-4d9f-a970-a9224706e6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:15.792701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e796d5-9756-4d9f-a970-a9224706e6b5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:15.795285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 93/200] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:15 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:15.796594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e796d5-9756-4d9f-a970-a9224706e6b5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:15.931261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:15.942076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e796d5-9756-4d9f-a970-a9224706e6b5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.953579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b694f-b710-4e17-b7b6-76b92e322642 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:15.980450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d8ad4-d35b-4a24-8ce7-bba421bda688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:15.981392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d8ad4-d35b-4a24-8ce7-bba421bda688 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:15.981779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d8ad4-d35b-4a24-8ce7-bba421bda688 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:15.982075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d8ad4-d35b-4a24-8ce7-bba421bda688 None admin] PATH_INFO: `/v3/users/4bd591d0bbfd4f2b9675b7428c974ea1` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:15.983545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d8ad4-d35b-4a24-8ce7-bba421bda688 None admin] RBAC: Authorizing `identity:get_user(user_id=4bd591d0bbfd4f2b9675b7428c974ea1)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:15.985246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d8ad4-d35b-4a24-8ce7-bba421bda688 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:15.986940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 94/201] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:15 2022] GET /identity/v3/users/4bd591d0bbfd4f2b9675b7428c974ea1 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:15.992726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d8ad4-d35b-4a24-8ce7-bba421bda688 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:16.019474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013cb1a-6949-49c3-813a-ae09fa3f97f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:16.025162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013cb1a-6949-49c3-813a-ae09fa3f97f1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:16.025873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013cb1a-6949-49c3-813a-ae09fa3f97f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:16.026327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013cb1a-6949-49c3-813a-ae09fa3f97f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:16.044800 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:16.114690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d8ad4-d35b-4a24-8ce7-bba421bda688 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:16.154224 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3c166-8ba9-4ba7-90e0-0fae3e453526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:16.154759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c166-8ba9-4ba7-90e0-0fae3e453526 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:16.155051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c166-8ba9-4ba7-90e0-0fae3e453526 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:16.155329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c166-8ba9-4ba7-90e0-0fae3e453526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:16.156103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3c166-8ba9-4ba7-90e0-0fae3e453526 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5, user.id=905112d3ae3c494ab6374fe585f27c57) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:16.156419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3c166-8ba9-4ba7-90e0-0fae3e453526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:16.157981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3c166-8ba9-4ba7-90e0-0fae3e453526 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:16.165926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 95/202] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:15 2022] GET /identity/v3/role_assignments?user.id=905112d3ae3c494ab6374fe585f27c57&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=c0316e22a13a4034846c451753b4c14e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:16.166509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3c166-8ba9-4ba7-90e0-0fae3e453526 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:16.170864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013cb1a-6949-49c3-813a-ae09fa3f97f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:16.174273 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013cb1a-6949-49c3-813a-ae09fa3f97f1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:16.198144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:16.373717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3c166-8ba9-4ba7-90e0-0fae3e453526 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:16.384668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 108/203] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:16.399674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013cb1a-6949-49c3-813a-ae09fa3f97f1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:16.466908 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:16.490811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7379003-3e11-41ce-b40b-ac592a056ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:16.491918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379003-3e11-41ce-b40b-ac592a056ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:16.492418 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379003-3e11-41ce-b40b-ac592a056ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:16.492944 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7379003-3e11-41ce-b40b-ac592a056ab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:16.608089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013cb1a-6949-49c3-813a-ae09fa3f97f1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:16.721368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7379003-3e11-41ce-b40b-ac592a056ab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:16.725855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7379003-3e11-41ce-b40b-ac592a056ab3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:16.734699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601439a8-02ee-455e-987e-e4de6093c52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:16.736335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601439a8-02ee-455e-987e-e4de6093c52e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:16.737164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601439a8-02ee-455e-987e-e4de6093c52e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:16.739545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601439a8-02ee-455e-987e-e4de6093c52e None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:16.750479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601439a8-02ee-455e-987e-e4de6093c52e None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:16.753865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601439a8-02ee-455e-987e-e4de6093c52e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:16.762761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 109/204] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:16 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:16.764915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601439a8-02ee-455e-987e-e4de6093c52e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:16.825110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:16.959992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 96/205] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:16.968761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7379003-3e11-41ce-b40b-ac592a056ab3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:17.125097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601439a8-02ee-455e-987e-e4de6093c52e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:17.143807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:17.212242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73740a-2602-4b56-87b3-4e02b183239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:17.213336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73740a-2602-4b56-87b3-4e02b183239a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.213841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73740a-2602-4b56-87b3-4e02b183239a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.214339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73740a-2602-4b56-87b3-4e02b183239a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.215766 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73740a-2602-4b56-87b3-4e02b183239a None admin] RBAC: Adding query filter params (role.id=971e130ba91d4b7ab75b8e33d322760b, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5, user.id=905112d3ae3c494ab6374fe585f27c57) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:17.216328 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73740a-2602-4b56-87b3-4e02b183239a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:17.225083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73740a-2602-4b56-87b3-4e02b183239a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:17.230857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7379003-3e11-41ce-b40b-ac592a056ab3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:17.233840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 110/206] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:16 2022] GET /identity/v3/role_assignments?user.id=905112d3ae3c494ab6374fe585f27c57&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=971e130ba91d4b7ab75b8e33d322760b => generated 259 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:17.280979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:17.303778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837a35-b98a-4215-9c55-9fbad96f023b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:17.305434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837a35-b98a-4215-9c55-9fbad96f023b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.305931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837a35-b98a-4215-9c55-9fbad96f023b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.306411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837a35-b98a-4215-9c55-9fbad96f023b None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.308650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837a35-b98a-4215-9c55-9fbad96f023b None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:17.311534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837a35-b98a-4215-9c55-9fbad96f023b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:17.314799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 97/207] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:16 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:17.325466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73740a-2602-4b56-87b3-4e02b183239a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:17.540250 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73740a-2602-4b56-87b3-4e02b183239a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:17.590069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26314842-8ed6-437d-ab4a-01a8f07b97df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:17.590735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314842-8ed6-437d-ab4a-01a8f07b97df None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:17.591067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314842-8ed6-437d-ab4a-01a8f07b97df None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:17.591377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314842-8ed6-437d-ab4a-01a8f07b97df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:17.592141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26314842-8ed6-437d-ab4a-01a8f07b97df None admin] RBAC: Adding query filter params (role.id=a88f94e8d7794f1b8513bad8de38ebb9, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc, user.id=4bd591d0bbfd4f2b9675b7428c974ea1) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:17.592670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26314842-8ed6-437d-ab4a-01a8f07b97df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:17.594646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26314842-8ed6-437d-ab4a-01a8f07b97df None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:17.605924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 111/208] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:17 2022] GET /identity/v3/role_assignments?user.id=4bd591d0bbfd4f2b9675b7428c974ea1&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=a88f94e8d7794f1b8513bad8de38ebb9 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:18.311693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22453de-5c07-4a74-9343-b286454fcb33 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.312211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22453de-5c07-4a74-9343-b286454fcb33 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.312211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22453de-5c07-4a74-9343-b286454fcb33 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.313655 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 98/209] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:18.321870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51def84f-9ae3-4dec-946e-312517c895a8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.322820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51def84f-9ae3-4dec-946e-312517c895a8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.323322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51def84f-9ae3-4dec-946e-312517c895a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.350549 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-51def84f-9ae3-4dec-946e-312517c895a8 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:18.352886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-51def84f-9ae3-4dec-946e-312517c895a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:18.355121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22f7c7-b232-4b80-8959-23bdb972ecc0 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.355419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22f7c7-b232-4b80-8959-23bdb972ecc0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.355664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22f7c7-b232-4b80-8959-23bdb972ecc0 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.357859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 99/210] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:18.363489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297b7f7-8c97-49db-89d5-7b9dfe52be60 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.363770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297b7f7-8c97-49db-89d5-7b9dfe52be60 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.364055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297b7f7-8c97-49db-89d5-7b9dfe52be60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.395015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5297b7f7-8c97-49db-89d5-7b9dfe52be60 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:18.397109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5297b7f7-8c97-49db-89d5-7b9dfe52be60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:18.403178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:18.462284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 112/211] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:18.501816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 100/212] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:27:18.651654 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bab339-647c-49d4-be6a-868578a109c2 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.651846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bab339-647c-49d4-be6a-868578a109c2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.652113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bab339-647c-49d4-be6a-868578a109c2 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.654283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 113/213] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:18.661575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65235edd-3c37-4cc4-96ef-23f783664c17 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:18.662071 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65235edd-3c37-4cc4-96ef-23f783664c17 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:18.662560 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65235edd-3c37-4cc4-96ef-23f783664c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:18.696248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-65235edd-3c37-4cc4-96ef-23f783664c17 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:18.698514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-65235edd-3c37-4cc4-96ef-23f783664c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:18.811801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bab339-647c-49d4-be6a-868578a109c2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:18.836707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 101/214] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:18.838243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65235edd-3c37-4cc4-96ef-23f783664c17 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:18.924046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:18.971703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bab339-647c-49d4-be6a-868578a109c2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:18.987028 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65235edd-3c37-4cc4-96ef-23f783664c17 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:19.023398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9fe88-b750-4217-bf14-8d980cff80c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:19.024045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9fe88-b750-4217-bf14-8d980cff80c3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:19.024718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9fe88-b750-4217-bf14-8d980cff80c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:19.025132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9fe88-b750-4217-bf14-8d980cff80c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:19.026832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9fe88-b750-4217-bf14-8d980cff80c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:19.029827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f9fe88-b750-4217-bf14-8d980cff80c3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:19.032548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 114/215] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:19.033658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bebed3-bd18-4793-bd74-30236ad4bb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:19.034411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bebed3-bd18-4793-bd74-30236ad4bb51 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:19.034692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bebed3-bd18-4793-bd74-30236ad4bb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:19.034961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bebed3-bd18-4793-bd74-30236ad4bb51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:19.044608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9fe88-b750-4217-bf14-8d980cff80c3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:19.059260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bebed3-bd18-4793-bd74-30236ad4bb51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-04bebed3-bd18-4793-bd74-30236ad4bb51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:19.069526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:19.071097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:19.071891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:19.072558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 102/216] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:19.080964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bebed3-bd18-4793-bd74-30236ad4bb51 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:19.094331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:19.228367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f9fe88-b750-4217-bf14-8d980cff80c3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:19.271494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f2431-62bc-4793-9f00-5bdb8847d3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:19.272112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f2431-62bc-4793-9f00-5bdb8847d3bb None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:19.272389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f2431-62bc-4793-9f00-5bdb8847d3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:19.272760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f2431-62bc-4793-9f00-5bdb8847d3bb None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:19.273613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f2431-62bc-4793-9f00-5bdb8847d3bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:19.275099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f2431-62bc-4793-9f00-5bdb8847d3bb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:19.342575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bebed3-bd18-4793-bd74-30236ad4bb51 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:19.365913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:19.397191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8e9e7-ee6f-4d32-ac54-b2a43c09cc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:19.398079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8e9e7-ee6f-4d32-ac54-b2a43c09cc8c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:19.398488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8e9e7-ee6f-4d32-ac54-b2a43c09cc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:19.398886 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8e9e7-ee6f-4d32-ac54-b2a43c09cc8c None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:19.399783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8e9e7-ee6f-4d32-ac54-b2a43c09cc8c None admin] RBAC: Adding query filter params (name=member) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:19.400199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8e9e7-ee6f-4d32-ac54-b2a43c09cc8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:19.401792 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8e9e7-ee6f-4d32-ac54-b2a43c09cc8c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:19.416652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 103/217] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:19.416652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8e9e7-ee6f-4d32-ac54-b2a43c09cc8c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:19.436521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 115/218] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:27:19 2022] POST /identity/v3/users => generated 297 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:19.436521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f2431-62bc-4793-9f00-5bdb8847d3bb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:19.645288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8e9e7-ee6f-4d32-ac54-b2a43c09cc8c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:19.647188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:19.675067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f2431-62bc-4793-9f00-5bdb8847d3bb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:19.724522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70cb53-d7c6-4056-8b64-98c178313f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:19.726176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70cb53-d7c6-4056-8b64-98c178313f38 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:19.727012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70cb53-d7c6-4056-8b64-98c178313f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:19.727811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70cb53-d7c6-4056-8b64-98c178313f38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:19.752996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e374de-0f7b-4f5c-b5c2-cb38a1288a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:19.753907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70cb53-d7c6-4056-8b64-98c178313f38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:19.754203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e374de-0f7b-4f5c-b5c2-cb38a1288a2f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:19.754485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e374de-0f7b-4f5c-b5c2-cb38a1288a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:19.754977 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e374de-0f7b-4f5c-b5c2-cb38a1288a2f None admin] PATH_INFO: `/v3/users/110304f302ba431fa0ffb7260a4493b7` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-ac70cb53-d7c6-4056-8b64-98c178313f38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:19.767488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:19.769317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:19.771573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 104/219] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:19.781942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70cb53-d7c6-4056-8b64-98c178313f38 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:19.786925 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e374de-0f7b-4f5c-b5c2-cb38a1288a2f None admin] RBAC: Authorizing `identity:get_user(user_id=110304f302ba431fa0ffb7260a4493b7)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:19.791272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e374de-0f7b-4f5c-b5c2-cb38a1288a2f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:19.794376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 116/220] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:19 2022] GET /identity/v3/users/110304f302ba431fa0ffb7260a4493b7 => generated 297 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:19.803923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e374de-0f7b-4f5c-b5c2-cb38a1288a2f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:19.871240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:20.004773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e374de-0f7b-4f5c-b5c2-cb38a1288a2f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:20.021235 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70cb53-d7c6-4056-8b64-98c178313f38 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:20.074999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1ae11-67a6-4710-b3bb-7cf061805d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:20.075647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1ae11-67a6-4710-b3bb-7cf061805d6f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.075944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1ae11-67a6-4710-b3bb-7cf061805d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.076199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1ae11-67a6-4710-b3bb-7cf061805d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.082287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975401a4-66f6-4cb3-9413-46beb130d19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:20.083645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975401a4-66f6-4cb3-9413-46beb130d19d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.084349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975401a4-66f6-4cb3-9413-46beb130d19d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.085023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975401a4-66f6-4cb3-9413-46beb130d19d None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.087002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975401a4-66f6-4cb3-9413-46beb130d19d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:20.087644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975401a4-66f6-4cb3-9413-46beb130d19d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:20.090300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975401a4-66f6-4cb3-9413-46beb130d19d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:20.097235 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:20.107915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 105/221] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:20.110425 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8c68d-0e39-4014-8361-6b34e254eec0 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.111147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8c68d-0e39-4014-8361-6b34e254eec0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.111646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8c68d-0e39-4014-8361-6b34e254eec0 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.114570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 106/222] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:20.122708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8c68d-0e39-4014-8361-6b34e254eec0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:20.172767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1ae11-67a6-4710-b3bb-7cf061805d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:20.175086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1ae11-67a6-4710-b3bb-7cf061805d6f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:20.288223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:20.299658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8c68d-0e39-4014-8361-6b34e254eec0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:20.354319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 117/223] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:20.355686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8154-55ce-4813-bef3-2dcb1c1ef1f7 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.356066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8154-55ce-4813-bef3-2dcb1c1ef1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.356355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce8154-55ce-4813-bef3-2dcb1c1ef1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.376160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7c1b6-0c8d-4c96-a545-fe18e8c3a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:20.377321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7c1b6-0c8d-4c96-a545-fe18e8c3a85f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.377781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7c1b6-0c8d-4c96-a545-fe18e8c3a85f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.378210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7c1b6-0c8d-4c96-a545-fe18e8c3a85f None admin] PATH_INFO: `/v3/users/905112d3ae3c494ab6374fe585f27c57` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.379546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1bce8154-55ce-4813-bef3-2dcb1c1ef1f7 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:20.380423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7c1b6-0c8d-4c96-a545-fe18e8c3a85f None admin] RBAC: Authorizing `identity:get_user(user_id=905112d3ae3c494ab6374fe585f27c57)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:20.381051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1bce8154-55ce-4813-bef3-2dcb1c1ef1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:20.383730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7c1b6-0c8d-4c96-a545-fe18e8c3a85f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:20.387575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 107/224] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:20 2022] GET /identity/v3/users/905112d3ae3c494ab6374fe585f27c57 => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:20.388946 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7c1b6-0c8d-4c96-a545-fe18e8c3a85f None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:20.454047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:20.485127 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 118/225] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:20.486078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce8154-55ce-4813-bef3-2dcb1c1ef1f7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:20.555320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7c1b6-0c8d-4c96-a545-fe18e8c3a85f None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:20.602971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01c08c-4002-40ec-bce7-01c79ca45837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:20.603786 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01c08c-4002-40ec-bce7-01c79ca45837 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.604076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01c08c-4002-40ec-bce7-01c79ca45837 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.604315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01c08c-4002-40ec-bce7-01c79ca45837 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.607750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01c08c-4002-40ec-bce7-01c79ca45837 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:20.609334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01c08c-4002-40ec-bce7-01c79ca45837 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:20.611686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 108/226] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:20 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:20.620214 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01c08c-4002-40ec-bce7-01c79ca45837 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:20.622412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce8154-55ce-4813-bef3-2dcb1c1ef1f7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:20.677046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135931-f4dc-45b2-ace5-3b29a533c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:20.677853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135931-f4dc-45b2-ace5-3b29a533c105 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.678204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135931-f4dc-45b2-ace5-3b29a533c105 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.678552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25135931-f4dc-45b2-ace5-3b29a533c105 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.682306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25135931-f4dc-45b2-ace5-3b29a533c105 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:20.684159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25135931-f4dc-45b2-ace5-3b29a533c105 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:20.688820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 119/227] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:20 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:20.694820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135931-f4dc-45b2-ace5-3b29a533c105 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:20.697043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:20.769402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:20.847420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25135931-f4dc-45b2-ace5-3b29a533c105 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:20.893767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628daba-0940-4ccd-95f7-497d793d9541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:20.894589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628daba-0940-4ccd-95f7-497d793d9541 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.894872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628daba-0940-4ccd-95f7-497d793d9541 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.895190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628daba-0940-4ccd-95f7-497d793d9541 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/users/905112d3ae3c494ab6374fe585f27c57/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.897546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628daba-0940-4ccd-95f7-497d793d9541 None admin] RBAC: Authorizing `identity:create_grant(project_id=9120de2e247f4ce5a58344a2f79fd2e5, user_id=905112d3ae3c494ab6374fe585f27c57, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:20.898816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01c08c-4002-40ec-bce7-01c79ca45837 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:20.899323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628daba-0940-4ccd-95f7-497d793d9541 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:20.950049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfd966-614b-4920-8fa3-0c0f23989d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:20.950876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfd966-614b-4920-8fa3-0c0f23989d22 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:20.951158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfd966-614b-4920-8fa3-0c0f23989d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:20.951412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfd966-614b-4920-8fa3-0c0f23989d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:20.952180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfd966-614b-4920-8fa3-0c0f23989d22 None admin] RBAC: Adding query filter params (role.id=23bfcdf883144a0b8740e12c6a6de7e3, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5, user.id=110304f302ba431fa0ffb7260a4493b7) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:20.952462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfd966-614b-4920-8fa3-0c0f23989d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:20.953995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfd966-614b-4920-8fa3-0c0f23989d22 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:20.961110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 109/228] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:20 2022] GET /identity/v3/role_assignments?user.id=110304f302ba431fa0ffb7260a4493b7&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 259 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:20.979450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfd966-614b-4920-8fa3-0c0f23989d22 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:21.033808 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 120/229] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:20 2022] PUT /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/users/905112d3ae3c494ab6374fe585f27c57/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:27:21.184376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:21.199138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfd966-614b-4920-8fa3-0c0f23989d22 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:21.285492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4446d-0aad-418f-b3a8-9830508b4484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:21.286623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4446d-0aad-418f-b3a8-9830508b4484 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:21.287053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4446d-0aad-418f-b3a8-9830508b4484 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:21.287460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4446d-0aad-418f-b3a8-9830508b4484 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:21.307827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4446d-0aad-418f-b3a8-9830508b4484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-4dc4446d-0aad-418f-b3a8-9830508b4484 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:21.318050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:21.321429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:21.324295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 110/230] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:27:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:21.333153 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628daba-0940-4ccd-95f7-497d793d9541 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:21.531834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628daba-0940-4ccd-95f7-497d793d9541 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:21.536086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:21.609992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2e606-77bb-4b14-b9a8-abe482f6d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:21.611077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2e606-77bb-4b14-b9a8-abe482f6d640 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:21.611586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2e606-77bb-4b14-b9a8-abe482f6d640 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:21.612083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2e606-77bb-4b14-b9a8-abe482f6d640 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:21.613308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2e606-77bb-4b14-b9a8-abe482f6d640 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:21.613764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2e606-77bb-4b14-b9a8-abe482f6d640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:21.616132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2e606-77bb-4b14-b9a8-abe482f6d640 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:21.640427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 121/231] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:21.647218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4446d-0aad-418f-b3a8-9830508b4484 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:21.823207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4446d-0aad-418f-b3a8-9830508b4484 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:21.868204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c8ecf-26dd-4ec5-8eba-dab7d9985589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:21.868903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c8ecf-26dd-4ec5-8eba-dab7d9985589 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:21.869182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c8ecf-26dd-4ec5-8eba-dab7d9985589 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:21.869458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c8ecf-26dd-4ec5-8eba-dab7d9985589 None admin] PATH_INFO: `/v3/users/905112d3ae3c494ab6374fe585f27c57` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:21.873493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c8ecf-26dd-4ec5-8eba-dab7d9985589 None admin] RBAC: Authorizing `identity:get_user(user_id=905112d3ae3c494ab6374fe585f27c57)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:21.875153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c8ecf-26dd-4ec5-8eba-dab7d9985589 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:21.877328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 111/232] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:21 2022] GET /identity/v3/users/905112d3ae3c494ab6374fe585f27c57 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:21.884345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2e606-77bb-4b14-b9a8-abe482f6d640 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:22.117991 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2e606-77bb-4b14-b9a8-abe482f6d640 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:22.178885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9ebb-5916-4ca0-a67c-f509c8712da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:22.180939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9ebb-5916-4ca0-a67c-f509c8712da9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:22.181648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9ebb-5916-4ca0-a67c-f509c8712da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:22.182329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9ebb-5916-4ca0-a67c-f509c8712da9 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:22.184557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9ebb-5916-4ca0-a67c-f509c8712da9 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:22.187388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9ebb-5916-4ca0-a67c-f509c8712da9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:22.191104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 122/233] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:21 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:22.205708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c8ecf-26dd-4ec5-8eba-dab7d9985589 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:22.247974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:22.444519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c8ecf-26dd-4ec5-8eba-dab7d9985589 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:22.522165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a0fa07-9548-4a7f-b092-b6bea4d64124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:22.523326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0fa07-9548-4a7f-b092-b6bea4d64124 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:22.523834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0fa07-9548-4a7f-b092-b6bea4d64124 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:22.524328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a0fa07-9548-4a7f-b092-b6bea4d64124 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/users/905112d3ae3c494ab6374fe585f27c57/roles/971e130ba91d4b7ab75b8e33d322760b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:22.529775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0fa07-9548-4a7f-b092-b6bea4d64124 None admin] RBAC: Authorizing `identity:create_grant(project_id=9120de2e247f4ce5a58344a2f79fd2e5, user_id=905112d3ae3c494ab6374fe585f27c57, role_id=971e130ba91d4b7ab75b8e33d322760b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:22.532631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a0fa07-9548-4a7f-b092-b6bea4d64124 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:22.656043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aa78e-9586-4d21-aff3-801292b995de None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:22.656944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aa78e-9586-4d21-aff3-801292b995de None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:22.656944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aa78e-9586-4d21-aff3-801292b995de None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:22.658034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 123/234] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:22.663833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b6e3-93d4-4ba3-a7e6-c5822d424cd4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:22.664773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b6e3-93d4-4ba3-a7e6-c5822d424cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:22.665054 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9b6e3-93d4-4ba3-a7e6-c5822d424cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:22.686070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 112/235] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:22 2022] PUT /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/users/905112d3ae3c494ab6374fe585f27c57/roles/971e130ba91d4b7ab75b8e33d322760b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:22.691791 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-14d9b6e3-93d4-4ba3-a7e6-c5822d424cd4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:22.693121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-14d9b6e3-93d4-4ba3-a7e6-c5822d424cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:22.735187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:22.797343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 124/236] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:22.901649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ff94a-c94f-4282-bc6b-8cabbf8882f8 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:22.902147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ff94a-c94f-4282-bc6b-8cabbf8882f8 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:22.902638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ff94a-c94f-4282-bc6b-8cabbf8882f8 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:22.905435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 113/237] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:22.922493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0975-0e76-4ebc-8b68-9fbbe883fe1a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:22.922988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0975-0e76-4ebc-8b68-9fbbe883fe1a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:22.923472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c0975-0e76-4ebc-8b68-9fbbe883fe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:22.962297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c23c0975-0e76-4ebc-8b68-9fbbe883fe1a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:22.964535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c23c0975-0e76-4ebc-8b68-9fbbe883fe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:23.146487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 125/238] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:23.419156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ff94a-c94f-4282-bc6b-8cabbf8882f8 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:23.614432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c0975-0e76-4ebc-8b68-9fbbe883fe1a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:23.623123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:23.654448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ff94a-c94f-4282-bc6b-8cabbf8882f8 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:23.702491 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da03f58-e5b2-4526-bd2d-e9c9671dcb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:23.703471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da03f58-e5b2-4526-bd2d-e9c9671dcb2a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:23.703471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da03f58-e5b2-4526-bd2d-e9c9671dcb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:23.703940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da03f58-e5b2-4526-bd2d-e9c9671dcb2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:23.735472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da03f58-e5b2-4526-bd2d-e9c9671dcb2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-1da03f58-e5b2-4526-bd2d-e9c9671dcb2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:23.740877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:23.743505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:23.746822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 114/239] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:23.756727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da03f58-e5b2-4526-bd2d-e9c9671dcb2a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:23.880430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da03f58-e5b2-4526-bd2d-e9c9671dcb2a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:23.906478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:23.924248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a417a-4a5d-4529-8c57-5cfa02b14d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:23.925159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a417a-4a5d-4529-8c57-5cfa02b14d07 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:23.925584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a417a-4a5d-4529-8c57-5cfa02b14d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:23.925998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a417a-4a5d-4529-8c57-5cfa02b14d07 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:23.926880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a417a-4a5d-4529-8c57-5cfa02b14d07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:23.927351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a417a-4a5d-4529-8c57-5cfa02b14d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:23.929070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a417a-4a5d-4529-8c57-5cfa02b14d07 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:23.931540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c0975-0e76-4ebc-8b68-9fbbe883fe1a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:23.941024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 115/240] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:23.946463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a417a-4a5d-4529-8c57-5cfa02b14d07 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:23.962136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:24.063318 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c342317-8ec1-4498-936f-10565308ccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:24.064448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342317-8ec1-4498-936f-10565308ccff None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.065248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342317-8ec1-4498-936f-10565308ccff None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.065668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342317-8ec1-4498-936f-10565308ccff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.074136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c342317-8ec1-4498-936f-10565308ccff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:24.077190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c342317-8ec1-4498-936f-10565308ccff None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:24.081086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 126/241] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:24.090324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c342317-8ec1-4498-936f-10565308ccff None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:24.095701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a417a-4a5d-4529-8c57-5cfa02b14d07 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:24.137315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a8d85-aa6b-4926-a61a-1395c0296448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:24.138269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a8d85-aa6b-4926-a61a-1395c0296448 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.138725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a8d85-aa6b-4926-a61a-1395c0296448 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.139170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a8d85-aa6b-4926-a61a-1395c0296448 None admin] PATH_INFO: `/v3/users/45c1db09322242ca96953a1e517ccb9d` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.157941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a8d85-aa6b-4926-a61a-1395c0296448 None admin] RBAC: Authorizing `identity:get_user(user_id=45c1db09322242ca96953a1e517ccb9d)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:24.159857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53a8d85-aa6b-4926-a61a-1395c0296448 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:24.162247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 116/242] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:23 2022] GET /identity/v3/users/45c1db09322242ca96953a1e517ccb9d => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:24.171203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a8d85-aa6b-4926-a61a-1395c0296448 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:24.253865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:24.309118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53a8d85-aa6b-4926-a61a-1395c0296448 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:24.408613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fab00-e163-442a-b51b-fd107547a8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:24.409681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fab00-e163-442a-b51b-fd107547a8db None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.410167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fab00-e163-442a-b51b-fd107547a8db None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.410631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fab00-e163-442a-b51b-fd107547a8db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.459549 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c342317-8ec1-4498-936f-10565308ccff None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:24.552916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a333bb39-c5b2-4de9-980f-2a933c95c813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:24.554007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333bb39-c5b2-4de9-980f-2a933c95c813 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.554380 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333bb39-c5b2-4de9-980f-2a933c95c813 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.554882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333bb39-c5b2-4de9-980f-2a933c95c813 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.556140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333bb39-c5b2-4de9-980f-2a933c95c813 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:24.559075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a333bb39-c5b2-4de9-980f-2a933c95c813 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:24.559844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fab00-e163-442a-b51b-fd107547a8db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:24.561660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2fab00-e163-442a-b51b-fd107547a8db None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:24.671035 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:24.675642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 127/243] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:27:24 2022] POST /identity/v3/users => generated 293 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:24.680842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a558ec-4631-480e-88f5-937c7e82f82f None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.681253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a558ec-4631-480e-88f5-937c7e82f82f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.681553 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a558ec-4631-480e-88f5-937c7e82f82f None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.683346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 128/244] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:24.687568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f8af2-8f98-4aa5-b404-6e9e2e34ba05 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.689387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f8af2-8f98-4aa5-b404-6e9e2e34ba05 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.689884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f8af2-8f98-4aa5-b404-6e9e2e34ba05 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.698535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 129/245] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:24 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:24.700303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930217f-5576-44fc-995c-9d1968d19fee None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.700303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930217f-5576-44fc-995c-9d1968d19fee None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.700303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930217f-5576-44fc-995c-9d1968d19fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.739664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4930217f-5576-44fc-995c-9d1968d19fee None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:24.740959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4930217f-5576-44fc-995c-9d1968d19fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:24.761177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:24.777064 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 117/246] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:27:24.781598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0ca6c-0ef8-4ea4-8a9b-2d6dae6e703d None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:24.782869 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0ca6c-0ef8-4ea4-8a9b-2d6dae6e703d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:24.783561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0ca6c-0ef8-4ea4-8a9b-2d6dae6e703d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:24.829045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-80e0ca6c-0ef8-4ea4-8a9b-2d6dae6e703d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:24.832960 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-80e0ca6c-0ef8-4ea4-8a9b-2d6dae6e703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:24.847376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 130/247] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:27:24.848531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930217f-5576-44fc-995c-9d1968d19fee None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:25.024524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 118/248] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:25.047406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930217f-5576-44fc-995c-9d1968d19fee None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:25.108252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cee4c-92e1-4f8d-9f19-988628b063b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:25.108917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cee4c-92e1-4f8d-9f19-988628b063b9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:25.109253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cee4c-92e1-4f8d-9f19-988628b063b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:25.109532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cee4c-92e1-4f8d-9f19-988628b063b9 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:25.110863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cee4c-92e1-4f8d-9f19-988628b063b9 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:25.112387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cee4c-92e1-4f8d-9f19-988628b063b9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:25.114916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 131/249] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:24 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:25.123930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0ca6c-0ef8-4ea4-8a9b-2d6dae6e703d None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:25.301759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:25.320009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0ca6c-0ef8-4ea4-8a9b-2d6dae6e703d None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:25.375878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9670c-5f6e-42d9-a0f5-ff87176dd579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:25.376407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9670c-5f6e-42d9-a0f5-ff87176dd579 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:25.376745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9670c-5f6e-42d9-a0f5-ff87176dd579 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:25.376993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9670c-5f6e-42d9-a0f5-ff87176dd579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:25.377755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9670c-5f6e-42d9-a0f5-ff87176dd579 None admin] RBAC: Adding query filter params (role.id=a88f94e8d7794f1b8513bad8de38ebb9, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5, user.id=45c1db09322242ca96953a1e517ccb9d) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:25.378063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9670c-5f6e-42d9-a0f5-ff87176dd579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:25.379543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9670c-5f6e-42d9-a0f5-ff87176dd579 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:25.387906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 119/250] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:25 2022] GET /identity/v3/role_assignments?user.id=45c1db09322242ca96953a1e517ccb9d&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=a88f94e8d7794f1b8513bad8de38ebb9 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:25.481561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cee4c-92e1-4f8d-9f19-988628b063b9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:25.505760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:25.533132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9670c-5f6e-42d9-a0f5-ff87176dd579 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:25.627756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cee4c-92e1-4f8d-9f19-988628b063b9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:25.672004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9b6c4-3d07-44c0-8262-9e930ec26e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:25.672708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9b6c4-3d07-44c0-8262-9e930ec26e8f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:25.672988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9b6c4-3d07-44c0-8262-9e930ec26e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:25.673255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9b6c4-3d07-44c0-8262-9e930ec26e8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:25.687619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9b6c4-3d07-44c0-8262-9e930ec26e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-f1a9b6c4-3d07-44c0-8262-9e930ec26e8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:25.693027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:25.696749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:25.699231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 132/251] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:25.714358 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9b6c4-3d07-44c0-8262-9e930ec26e8f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:25.758395 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9670c-5f6e-42d9-a0f5-ff87176dd579 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:25.810138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf18dcd-2ba5-4870-a2c9-344b9f443408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:25.811260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf18dcd-2ba5-4870-a2c9-344b9f443408 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:25.811260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf18dcd-2ba5-4870-a2c9-344b9f443408 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:25.811825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf18dcd-2ba5-4870-a2c9-344b9f443408 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:25.824177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf18dcd-2ba5-4870-a2c9-344b9f443408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-ddf18dcd-2ba5-4870-a2c9-344b9f443408 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:25.829664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:25.833015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 120/252] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:25.836827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc1b9b-033d-4755-a71b-ad19ad261755 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:25.839589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc1b9b-033d-4755-a71b-ad19ad261755 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:25.839589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc1b9b-033d-4755-a71b-ad19ad261755 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:25.839589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 121/253] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:25.849591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc1b9b-033d-4755-a71b-ad19ad261755 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:25.874150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:25.904531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:25.946912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9b6c4-3d07-44c0-8262-9e930ec26e8f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:25.975444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc1b9b-033d-4755-a71b-ad19ad261755 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:26.024521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2870864-6105-4e4d-889e-97782735f5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:26.024521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2870864-6105-4e4d-889e-97782735f5be None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:26.024521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2870864-6105-4e4d-889e-97782735f5be None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:26.024521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2870864-6105-4e4d-889e-97782735f5be None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:26.025626 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2870864-6105-4e4d-889e-97782735f5be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:26.025626 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2870864-6105-4e4d-889e-97782735f5be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:26.025626 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2870864-6105-4e4d-889e-97782735f5be None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:26.032222 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 122/254] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:26.034151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493d30-44a1-4c57-b573-5f157c9f2ccf None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:26.034151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493d30-44a1-4c57-b573-5f157c9f2ccf None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:26.034151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493d30-44a1-4c57-b573-5f157c9f2ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:26.054534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-ff493d30-44a1-4c57-b573-5f157c9f2ccf None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:26.056327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ff493d30-44a1-4c57-b573-5f157c9f2ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:26.072972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd3f65-1acc-46c4-86bd-62a1030ee744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:26.075205 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd3f65-1acc-46c4-86bd-62a1030ee744 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:26.076016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd3f65-1acc-46c4-86bd-62a1030ee744 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:26.076827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd3f65-1acc-46c4-86bd-62a1030ee744 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:26.078540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd3f65-1acc-46c4-86bd-62a1030ee744 None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:26.079432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd3f65-1acc-46c4-86bd-62a1030ee744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:26.088521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd3f65-1acc-46c4-86bd-62a1030ee744 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:26.112048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 133/255] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:26.112688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd3f65-1acc-46c4-86bd-62a1030ee744 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:26.159575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 123/256] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:26.160387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493d30-44a1-4c57-b573-5f157c9f2ccf None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:26.173126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:26.282332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493d30-44a1-4c57-b573-5f157c9f2ccf None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:26.324080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cab4b0-7587-4059-bc63-fca6e72055fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:26.324773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cab4b0-7587-4059-bc63-fca6e72055fa None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:26.325051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cab4b0-7587-4059-bc63-fca6e72055fa None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:26.325368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cab4b0-7587-4059-bc63-fca6e72055fa None admin] PATH_INFO: `/v3/users/110304f302ba431fa0ffb7260a4493b7` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:26.326555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cab4b0-7587-4059-bc63-fca6e72055fa None admin] RBAC: Authorizing `identity:get_user(user_id=110304f302ba431fa0ffb7260a4493b7)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:26.328060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cab4b0-7587-4059-bc63-fca6e72055fa None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:26.330031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 124/257] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:26 2022] GET /identity/v3/users/110304f302ba431fa0ffb7260a4493b7 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:26.343092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cab4b0-7587-4059-bc63-fca6e72055fa None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:26.411165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd3f65-1acc-46c4-86bd-62a1030ee744 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:26.455474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:26.484087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cab4b0-7587-4059-bc63-fca6e72055fa None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:26.517765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1f58c-61dd-4d1e-84ce-c3e7647f95eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:26.517765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1f58c-61dd-4d1e-84ce-c3e7647f95eb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:26.518183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1f58c-61dd-4d1e-84ce-c3e7647f95eb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:26.518313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1f58c-61dd-4d1e-84ce-c3e7647f95eb None admin] PATH_INFO: `/v3/users/905112d3ae3c494ab6374fe585f27c57` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:26.520555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1f58c-61dd-4d1e-84ce-c3e7647f95eb None admin] RBAC: Authorizing `identity:get_user(user_id=905112d3ae3c494ab6374fe585f27c57)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:26.521339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1f58c-61dd-4d1e-84ce-c3e7647f95eb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:26.525531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 134/258] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:26 2022] GET /identity/v3/users/905112d3ae3c494ab6374fe585f27c57 => generated 283 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:26.533526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1f58c-61dd-4d1e-84ce-c3e7647f95eb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:26.551319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:26.565555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da184644-1d42-4a1a-9339-a7bb0f4af185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:26.566209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da184644-1d42-4a1a-9339-a7bb0f4af185 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:26.566490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da184644-1d42-4a1a-9339-a7bb0f4af185 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:26.566981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da184644-1d42-4a1a-9339-a7bb0f4af185 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:26.573453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da184644-1d42-4a1a-9339-a7bb0f4af185 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:26.574971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da184644-1d42-4a1a-9339-a7bb0f4af185 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:26.578455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 125/259] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:26 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:26.589029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da184644-1d42-4a1a-9339-a7bb0f4af185 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:26.840945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1f58c-61dd-4d1e-84ce-c3e7647f95eb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:26.890678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da184644-1d42-4a1a-9339-a7bb0f4af185 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:26.929407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c993fa2-b82b-4390-94c2-5e06d50d0df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:26.930085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c993fa2-b82b-4390-94c2-5e06d50d0df7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:26.930474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c993fa2-b82b-4390-94c2-5e06d50d0df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:26.930798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c993fa2-b82b-4390-94c2-5e06d50d0df7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:26.961673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236deef-1915-4290-803e-594180980388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:26.962742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236deef-1915-4290-803e-594180980388 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:26.963189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236deef-1915-4290-803e-594180980388 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:26.963653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236deef-1915-4290-803e-594180980388 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/users/110304f302ba431fa0ffb7260a4493b7/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:26.966780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236deef-1915-4290-803e-594180980388 None admin] RBAC: Authorizing `identity:create_grant(project_id=9120de2e247f4ce5a58344a2f79fd2e5, user_id=110304f302ba431fa0ffb7260a4493b7, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:26.969005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236deef-1915-4290-803e-594180980388 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:27.050131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c993fa2-b82b-4390-94c2-5e06d50d0df7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:27.052754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c993fa2-b82b-4390-94c2-5e06d50d0df7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:27.066679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:27.087114 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 126/260] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:26 2022] PUT /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/users/110304f302ba431fa0ffb7260a4493b7/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:27:27.087661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236deef-1915-4290-803e-594180980388 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:27.099484 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:27.268393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 135/261] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:27.278984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c993fa2-b82b-4390-94c2-5e06d50d0df7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:27.433746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236deef-1915-4290-803e-594180980388 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:27.535580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c993fa2-b82b-4390-94c2-5e06d50d0df7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:27.560032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:27.597752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7d7d0-a60b-4c7d-a2df-39f13d0756a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:27.598885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7d7d0-a60b-4c7d-a2df-39f13d0756a5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:27.599393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7d7d0-a60b-4c7d-a2df-39f13d0756a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:27.599901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7d7d0-a60b-4c7d-a2df-39f13d0756a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:27.642215 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7d7d0-a60b-4c7d-a2df-39f13d0756a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-8af7d7d0-a60b-4c7d-a2df-39f13d0756a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:27.662827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:27.664862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:27.667301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 127/262] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:27:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 578 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:27.673923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedab9d5-bc7e-4ad9-a137-bd001485cf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:27.675142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedab9d5-bc7e-4ad9-a137-bd001485cf47 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:27.675638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedab9d5-bc7e-4ad9-a137-bd001485cf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:27.676117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedab9d5-bc7e-4ad9-a137-bd001485cf47 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:27.682027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedab9d5-bc7e-4ad9-a137-bd001485cf47 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:27.685246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedab9d5-bc7e-4ad9-a137-bd001485cf47 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:27.693145 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 136/263] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:27 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:27.700110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7d7d0-a60b-4c7d-a2df-39f13d0756a5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:27.700622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedab9d5-bc7e-4ad9-a137-bd001485cf47 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:27.942361 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:28.050713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7d7d0-a60b-4c7d-a2df-39f13d0756a5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:28.127645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedab9d5-bc7e-4ad9-a137-bd001485cf47 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:28.169608 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a18122-0097-4560-9607-ff4a97c042b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:28.170594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a18122-0097-4560-9607-ff4a97c042b4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:28.171080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a18122-0097-4560-9607-ff4a97c042b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:28.171550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a18122-0097-4560-9607-ff4a97c042b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:28.172863 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a18122-0097-4560-9607-ff4a97c042b4 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5, user.id=905112d3ae3c494ab6374fe585f27c57) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:28.173393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a18122-0097-4560-9607-ff4a97c042b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:28.176068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a18122-0097-4560-9607-ff4a97c042b4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:28.202235 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 128/264] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:27 2022] GET /identity/v3/role_assignments?user.id=905112d3ae3c494ab6374fe585f27c57&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=c0316e22a13a4034846c451753b4c14e => generated 608 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:28.273209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1513-be90-4e4c-a9f0-0e3de6ec75eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:28.274467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1513-be90-4e4c-a9f0-0e3de6ec75eb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:28.274947 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1513-be90-4e4c-a9f0-0e3de6ec75eb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:28.275413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf1513-be90-4e4c-a9f0-0e3de6ec75eb None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:28.276692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf1513-be90-4e4c-a9f0-0e3de6ec75eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:28.277210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf1513-be90-4e4c-a9f0-0e3de6ec75eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:28.279713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf1513-be90-4e4c-a9f0-0e3de6ec75eb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:28.306042 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 137/265] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 607 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:28.312098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a18122-0097-4560-9607-ff4a97c042b4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:28.490566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a18122-0097-4560-9607-ff4a97c042b4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:28.533244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:28.545336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10d964-2a9b-4aca-96f7-214fca0b32d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:28.546119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d964-2a9b-4aca-96f7-214fca0b32d5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:28.546438 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d964-2a9b-4aca-96f7-214fca0b32d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:28.546728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10d964-2a9b-4aca-96f7-214fca0b32d5 None admin] PATH_INFO: `/v3/users/905112d3ae3c494ab6374fe585f27c57` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:28.553530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10d964-2a9b-4aca-96f7-214fca0b32d5 None admin] RBAC: Authorizing `identity:get_user(user_id=905112d3ae3c494ab6374fe585f27c57)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:28.555602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10d964-2a9b-4aca-96f7-214fca0b32d5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:28.557805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 129/266] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:28 2022] GET /identity/v3/users/905112d3ae3c494ab6374fe585f27c57 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:28.565048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1513-be90-4e4c-a9f0-0e3de6ec75eb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:28.674594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:28.842012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf1513-be90-4e4c-a9f0-0e3de6ec75eb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:28.939663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7983b-de40-4c32-b04d-9deef9d07cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:28.939663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7983b-de40-4c32-b04d-9deef9d07cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:28.939663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7983b-de40-4c32-b04d-9deef9d07cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:28.939663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7983b-de40-4c32-b04d-9deef9d07cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.022494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7983b-de40-4c32-b04d-9deef9d07cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:29.024631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7983b-de40-4c32-b04d-9deef9d07cd4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:29.050832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153f0e-3186-45d5-93f9-5b4b87f66b5c None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:29.051379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153f0e-3186-45d5-93f9-5b4b87f66b5c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:29.051822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da153f0e-3186-45d5-93f9-5b4b87f66b5c None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.059219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 130/267] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:29.065249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:29.068134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d88e-2a53-4662-981c-e1ea1fd8226e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:29.072780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d88e-2a53-4662-981c-e1ea1fd8226e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:29.073377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d88e-2a53-4662-981c-e1ea1fd8226e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.138937 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-67c3d88e-2a53-4662-981c-e1ea1fd8226e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:29.141059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-67c3d88e-2a53-4662-981c-e1ea1fd8226e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:29.149839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 138/268] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:29.156550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7983b-de40-4c32-b04d-9deef9d07cd4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:29.290255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7983b-de40-4c32-b04d-9deef9d07cd4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:29.340891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbfa3b-f602-490e-87c5-641f9e941a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:29.342603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbfa3b-f602-490e-87c5-641f9e941a29 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:29.343528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbfa3b-f602-490e-87c5-641f9e941a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:29.344335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbfa3b-f602-490e-87c5-641f9e941a29 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.347015 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbfa3b-f602-490e-87c5-641f9e941a29 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:29.350412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbfa3b-f602-490e-87c5-641f9e941a29 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:29.360598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 131/270] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:29.360598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81867c-ddbf-46ef-ac5e-37b618a2fefc None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:29.360598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81867c-ddbf-46ef-ac5e-37b618a2fefc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:29.360598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81867c-ddbf-46ef-ac5e-37b618a2fefc None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.360598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 132/271] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:29.361725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 139/271] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:29 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:29.366177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2642-a3dd-4852-b19d-c8fbd547ae58 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:29.366441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2642-a3dd-4852-b19d-c8fbd547ae58 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:29.366776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a2642-a3dd-4852-b19d-c8fbd547ae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.368465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbfa3b-f602-490e-87c5-641f9e941a29 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:29.380824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:29.410481 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9e8a2642-a3dd-4852-b19d-c8fbd547ae58 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:29.411632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9e8a2642-a3dd-4852-b19d-c8fbd547ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:29.519171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 133/272] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:29.520581 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294dec-2edf-4b58-91ca-0446bba0da88 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:29.521043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294dec-2edf-4b58-91ca-0446bba0da88 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:29.521465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294dec-2edf-4b58-91ca-0446bba0da88 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.528179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 134/273] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:29.530130 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eaf2b-f36b-42d9-8dc8-decfeebeb3c3 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:29.530714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eaf2b-f36b-42d9-8dc8-decfeebeb3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:29.531141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106eaf2b-f36b-42d9-8dc8-decfeebeb3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.552340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbfa3b-f602-490e-87c5-641f9e941a29 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:29.565178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-106eaf2b-f36b-42d9-8dc8-decfeebeb3c3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:29.566431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-106eaf2b-f36b-42d9-8dc8-decfeebeb3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:29.608944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e40de-1805-4140-b3e9-58889517b538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:29.609698 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e40de-1805-4140-b3e9-58889517b538 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:29.609980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e40de-1805-4140-b3e9-58889517b538 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:29.611811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e40de-1805-4140-b3e9-58889517b538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:29.612600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e40de-1805-4140-b3e9-58889517b538 None admin] RBAC: Adding query filter params (role.id=971e130ba91d4b7ab75b8e33d322760b, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5, user.id=905112d3ae3c494ab6374fe585f27c57) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:29.612916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e40de-1805-4140-b3e9-58889517b538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:29.615378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e40de-1805-4140-b3e9-58889517b538 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:29.634584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 140/274] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:29 2022] GET /identity/v3/role_assignments?user.id=905112d3ae3c494ab6374fe585f27c57&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=971e130ba91d4b7ab75b8e33d322760b => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:29.665683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:29.685649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 135/275] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:29.869630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e40de-1805-4140-b3e9-58889517b538 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:29.874726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106eaf2b-f36b-42d9-8dc8-decfeebeb3c3 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:29.990633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:30.053459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e40de-1805-4140-b3e9-58889517b538 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.075524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106eaf2b-f36b-42d9-8dc8-decfeebeb3c3 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.123965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a467-82bb-46bc-9885-98ae52138b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.124888 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a467-82bb-46bc-9885-98ae52138b68 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.125332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a467-82bb-46bc-9885-98ae52138b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.125713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a467-82bb-46bc-9885-98ae52138b68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.132247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144218-bebf-4dee-972c-8dcfa862ce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.134874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144218-bebf-4dee-972c-8dcfa862ce90 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.135598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144218-bebf-4dee-972c-8dcfa862ce90 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.136234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144218-bebf-4dee-972c-8dcfa862ce90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.139838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22144218-bebf-4dee-972c-8dcfa862ce90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:30.143414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22144218-bebf-4dee-972c-8dcfa862ce90 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:30.143966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8a467-82bb-46bc-9885-98ae52138b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2bc8a467-82bb-46bc-9885-98ae52138b68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:30.149976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:30.150943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:30.151770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:30.154138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 136/276] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:30.156221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 141/277] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:30.157665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144218-bebf-4dee-972c-8dcfa862ce90 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:30.164334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a467-82bb-46bc-9885-98ae52138b68 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:30.287514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:30.306585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8a467-82bb-46bc-9885-98ae52138b68 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.345078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:30.356010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2335756-ba4e-4e4e-b249-5b09e7ac3251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.357497 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2335756-ba4e-4e4e-b249-5b09e7ac3251 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.358209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2335756-ba4e-4e4e-b249-5b09e7ac3251 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.358898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2335756-ba4e-4e4e-b249-5b09e7ac3251 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.375801 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22144218-bebf-4dee-972c-8dcfa862ce90 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.378578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2335756-ba4e-4e4e-b249-5b09e7ac3251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-f2335756-ba4e-4e4e-b249-5b09e7ac3251 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:30.387887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:30.389765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:30.391374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:30.397393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 142/278] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:30.401257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2335756-ba4e-4e4e-b249-5b09e7ac3251 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:30.455831 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404f075-dd4d-4466-8555-f6093ee203f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.456912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f075-dd4d-4466-8555-f6093ee203f9 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.457411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f075-dd4d-4466-8555-f6093ee203f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.457895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404f075-dd4d-4466-8555-f6093ee203f9 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.459200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404f075-dd4d-4466-8555-f6093ee203f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:30.461843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404f075-dd4d-4466-8555-f6093ee203f9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:30.563090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2335756-ba4e-4e4e-b249-5b09e7ac3251 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.628334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62548a-543e-45c4-8bea-992bbc402679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.629434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62548a-543e-45c4-8bea-992bbc402679 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.629933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62548a-543e-45c4-8bea-992bbc402679 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.630405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62548a-543e-45c4-8bea-992bbc402679 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.631675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62548a-543e-45c4-8bea-992bbc402679 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:30.632176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62548a-543e-45c4-8bea-992bbc402679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:30.634765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc62548a-543e-45c4-8bea-992bbc402679 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:30.650194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 137/279] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:27:30 2022] POST /identity/v3/users => generated 293 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:30.650194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404f075-dd4d-4466-8555-f6093ee203f9 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:30.650481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 143/280] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:30.657960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62548a-543e-45c4-8bea-992bbc402679 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:30.761947 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:30.814794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404f075-dd4d-4466-8555-f6093ee203f9 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.835940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:30.851142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62548a-543e-45c4-8bea-992bbc402679 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:30.882515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32cf10-8cc4-435f-971d-a70efa6df225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.884577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32cf10-8cc4-435f-971d-a70efa6df225 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.885245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32cf10-8cc4-435f-971d-a70efa6df225 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.885649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32cf10-8cc4-435f-971d-a70efa6df225 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.886804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32cf10-8cc4-435f-971d-a70efa6df225 None admin] RBAC: Adding query filter params (name=member) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:30.887832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32cf10-8cc4-435f-971d-a70efa6df225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:30.889752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32cf10-8cc4-435f-971d-a70efa6df225 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:30.899952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c704dd36-a3b3-411d-bb55-6bad23e50c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:30.900640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704dd36-a3b3-411d-bb55-6bad23e50c3d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.900916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704dd36-a3b3-411d-bb55-6bad23e50c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.901184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c704dd36-a3b3-411d-bb55-6bad23e50c3d None admin] PATH_INFO: `/v3/users/45c1db09322242ca96953a1e517ccb9d` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.902482 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704dd36-a3b3-411d-bb55-6bad23e50c3d None admin] RBAC: Authorizing `identity:get_user(user_id=45c1db09322242ca96953a1e517ccb9d)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:30.903992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c704dd36-a3b3-411d-bb55-6bad23e50c3d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:30.906053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 144/281] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:30 2022] GET /identity/v3/users/45c1db09322242ca96953a1e517ccb9d => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:30.906998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde68ed-a6d1-4c2e-9bf9-da273782934c None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.907285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde68ed-a6d1-4c2e-9bf9-da273782934c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.907647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde68ed-a6d1-4c2e-9bf9-da273782934c None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.909033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 145/282] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:30.911204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 138/283] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:30.918961 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde68ed-a6d1-4c2e-9bf9-da273782934c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:30.921700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0c36d-3fa6-47f7-b26b-be8ce44a5e3b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:30.922225 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0c36d-3fa6-47f7-b26b-be8ce44a5e3b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:30.922721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0c36d-3fa6-47f7-b26b-be8ce44a5e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:30.952238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-48a0c36d-3fa6-47f7-b26b-be8ce44a5e3b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:30.954102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-48a0c36d-3fa6-47f7-b26b-be8ce44a5e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:31.091836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 139/284] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:31.093413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0c36d-3fa6-47f7-b26b-be8ce44a5e3b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:31.134737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde68ed-a6d1-4c2e-9bf9-da273782934c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:31.176743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:31.212122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db873578-729c-4862-8d70-0f0235ad9da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:31.213194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db873578-729c-4862-8d70-0f0235ad9da1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:31.213665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db873578-729c-4862-8d70-0f0235ad9da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:31.214456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db873578-729c-4862-8d70-0f0235ad9da1 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:31.217959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db873578-729c-4862-8d70-0f0235ad9da1 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:31.221544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db873578-729c-4862-8d70-0f0235ad9da1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:31.225013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 146/285] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:30 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:31.234602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db873578-729c-4862-8d70-0f0235ad9da1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:31.322835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0c36d-3fa6-47f7-b26b-be8ce44a5e3b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:31.331575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:31.418520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e552fc-de68-44ea-8116-a343213f3b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:31.421933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e552fc-de68-44ea-8116-a343213f3b92 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:31.422310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e552fc-de68-44ea-8116-a343213f3b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:31.422635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e552fc-de68-44ea-8116-a343213f3b92 None admin] PATH_INFO: `/v3/users/e29203af08094474a4a0756b1183cebb` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:31.449417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e552fc-de68-44ea-8116-a343213f3b92 None admin] RBAC: Authorizing `identity:get_user(user_id=e29203af08094474a4a0756b1183cebb)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:31.456962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e552fc-de68-44ea-8116-a343213f3b92 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:31.459143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 140/286] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:31 2022] GET /identity/v3/users/e29203af08094474a4a0756b1183cebb => generated 293 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:31.465974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e552fc-de68-44ea-8116-a343213f3b92 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:31.526341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db873578-729c-4862-8d70-0f0235ad9da1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:31.602422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af346-abf9-4ddb-a2de-c5be3394fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:31.604043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af346-abf9-4ddb-a2de-c5be3394fb21 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:31.604802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af346-abf9-4ddb-a2de-c5be3394fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:31.605783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af346-abf9-4ddb-a2de-c5be3394fb21 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/users/45c1db09322242ca96953a1e517ccb9d/roles/a88f94e8d7794f1b8513bad8de38ebb9` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:31.609978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af346-abf9-4ddb-a2de-c5be3394fb21 None admin] RBAC: Authorizing `identity:create_grant(project_id=9120de2e247f4ce5a58344a2f79fd2e5, user_id=45c1db09322242ca96953a1e517ccb9d, role_id=a88f94e8d7794f1b8513bad8de38ebb9)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:31.613237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af346-abf9-4ddb-a2de-c5be3394fb21 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:31.630959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e552fc-de68-44ea-8116-a343213f3b92 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:31.682165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5d661-3e90-4a6e-bfd1-25076f4022f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:31.682165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5d661-3e90-4a6e-bfd1-25076f4022f9 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:31.682165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5d661-3e90-4a6e-bfd1-25076f4022f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:31.682165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5d661-3e90-4a6e-bfd1-25076f4022f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:31.682708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5d661-3e90-4a6e-bfd1-25076f4022f9 None admin] RBAC: Adding query filter params (role.id=23bfcdf883144a0b8740e12c6a6de7e3, user.id=e29203af08094474a4a0756b1183cebb, scope.system=all) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:31.682708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5d661-3e90-4a6e-bfd1-25076f4022f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:31.682708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d5d661-3e90-4a6e-bfd1-25076f4022f9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:31.687070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 141/287] 10.222.0.83 () {56 vars in 1308 bytes} [Mon Aug 29 21:27:31 2022] GET /identity/v3/role_assignments?user.id=e29203af08094474a4a0756b1183cebb&scope.system=all&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:31.688219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5d661-3e90-4a6e-bfd1-25076f4022f9 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:31.726880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:31.760767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 147/288] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:27:31 2022] PUT /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/users/45c1db09322242ca96953a1e517ccb9d/roles/a88f94e8d7794f1b8513bad8de38ebb9 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:31.837697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d5d661-3e90-4a6e-bfd1-25076f4022f9 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:31.896525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bebc7-d4eb-4b56-90b4-5bf7fbeef490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:31.896525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bebc7-d4eb-4b56-90b4-5bf7fbeef490 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:31.896917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bebc7-d4eb-4b56-90b4-5bf7fbeef490 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:31.897021 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bebc7-d4eb-4b56-90b4-5bf7fbeef490 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:31.924513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bebc7-d4eb-4b56-90b4-5bf7fbeef490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-b93bebc7-d4eb-4b56-90b4-5bf7fbeef490 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:31.928612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:31.930671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:31.932358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:31.940521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 142/289] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:31.948501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af346-abf9-4ddb-a2de-c5be3394fb21 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:32.099083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:32.238568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af346-abf9-4ddb-a2de-c5be3394fb21 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:32.345717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a313fad-e594-40fa-aa5c-9c63c15ce199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:32.346472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a313fad-e594-40fa-aa5c-9c63c15ce199 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:32.346767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a313fad-e594-40fa-aa5c-9c63c15ce199 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:32.352517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a313fad-e594-40fa-aa5c-9c63c15ce199 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:32.352517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a313fad-e594-40fa-aa5c-9c63c15ce199 None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:32.352517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a313fad-e594-40fa-aa5c-9c63c15ce199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:32.352517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a313fad-e594-40fa-aa5c-9c63c15ce199 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:32.361283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 148/290] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:32.374621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bebc7-d4eb-4b56-90b4-5bf7fbeef490 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:32.642555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:32.680557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bebc7-d4eb-4b56-90b4-5bf7fbeef490 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:32.769568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418d5a4-c99c-4277-af9e-1c0690e69b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:32.770687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418d5a4-c99c-4277-af9e-1c0690e69b0c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:32.771190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418d5a4-c99c-4277-af9e-1c0690e69b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:32.771677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1418d5a4-c99c-4277-af9e-1c0690e69b0c None admin] PATH_INFO: `/v3/users/110304f302ba431fa0ffb7260a4493b7` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:32.777396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418d5a4-c99c-4277-af9e-1c0690e69b0c None admin] RBAC: Authorizing `identity:get_user(user_id=110304f302ba431fa0ffb7260a4493b7)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:32.779346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1418d5a4-c99c-4277-af9e-1c0690e69b0c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:32.781487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 143/291] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:32 2022] GET /identity/v3/users/110304f302ba431fa0ffb7260a4493b7 => generated 297 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:32.790016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a313fad-e594-40fa-aa5c-9c63c15ce199 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:32.956100 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a313fad-e594-40fa-aa5c-9c63c15ce199 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:32.968247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:33.008296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f6ef-9224-4046-ac7a-1ef67c6a84e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:33.010555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f6ef-9224-4046-ac7a-1ef67c6a84e6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:33.010555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f6ef-9224-4046-ac7a-1ef67c6a84e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:33.010555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9f6ef-9224-4046-ac7a-1ef67c6a84e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:33.179681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9f6ef-9224-4046-ac7a-1ef67c6a84e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:33.182624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9f6ef-9224-4046-ac7a-1ef67c6a84e6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:33.415473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 149/292] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:33.422771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418d5a4-c99c-4277-af9e-1c0690e69b0c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:33.655445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1418d5a4-c99c-4277-af9e-1c0690e69b0c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:33.738476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd01d8-5b33-44b3-a8a8-2411aef9a861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:33.739409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd01d8-5b33-44b3-a8a8-2411aef9a861 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:33.739884 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd01d8-5b33-44b3-a8a8-2411aef9a861 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:33.740348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd01d8-5b33-44b3-a8a8-2411aef9a861 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:33.742975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd01d8-5b33-44b3-a8a8-2411aef9a861 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:33.745656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd01d8-5b33-44b3-a8a8-2411aef9a861 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:33.753332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 144/293] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:33 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:33.763447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f6ef-9224-4046-ac7a-1ef67c6a84e6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:33.784469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:34.031329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9f6ef-9224-4046-ac7a-1ef67c6a84e6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:34.140122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f55ac-a8a7-456c-8267-0837db25c3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:34.141181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f55ac-a8a7-456c-8267-0837db25c3be None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:34.141651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f55ac-a8a7-456c-8267-0837db25c3be None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:34.142104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f55ac-a8a7-456c-8267-0837db25c3be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:34.143428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f55ac-a8a7-456c-8267-0837db25c3be None admin] RBAC: Adding query filter params (role.id=23bfcdf883144a0b8740e12c6a6de7e3, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5, user.id=110304f302ba431fa0ffb7260a4493b7) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:34.143959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f55ac-a8a7-456c-8267-0837db25c3be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:34.146727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f55ac-a8a7-456c-8267-0837db25c3be None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:34.165643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 150/294] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:33 2022] GET /identity/v3/role_assignments?user.id=110304f302ba431fa0ffb7260a4493b7&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 608 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:34.648449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4635b-249a-4a2b-9442-ab0b1e6d7849 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:34.650294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4635b-249a-4a2b-9442-ab0b1e6d7849 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:34.651023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a4635b-249a-4a2b-9442-ab0b1e6d7849 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:34.653844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 145/295] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:34.657713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e5700-2b74-4979-a7ee-6bf83ef7ee99 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:34.658569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e5700-2b74-4979-a7ee-6bf83ef7ee99 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:34.659284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e5700-2b74-4979-a7ee-6bf83ef7ee99 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:34.661705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 151/296] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:34.667077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67fde5-68d5-4b03-88f7-59ad89daa269 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:34.667883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67fde5-68d5-4b03-88f7-59ad89daa269 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:34.668703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67fde5-68d5-4b03-88f7-59ad89daa269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:34.675465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bde3c-8710-4e6e-935a-d958a0f3c483 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:34.675927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bde3c-8710-4e6e-935a-d958a0f3c483 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:34.676399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bde3c-8710-4e6e-935a-d958a0f3c483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:34.701142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-3e67fde5-68d5-4b03-88f7-59ad89daa269 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:34.703419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3e67fde5-68d5-4b03-88f7-59ad89daa269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:34.709915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9a2bde3c-8710-4e6e-935a-d958a0f3c483 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:34.713094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9a2bde3c-8710-4e6e-935a-d958a0f3c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:34.736610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:34.848199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 146/297] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:34.875746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 152/298] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:35.070667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4732d74-cab1-4b5a-90aa-895eef855f2a None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:35.071616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4732d74-cab1-4b5a-90aa-895eef855f2a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:35.072402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4732d74-cab1-4b5a-90aa-895eef855f2a None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:35.075768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 147/299] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:35.081402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f261-3baa-448f-afa5-520c5b69ef8d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:35.082134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f261-3baa-448f-afa5-520c5b69ef8d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:35.082134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220f261-3baa-448f-afa5-520c5b69ef8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:35.089090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:35.110620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e220f261-3baa-448f-afa5-520c5b69ef8d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:35.112653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e220f261-3baa-448f-afa5-520c5b69ef8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:35.246692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 153/300] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:27:35.359078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4732d74-cab1-4b5a-90aa-895eef855f2a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:35.406046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f261-3baa-448f-afa5-520c5b69ef8d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:35.591622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4732d74-cab1-4b5a-90aa-895eef855f2a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:35.622423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220f261-3baa-448f-afa5-520c5b69ef8d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:35.660527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35dfda-af4f-410e-9581-474d6a2d0e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:35.661541 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35dfda-af4f-410e-9581-474d6a2d0e14 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:35.661966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35dfda-af4f-410e-9581-474d6a2d0e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:35.662356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35dfda-af4f-410e-9581-474d6a2d0e14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:35.677346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc35dfda-af4f-410e-9581-474d6a2d0e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-cc35dfda-af4f-410e-9581-474d6a2d0e14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:35.682458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:35.684847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 148/301] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:35.686966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda45564-1680-4bb8-9206-9c0de158445b None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:35.693756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda45564-1680-4bb8-9206-9c0de158445b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:35.693756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda45564-1680-4bb8-9206-9c0de158445b None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:35.693756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 149/302] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:35.693756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda45564-1680-4bb8-9206-9c0de158445b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:35.700827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:35.707756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af9710-e9c7-4965-b1b8-f6989618e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:35.708900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9710-e9c7-4965-b1b8-f6989618e158 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:35.709385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9710-e9c7-4965-b1b8-f6989618e158 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:35.709862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af9710-e9c7-4965-b1b8-f6989618e158 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:35.717190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:35.717386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af9710-e9c7-4965-b1b8-f6989618e158 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:35.717386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af9710-e9c7-4965-b1b8-f6989618e158 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:35.718192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 154/303] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:35.720131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f96f2-a90f-4215-a55a-b968c360e987 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:35.720564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f96f2-a90f-4215-a55a-b968c360e987 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:35.720988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f96f2-a90f-4215-a55a-b968c360e987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:35.750498 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6d2f96f2-a90f-4215-a55a-b968c360e987 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:35.752476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6d2f96f2-a90f-4215-a55a-b968c360e987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:35.848078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 155/304] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:35.849007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f96f2-a90f-4215-a55a-b968c360e987 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:35.871230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda45564-1680-4bb8-9206-9c0de158445b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:35.926485 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40108-d4ff-48f9-a5e4-461dffd415bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:35.927199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40108-d4ff-48f9-a5e4-461dffd415bc None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:35.927606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40108-d4ff-48f9-a5e4-461dffd415bc None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:35.928007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade40108-d4ff-48f9-a5e4-461dffd415bc None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:35.929405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40108-d4ff-48f9-a5e4-461dffd415bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:35.929838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40108-d4ff-48f9-a5e4-461dffd415bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:35.931979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade40108-d4ff-48f9-a5e4-461dffd415bc None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:35.943789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 150/305] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:35.946519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40108-d4ff-48f9-a5e4-461dffd415bc None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:36.032445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f96f2-a90f-4215-a55a-b968c360e987 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:36.083779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:36.090550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:36.099934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8825f1-43c0-44b7-a97f-44b51d578ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:36.101290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8825f1-43c0-44b7-a97f-44b51d578ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.101779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8825f1-43c0-44b7-a97f-44b51d578ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.102209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8825f1-43c0-44b7-a97f-44b51d578ec3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.121009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8825f1-43c0-44b7-a97f-44b51d578ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-0d8825f1-43c0-44b7-a97f-44b51d578ec3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:36.127539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:36.129301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 156/306] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:36.131125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8825f1-43c0-44b7-a97f-44b51d578ec3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:36.159080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade40108-d4ff-48f9-a5e4-461dffd415bc None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:36.227844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0fe7d-79cf-4e72-af1b-c6a5df865069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:36.228993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0fe7d-79cf-4e72-af1b-c6a5df865069 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.229485 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0fe7d-79cf-4e72-af1b-c6a5df865069 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.229968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0fe7d-79cf-4e72-af1b-c6a5df865069 None admin] PATH_INFO: `/v3/groups` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.231219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0fe7d-79cf-4e72-af1b-c6a5df865069 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:36.234108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0fe7d-79cf-4e72-af1b-c6a5df865069 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:36.271430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8825f1-43c0-44b7-a97f-44b51d578ec3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:36.328365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1a523-1554-4d8a-aaa7-2159b8d27d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:36.329483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1a523-1554-4d8a-aaa7-2159b8d27d1c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.329941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1a523-1554-4d8a-aaa7-2159b8d27d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.330434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1a523-1554-4d8a-aaa7-2159b8d27d1c None admin] PATH_INFO: `/v3/users/fb803c12f4614cbebbc85d288c1bb0ad` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.358276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1a523-1554-4d8a-aaa7-2159b8d27d1c None admin] RBAC: Authorizing `identity:get_user(user_id=fb803c12f4614cbebbc85d288c1bb0ad)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:36.360820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1a523-1554-4d8a-aaa7-2159b8d27d1c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:36.363964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 157/307] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:36 2022] GET /identity/v3/users/fb803c12f4614cbebbc85d288c1bb0ad => generated 293 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:36.365506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1a523-1554-4d8a-aaa7-2159b8d27d1c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:36.408681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 151/308] 10.222.0.83 () {60 vars in 1134 bytes} [Mon Aug 29 21:27:35 2022] POST /identity/v3/groups => generated 229 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:36.409633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0fe7d-79cf-4e72-af1b-c6a5df865069 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:36.452948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:36.561805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1a523-1554-4d8a-aaa7-2159b8d27d1c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:36.610954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0fe7d-79cf-4e72-af1b-c6a5df865069 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:36.641008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81613c-2492-41da-9601-25910200a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:36.641956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81613c-2492-41da-9601-25910200a38d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.642172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81613c-2492-41da-9601-25910200a38d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.642384 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81613c-2492-41da-9601-25910200a38d None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.643082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81613c-2492-41da-9601-25910200a38d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:36.643382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81613c-2492-41da-9601-25910200a38d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:36.646045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81613c-2492-41da-9601-25910200a38d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:36.657591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 158/309] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:36.658258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81613c-2492-41da-9601-25910200a38d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:36.669253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:36.681615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0055cc-edd0-499d-844b-b84b8b21ad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:36.682730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0055cc-edd0-499d-844b-b84b8b21ad15 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.683948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0055cc-edd0-499d-844b-b84b8b21ad15 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.683948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0055cc-edd0-499d-844b-b84b8b21ad15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.707293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0055cc-edd0-499d-844b-b84b8b21ad15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-2b0055cc-edd0-499d-844b-b84b8b21ad15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:36.718843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:36.725587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 152/310] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:36.727171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0055cc-edd0-499d-844b-b84b8b21ad15 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:36.817882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81613c-2492-41da-9601-25910200a38d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:36.839169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:36.881932 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef2d74-9c95-469c-a94e-0ff31cdb53fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:36.882739 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef2d74-9c95-469c-a94e-0ff31cdb53fd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.883050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef2d74-9c95-469c-a94e-0ff31cdb53fd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.883883 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef2d74-9c95-469c-a94e-0ff31cdb53fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.884667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef2d74-9c95-469c-a94e-0ff31cdb53fd None admin] RBAC: Adding query filter params (role.id=a88f94e8d7794f1b8513bad8de38ebb9, user.id=fb803c12f4614cbebbc85d288c1bb0ad, scope.system=all) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:36.884971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef2d74-9c95-469c-a94e-0ff31cdb53fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:36.886665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef2d74-9c95-469c-a94e-0ff31cdb53fd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:36.893709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 159/311] 10.222.0.83 () {56 vars in 1308 bytes} [Mon Aug 29 21:27:36 2022] GET /identity/v3/role_assignments?user.id=fb803c12f4614cbebbc85d288c1bb0ad&scope.system=all&role.id=a88f94e8d7794f1b8513bad8de38ebb9 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:36.894359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef2d74-9c95-469c-a94e-0ff31cdb53fd None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:36.921901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0055cc-edd0-499d-844b-b84b8b21ad15 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:36.981400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9e045-9613-4cc4-820d-9e5bddc182f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:36.983043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9e045-9613-4cc4-820d-9e5bddc182f9 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:36.984085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9e045-9613-4cc4-820d-9e5bddc182f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:36.984380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9e045-9613-4cc4-820d-9e5bddc182f9 None admin] PATH_INFO: `/v3/users/45c1db09322242ca96953a1e517ccb9d` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:36.985891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9e045-9613-4cc4-820d-9e5bddc182f9 None admin] RBAC: Authorizing `identity:get_user(user_id=45c1db09322242ca96953a1e517ccb9d)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:36.988206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9e045-9613-4cc4-820d-9e5bddc182f9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:36.990635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 153/312] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:36 2022] GET /identity/v3/users/45c1db09322242ca96953a1e517ccb9d => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:36.998062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9e045-9613-4cc4-820d-9e5bddc182f9 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:37.088353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef2d74-9c95-469c-a94e-0ff31cdb53fd None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:37.135467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aa23a-1fd6-4f16-8e94-79344d0ef3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:37.136620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:37.138811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa23a-1fd6-4f16-8e94-79344d0ef3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:37.138811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa23a-1fd6-4f16-8e94-79344d0ef3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:37.139041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aa23a-1fd6-4f16-8e94-79344d0ef3e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:37.140183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa23a-1fd6-4f16-8e94-79344d0ef3e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:37.140935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa23a-1fd6-4f16-8e94-79344d0ef3e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:37.144531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aa23a-1fd6-4f16-8e94-79344d0ef3e4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:37.155872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 160/313] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:37.171133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aa23a-1fd6-4f16-8e94-79344d0ef3e4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:37.222791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9e045-9613-4cc4-820d-9e5bddc182f9 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:37.225447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:37.274429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfe441-7af3-4cd0-a4d6-458d174affb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:37.275844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfe441-7af3-4cd0-a4d6-458d174affb8 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:37.276311 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfe441-7af3-4cd0-a4d6-458d174affb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:37.277123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfe441-7af3-4cd0-a4d6-458d174affb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:37.407722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aa23a-1fd6-4f16-8e94-79344d0ef3e4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:37.443329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfe441-7af3-4cd0-a4d6-458d174affb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:37.445502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfe441-7af3-4cd0-a4d6-458d174affb8 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:37.480745 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a521732-495c-4685-8f72-9e3d1d0a3832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:37.481677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a521732-495c-4685-8f72-9e3d1d0a3832 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:37.482113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a521732-495c-4685-8f72-9e3d1d0a3832 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:37.482626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a521732-495c-4685-8f72-9e3d1d0a3832 None admin] PATH_INFO: `/v3/users/e29203af08094474a4a0756b1183cebb` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:37.484602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a521732-495c-4685-8f72-9e3d1d0a3832 None admin] RBAC: Authorizing `identity:get_user(user_id=e29203af08094474a4a0756b1183cebb)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:37.486445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a521732-495c-4685-8f72-9e3d1d0a3832 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:37.494166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 161/314] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:37 2022] GET /identity/v3/users/e29203af08094474a4a0756b1183cebb => generated 293 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:37.495861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a521732-495c-4685-8f72-9e3d1d0a3832 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:37.568290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:37.642736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a521732-495c-4685-8f72-9e3d1d0a3832 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:37.647764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:37.676507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 154/315] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:37.686592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfe441-7af3-4cd0-a4d6-458d174affb8 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:37.704874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05856fcd-2c59-480f-ae1c-b446ef4c3666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:37.706086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05856fcd-2c59-480f-ae1c-b446ef4c3666 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:37.706585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05856fcd-2c59-480f-ae1c-b446ef4c3666 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:37.707188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05856fcd-2c59-480f-ae1c-b446ef4c3666 None admin] PATH_INFO: `/v3/system/users/e29203af08094474a4a0756b1183cebb/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:37.709303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05856fcd-2c59-480f-ae1c-b446ef4c3666 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e29203af08094474a4a0756b1183cebb, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:37.711800 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05856fcd-2c59-480f-ae1c-b446ef4c3666 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:37.870868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfe441-7af3-4cd0-a4d6-458d174affb8 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:37.928653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 162/316] 10.222.0.83 () {58 vars in 1334 bytes} [Mon Aug 29 21:27:37 2022] PUT /identity/v3/system/users/e29203af08094474a4a0756b1183cebb/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:37.939569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c309b-8e5f-4bb2-aa11-58b98dc75b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:37.943380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c309b-8e5f-4bb2-aa11-58b98dc75b7b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:37.943380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c309b-8e5f-4bb2-aa11-58b98dc75b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:37.943380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c309b-8e5f-4bb2-aa11-58b98dc75b7b None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:37.949766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c309b-8e5f-4bb2-aa11-58b98dc75b7b None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:37.951834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c309b-8e5f-4bb2-aa11-58b98dc75b7b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:37.957464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 155/317] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:37 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:37.963974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05856fcd-2c59-480f-ae1c-b446ef4c3666 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:38.107284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05856fcd-2c59-480f-ae1c-b446ef4c3666 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:38.157897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13932ccc-c1ec-4a1a-9215-6f4c343b9626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:38.159722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932ccc-c1ec-4a1a-9215-6f4c343b9626 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:38.160299 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932ccc-c1ec-4a1a-9215-6f4c343b9626 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:38.160959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932ccc-c1ec-4a1a-9215-6f4c343b9626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:38.162329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13932ccc-c1ec-4a1a-9215-6f4c343b9626 None admin] RBAC: Adding query filter params (role.id=a88f94e8d7794f1b8513bad8de38ebb9, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5, user.id=45c1db09322242ca96953a1e517ccb9d) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:38.162975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13932ccc-c1ec-4a1a-9215-6f4c343b9626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:38.164897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13932ccc-c1ec-4a1a-9215-6f4c343b9626 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:38.177866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 163/318] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:27:37 2022] GET /identity/v3/role_assignments?user.id=45c1db09322242ca96953a1e517ccb9d&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=a88f94e8d7794f1b8513bad8de38ebb9 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:39.861985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693dcd8-0efb-4655-9cc5-f7d78ca519ba None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:39.862755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693dcd8-0efb-4655-9cc5-f7d78ca519ba None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:39.863143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693dcd8-0efb-4655-9cc5-f7d78ca519ba None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:39.867306 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 156/319] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:39.878071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d5d07-e4e7-4b03-b433-5827f5924203 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:39.878903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d5d07-e4e7-4b03-b433-5827f5924203 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:39.879053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d5d07-e4e7-4b03-b433-5827f5924203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:39.912650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-751d5d07-e4e7-4b03-b433-5827f5924203 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:39.914716 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-751d5d07-e4e7-4b03-b433-5827f5924203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:39.973297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:40.063593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 164/320] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:40.332186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e85a9-f215-42a4-a74e-5d199d91d790 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:40.332693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e85a9-f215-42a4-a74e-5d199d91d790 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:40.333186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e85a9-f215-42a4-a74e-5d199d91d790 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:40.336100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 157/321] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:40.345588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5f2d6-46b9-4fc1-bc17-e3c99506c480 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:40.356983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5f2d6-46b9-4fc1-bc17-e3c99506c480 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:40.356983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5f2d6-46b9-4fc1-bc17-e3c99506c480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:40.471410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-83d5f2d6-46b9-4fc1-bc17-e3c99506c480 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:40.473649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-83d5f2d6-46b9-4fc1-bc17-e3c99506c480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:40.512726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c128b-a030-4852-96f5-ef065a642a4e None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:40.513013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c128b-a030-4852-96f5-ef065a642a4e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:40.513330 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c128b-a030-4852-96f5-ef065a642a4e None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:40.515130 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 158/322] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:40.522143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f819e-51f2-4811-b74d-f4dd88ef9f47 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:40.522421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f819e-51f2-4811-b74d-f4dd88ef9f47 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:40.522701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f819e-51f2-4811-b74d-f4dd88ef9f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:40.545592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-d49f819e-51f2-4811-b74d-f4dd88ef9f47 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:40.547150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d49f819e-51f2-4811-b74d-f4dd88ef9f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:40.678652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:40.683632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 165/323] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:40.684248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5f2d6-46b9-4fc1-bc17-e3c99506c480 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:40.758964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 159/324] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:27:40.851353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:40.869341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5f2d6-46b9-4fc1-bc17-e3c99506c480 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:40.938813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53529471-6a74-4564-8c3d-d4a596d15d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:40.939816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529471-6a74-4564-8c3d-d4a596d15d85 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:40.940311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529471-6a74-4564-8c3d-d4a596d15d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:40.940835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53529471-6a74-4564-8c3d-d4a596d15d85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:40.942939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53529471-6a74-4564-8c3d-d4a596d15d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:40.946263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53529471-6a74-4564-8c3d-d4a596d15d85 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:40.950414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 166/325] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:27:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:40.959476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f819e-51f2-4811-b74d-f4dd88ef9f47 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:41.168376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f819e-51f2-4811-b74d-f4dd88ef9f47 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:41.177616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53529471-6a74-4564-8c3d-d4a596d15d85 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:41.250342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ccfd8-3cce-4ad0-ab8a-6671a863e43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:41.251387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ccfd8-3cce-4ad0-ab8a-6671a863e43e None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:41.251867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ccfd8-3cce-4ad0-ab8a-6671a863e43e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:41.252364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ccfd8-3cce-4ad0-ab8a-6671a863e43e None admin] PATH_INFO: `/v3/groups` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:41.253982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ccfd8-3cce-4ad0-ab8a-6671a863e43e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:41.257810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ccfd8-3cce-4ad0-ab8a-6671a863e43e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:41.330621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53529471-6a74-4564-8c3d-d4a596d15d85 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:41.374662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bd63c-20b7-480c-835a-49ed767eeede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:41.375390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bd63c-20b7-480c-835a-49ed767eeede None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:41.375712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bd63c-20b7-480c-835a-49ed767eeede None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:41.376066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bd63c-20b7-480c-835a-49ed767eeede None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:41.389259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bd63c-20b7-480c-835a-49ed767eeede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-864bd63c-20b7-480c-835a-49ed767eeede None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:41.395104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:41.396866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:41.397837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 167/326] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:41.399274 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bd63c-20b7-480c-835a-49ed767eeede None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:41.429854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:41.464275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 160/327] 10.222.0.83 () {60 vars in 1134 bytes} [Mon Aug 29 21:27:40 2022] POST /identity/v3/groups => generated 226 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:27:41.465840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ccfd8-3cce-4ad0-ab8a-6671a863e43e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:41.501803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:41.580516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bd63c-20b7-480c-835a-49ed767eeede None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:41.658734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c998ce-1646-4c35-813b-98540cab7b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:41.659867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c998ce-1646-4c35-813b-98540cab7b18 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:41.660365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c998ce-1646-4c35-813b-98540cab7b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:41.660912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c998ce-1646-4c35-813b-98540cab7b18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:41.665216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ccfd8-3cce-4ad0-ab8a-6671a863e43e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:41.683233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c998ce-1646-4c35-813b-98540cab7b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-19c998ce-1646-4c35-813b-98540cab7b18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:41.694445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:41.696770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:41.698293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 168/328] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:41.707147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c998ce-1646-4c35-813b-98540cab7b18 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:41.746449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a1f4b-378c-4c6c-813d-bddb95d432bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:41.747514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a1f4b-378c-4c6c-813d-bddb95d432bb None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:41.748023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a1f4b-378c-4c6c-813d-bddb95d432bb None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:41.749018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a1f4b-378c-4c6c-813d-bddb95d432bb None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:41.750369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a1f4b-378c-4c6c-813d-bddb95d432bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:41.750998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a1f4b-378c-4c6c-813d-bddb95d432bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:41.754330 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a1f4b-378c-4c6c-813d-bddb95d432bb None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:41.772557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 161/329] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:41.778893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a1f4b-378c-4c6c-813d-bddb95d432bb None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:41.882575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:41.921651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c998ce-1646-4c35-813b-98540cab7b18 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:41.933094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:41.957758 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a1f4b-378c-4c6c-813d-bddb95d432bb None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:42.007335 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b5966-e970-429a-b61d-eddb6c33c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:42.009003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a37f7c-cfc5-4952-ae15-de921e7396c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:42.009952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b5966-e970-429a-b61d-eddb6c33c320 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:42.010062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37f7c-cfc5-4952-ae15-de921e7396c6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:42.011655 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b5966-e970-429a-b61d-eddb6c33c320 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:42.011781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37f7c-cfc5-4952-ae15-de921e7396c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:42.011781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a37f7c-cfc5-4952-ae15-de921e7396c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:42.012261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a37f7c-cfc5-4952-ae15-de921e7396c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:42.012599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b5966-e970-429a-b61d-eddb6c33c320 None admin] PATH_INFO: `/v3/users/fb803c12f4614cbebbc85d288c1bb0ad` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:42.012802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a37f7c-cfc5-4952-ae15-de921e7396c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:42.014590 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b5966-e970-429a-b61d-eddb6c33c320 None admin] RBAC: Authorizing `identity:get_user(user_id=fb803c12f4614cbebbc85d288c1bb0ad)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:42.015514 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a37f7c-cfc5-4952-ae15-de921e7396c6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:42.017053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b5966-e970-429a-b61d-eddb6c33c320 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:42.019773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 162/330] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:41 2022] GET /identity/v3/users/fb803c12f4614cbebbc85d288c1bb0ad => generated 293 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:42.036543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b5966-e970-429a-b61d-eddb6c33c320 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:42.036805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 169/331] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:42.041699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a37f7c-cfc5-4952-ae15-de921e7396c6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:42.227558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a37f7c-cfc5-4952-ae15-de921e7396c6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:42.241576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b5966-e970-429a-b61d-eddb6c33c320 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:42.300307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166aed2b-2994-4c28-a08e-36021b007c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:42.300984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aed2b-2994-4c28-a08e-36021b007c42 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:42.301260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aed2b-2994-4c28-a08e-36021b007c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:42.304533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166aed2b-2994-4c28-a08e-36021b007c42 None admin] PATH_INFO: `/v3/system/users/fb803c12f4614cbebbc85d288c1bb0ad/roles/a88f94e8d7794f1b8513bad8de38ebb9` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:42.304533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166aed2b-2994-4c28-a08e-36021b007c42 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fb803c12f4614cbebbc85d288c1bb0ad, role_id=a88f94e8d7794f1b8513bad8de38ebb9)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:42.306094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166aed2b-2994-4c28-a08e-36021b007c42 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:42.322131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a73ddb-d530-4bc9-8716-3c3f28a4fc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:42.327151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a73ddb-d530-4bc9-8716-3c3f28a4fc40 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:42.327151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a73ddb-d530-4bc9-8716-3c3f28a4fc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:42.327151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a73ddb-d530-4bc9-8716-3c3f28a4fc40 None admin] PATH_INFO: `/v3/users/e29203af08094474a4a0756b1183cebb` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:42.327151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a73ddb-d530-4bc9-8716-3c3f28a4fc40 None admin] RBAC: Authorizing `identity:get_user(user_id=e29203af08094474a4a0756b1183cebb)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:42.329081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a73ddb-d530-4bc9-8716-3c3f28a4fc40 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:42.332823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 170/332] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:42 2022] GET /identity/v3/users/e29203af08094474a4a0756b1183cebb => generated 293 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:42.340160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a73ddb-d530-4bc9-8716-3c3f28a4fc40 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:42.361752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:42.395696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 163/333] 10.222.0.83 () {58 vars in 1334 bytes} [Mon Aug 29 21:27:42 2022] PUT /identity/v3/system/users/fb803c12f4614cbebbc85d288c1bb0ad/roles/a88f94e8d7794f1b8513bad8de38ebb9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:27:42.564680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a73ddb-d530-4bc9-8716-3c3f28a4fc40 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:42.636536 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663a1aa-1b79-41fb-a4f3-4a2c0bb76cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:42.637568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663a1aa-1b79-41fb-a4f3-4a2c0bb76cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:42.638054 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663a1aa-1b79-41fb-a4f3-4a2c0bb76cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:42.638541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663a1aa-1b79-41fb-a4f3-4a2c0bb76cc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:42.639971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663a1aa-1b79-41fb-a4f3-4a2c0bb76cc1 None admin] RBAC: Adding query filter params (role.id=23bfcdf883144a0b8740e12c6a6de7e3, user.id=e29203af08094474a4a0756b1183cebb, scope.system=all) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:42.642336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663a1aa-1b79-41fb-a4f3-4a2c0bb76cc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:42.643643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663a1aa-1b79-41fb-a4f3-4a2c0bb76cc1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:42.665558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 171/334] 10.222.0.83 () {56 vars in 1308 bytes} [Mon Aug 29 21:27:42 2022] GET /identity/v3/role_assignments?user.id=e29203af08094474a4a0756b1183cebb&scope.system=all&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 510 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:44.725139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387607e-1511-4a71-9f80-b349edae28e8 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:44.726228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387607e-1511-4a71-9f80-b349edae28e8 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:44.726708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387607e-1511-4a71-9f80-b349edae28e8 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:44.729609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 164/335] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:44.736540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ab0ed-658c-4c19-b6ac-1d31e6a9a8d7 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:44.737626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ab0ed-658c-4c19-b6ac-1d31e6a9a8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:44.738217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ab0ed-658c-4c19-b6ac-1d31e6a9a8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:44.762528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-010ab0ed-658c-4c19-b6ac-1d31e6a9a8d7 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:44.764205 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-010ab0ed-658c-4c19-b6ac-1d31e6a9a8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:44.863751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:44.872405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 172/336] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:27:45.911086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387607e-1511-4a71-9f80-b349edae28e8 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:45.949333 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:46.177115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387607e-1511-4a71-9f80-b349edae28e8 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:46.263800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d881-22e4-4d76-8d78-28d1e9079d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:46.264474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d881-22e4-4d76-8d78-28d1e9079d9c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.264769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d881-22e4-4d76-8d78-28d1e9079d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.265062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e271d881-22e4-4d76-8d78-28d1e9079d9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.284342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e271d881-22e4-4d76-8d78-28d1e9079d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-e271d881-22e4-4d76-8d78-28d1e9079d9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:46.290920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:46.292672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:46.294229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 165/337] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:27:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:46.301940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ab0ed-658c-4c19-b6ac-1d31e6a9a8d7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:46.487746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ab0ed-658c-4c19-b6ac-1d31e6a9a8d7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:46.541430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa9145-2037-41f8-b920-da90d4f771dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:46.542115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa9145-2037-41f8-b920-da90d4f771dd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.542397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa9145-2037-41f8-b920-da90d4f771dd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.542675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa9145-2037-41f8-b920-da90d4f771dd None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.543576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa9145-2037-41f8-b920-da90d4f771dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:46.543883 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa9145-2037-41f8-b920-da90d4f771dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:46.545433 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa9145-2037-41f8-b920-da90d4f771dd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:46.555282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 173/338] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:46.563862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d881-22e4-4d76-8d78-28d1e9079d9c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:46.625067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb5e50-f397-4376-ac7e-d4080cff10f8 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.625517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb5e50-f397-4376-ac7e-d4080cff10f8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.625768 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb5e50-f397-4376-ac7e-d4080cff10f8 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.627350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 174/339] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:46.644922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93a314-464f-45f1-bb7f-d47ed4bca236 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.645312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93a314-464f-45f1-bb7f-d47ed4bca236 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.646721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93a314-464f-45f1-bb7f-d47ed4bca236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.703747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-aa93a314-464f-45f1-bb7f-d47ed4bca236 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:46.705795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-aa93a314-464f-45f1-bb7f-d47ed4bca236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:46.720321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:46.779558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e271d881-22e4-4d76-8d78-28d1e9079d9c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:46.866653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:46.879388 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020323f9-ece2-4254-a3fa-434d0e69fbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:46.880190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020323f9-ece2-4254-a3fa-434d0e69fbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.880506 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020323f9-ece2-4254-a3fa-434d0e69fbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.880812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020323f9-ece2-4254-a3fa-434d0e69fbd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.902193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 175/340] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:27:46.903922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf16171-8081-4b7b-be1a-65ab22c8d3ce None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.904597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf16171-8081-4b7b-be1a-65ab22c8d3ce None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.904949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf16171-8081-4b7b-be1a-65ab22c8d3ce None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.906869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 176/341] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:46.913805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809d513-c092-44c7-8f89-da4acc2564a3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:46.914278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809d513-c092-44c7-8f89-da4acc2564a3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:46.915252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809d513-c092-44c7-8f89-da4acc2564a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:46.950003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f809d513-c092-44c7-8f89-da4acc2564a3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:46.951703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f809d513-c092-44c7-8f89-da4acc2564a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:47.050515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 177/342] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:47.052410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd9dd8-57e3-4045-aba3-05c812b39566 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:47.053015 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd9dd8-57e3-4045-aba3-05c812b39566 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:47.053511 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd9dd8-57e3-4045-aba3-05c812b39566 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:47.055819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 178/343] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:47.067268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12de39-ff01-474c-878f-c8937643fc8a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:47.068412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12de39-ff01-474c-878f-c8937643fc8a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:47.068880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12de39-ff01-474c-878f-c8937643fc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:47.099672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0f12de39-ff01-474c-878f-c8937643fc8a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:47.101366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0f12de39-ff01-474c-878f-c8937643fc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:47.140860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020323f9-ece2-4254-a3fa-434d0e69fbd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:47.143664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020323f9-ece2-4254-a3fa-434d0e69fbd3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:47.226327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 179/344] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:27:47.304596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:47.370416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 166/345] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:47.379244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12de39-ff01-474c-878f-c8937643fc8a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:47.417137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020ce7-fcb3-420c-97ac-38eede035881 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:47.417608 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020ce7-fcb3-420c-97ac-38eede035881 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:47.418056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce020ce7-fcb3-420c-97ac-38eede035881 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:47.425165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 167/346] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:47.439288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ba4eb-6c22-41d3-bc5e-55633d9b6f02 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:47.440113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ba4eb-6c22-41d3-bc5e-55633d9b6f02 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:47.440879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ba4eb-6c22-41d3-bc5e-55633d9b6f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:47.467484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:47.499154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c60ba4eb-6c22-41d3-bc5e-55633d9b6f02 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:47.501856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c60ba4eb-6c22-41d3-bc5e-55633d9b6f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:47.530244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12de39-ff01-474c-878f-c8937643fc8a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:47.577386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33623684-efd9-4358-89ff-c99d043fc1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:47.578235 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33623684-efd9-4358-89ff-c99d043fc1cf None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:47.578524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33623684-efd9-4358-89ff-c99d043fc1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:47.578877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33623684-efd9-4358-89ff-c99d043fc1cf None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:47.580438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33623684-efd9-4358-89ff-c99d043fc1cf None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:47.582247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33623684-efd9-4358-89ff-c99d043fc1cf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:47.584451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 180/347] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:47 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:47.585300 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33623684-efd9-4358-89ff-c99d043fc1cf None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:47.673185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 168/348] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 21:27:47.675730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe1575-514b-44b8-8842-96920377d428 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:47.677289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe1575-514b-44b8-8842-96920377d428 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:47.678142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe1575-514b-44b8-8842-96920377d428 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:47.680878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 169/349] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:47.688588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe1575-514b-44b8-8842-96920377d428 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:47.747574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33623684-efd9-4358-89ff-c99d043fc1cf None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:47.786704 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:47.828252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb52d6-561e-49b1-8c2d-bb13d6f565c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:47.829228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb52d6-561e-49b1-8c2d-bb13d6f565c8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:47.829656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb52d6-561e-49b1-8c2d-bb13d6f565c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:47.830108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb52d6-561e-49b1-8c2d-bb13d6f565c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:47.857458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb52d6-561e-49b1-8c2d-bb13d6f565c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:47.866678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe1575-514b-44b8-8842-96920377d428 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a2fb52d6-561e-49b1-8c2d-bb13d6f565c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:47.866898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:47.867789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:47.868645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:47.869297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:47.870255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 181/350] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:47.873743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e8b25-5e6c-4af8-8e00-d043ee06f0b5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:47.874370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e8b25-5e6c-4af8-8e00-d043ee06f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:47.874861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e8b25-5e6c-4af8-8e00-d043ee06f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:47.898697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-026e8b25-5e6c-4af8-8e00-d043ee06f0b5 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:47.901003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-026e8b25-5e6c-4af8-8e00-d043ee06f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:47.941266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc0957-c515-40da-b38b-c649a7ae9674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:47.942538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc0957-c515-40da-b38b-c649a7ae9674 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:47.944527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc0957-c515-40da-b38b-c649a7ae9674 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:47.945379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc0957-c515-40da-b38b-c649a7ae9674 None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:47.957746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc0957-c515-40da-b38b-c649a7ae9674 None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:47.960989 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc0957-c515-40da-b38b-c649a7ae9674 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:47.964726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 170/351] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:27:47 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:47.966585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc0957-c515-40da-b38b-c649a7ae9674 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:48.027539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 182/352] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:48.030041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e8b25-5e6c-4af8-8e00-d043ee06f0b5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:48.188750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc0957-c515-40da-b38b-c649a7ae9674 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:48.255818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e8b25-5e6c-4af8-8e00-d043ee06f0b5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:48.265297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ef849-10d5-4167-be31-cf4413ba2a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:48.266037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ef849-10d5-4167-be31-cf4413ba2a13 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:48.266355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ef849-10d5-4167-be31-cf4413ba2a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:48.266634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ef849-10d5-4167-be31-cf4413ba2a13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:48.276579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:48.298593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ef849-10d5-4167-be31-cf4413ba2a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-726ef849-10d5-4167-be31-cf4413ba2a13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:48.311041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:48.312966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 21:27:48.314632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:48.319716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 171/353] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:48.319716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ef849-10d5-4167-be31-cf4413ba2a13 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:48.326752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7940aa2-f856-4382-b833-6ed50d6a6c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:48.329490 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7940aa2-f856-4382-b833-6ed50d6a6c96 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:48.329490 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7940aa2-f856-4382-b833-6ed50d6a6c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:48.329490 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7940aa2-f856-4382-b833-6ed50d6a6c96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:48.355625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7940aa2-f856-4382-b833-6ed50d6a6c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-c7940aa2-f856-4382-b833-6ed50d6a6c96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:48.366452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:48.367526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:48.368986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:48.370310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 183/354] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:48.371252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7940aa2-f856-4382-b833-6ed50d6a6c96 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:48.380982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:48.521760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ef849-10d5-4167-be31-cf4413ba2a13 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:48.538957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7940aa2-f856-4382-b833-6ed50d6a6c96 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:48.587100 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16bd24-acaf-4d05-8412-70ee6118b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:48.587780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16bd24-acaf-4d05-8412-70ee6118b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:48.588085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16bd24-acaf-4d05-8412-70ee6118b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:48.588374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16bd24-acaf-4d05-8412-70ee6118b0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:48.589200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16bd24-acaf-4d05-8412-70ee6118b0a2 None admin] RBAC: Adding query filter params (group.id=c5598164e722452c8998b8100b53c83b, role.id=971e130ba91d4b7ab75b8e33d322760b, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:48.591758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16bd24-acaf-4d05-8412-70ee6118b0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:48.591916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f03e6-990f-4645-adda-58be15f91260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:48.592011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16bd24-acaf-4d05-8412-70ee6118b0a2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:48.592087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f03e6-990f-4645-adda-58be15f91260 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:48.592309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f03e6-990f-4645-adda-58be15f91260 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:48.592838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f03e6-990f-4645-adda-58be15f91260 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:48.594932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f03e6-990f-4645-adda-58be15f91260 None admin] RBAC: Adding query filter params (name=member) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:48.594932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f03e6-990f-4645-adda-58be15f91260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:48.598493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 184/355] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 21:27:48 2022] GET /identity/v3/role_assignments?group.id=c5598164e722452c8998b8100b53c83b&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=971e130ba91d4b7ab75b8e33d322760b => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:48.599637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16bd24-acaf-4d05-8412-70ee6118b0a2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:48.600095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f03e6-990f-4645-adda-58be15f91260 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:48.626176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 172/356] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:48.627176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f03e6-990f-4645-adda-58be15f91260 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:48.664082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:48.800705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:48.824630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16bd24-acaf-4d05-8412-70ee6118b0a2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:48.889263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f03e6-990f-4645-adda-58be15f91260 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:48.889463 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75b8a7-4ba6-48ba-b1a9-2b87fbb4a5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:48.889600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4384-30c3-4806-930c-7ece12e003b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:48.889730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75b8a7-4ba6-48ba-b1a9-2b87fbb4a5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:48.889730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75b8a7-4ba6-48ba-b1a9-2b87fbb4a5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:48.889956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4384-30c3-4806-930c-7ece12e003b6 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:48.890072 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75b8a7-4ba6-48ba-b1a9-2b87fbb4a5c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:48.890180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4384-30c3-4806-930c-7ece12e003b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:48.890180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e4384-30c3-4806-930c-7ece12e003b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:48.909564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75b8a7-4ba6-48ba-b1a9-2b87fbb4a5c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:48.912291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e4384-30c3-4806-930c-7ece12e003b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-cf75b8a7-4ba6-48ba-b1a9-2b87fbb4a5c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:48.916707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:48.918257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 185/357] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:48.919868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75b8a7-4ba6-48ba-b1a9-2b87fbb4a5c2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-db2e4384-30c3-4806-930c-7ece12e003b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:48.929159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:48.932323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 173/358] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:27:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:48.942191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4384-30c3-4806-930c-7ece12e003b6 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:49.070436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:49.083936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75b8a7-4ba6-48ba-b1a9-2b87fbb4a5c2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:49.141966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d612f2-3097-4c49-868b-92cecad372df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:49.142656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d612f2-3097-4c49-868b-92cecad372df None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:49.142938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d612f2-3097-4c49-868b-92cecad372df None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:49.143216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d612f2-3097-4c49-868b-92cecad372df None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:49.145015 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d612f2-3097-4c49-868b-92cecad372df None admin] RBAC: Adding query filter params (name=reader) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:49.145281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d612f2-3097-4c49-868b-92cecad372df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:49.146949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d612f2-3097-4c49-868b-92cecad372df None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:49.148460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e4384-30c3-4806-930c-7ece12e003b6 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:49.158995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 186/359] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:49.161141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d612f2-3097-4c49-868b-92cecad372df None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:49.234994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841ae93-8210-47a3-811b-177ec5d09b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:49.235781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841ae93-8210-47a3-811b-177ec5d09b99 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:49.235952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841ae93-8210-47a3-811b-177ec5d09b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:49.236325 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841ae93-8210-47a3-811b-177ec5d09b99 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:49.237017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841ae93-8210-47a3-811b-177ec5d09b99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:49.237347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841ae93-8210-47a3-811b-177ec5d09b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:49.238965 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841ae93-8210-47a3-811b-177ec5d09b99 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:49.260510 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 174/360] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:49.262562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841ae93-8210-47a3-811b-177ec5d09b99 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:49.288464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:49.350464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d612f2-3097-4c49-868b-92cecad372df None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:49.445764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dd9f6-2068-4856-aa51-fc1c373b8ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:49.447420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd9f6-2068-4856-aa51-fc1c373b8ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:49.448221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd9f6-2068-4856-aa51-fc1c373b8ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:49.449005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dd9f6-2068-4856-aa51-fc1c373b8ba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:49.506956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:49.509180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841ae93-8210-47a3-811b-177ec5d09b99 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:49.588925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f368b-44ed-4465-901c-11d6caab2f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:49.590535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f368b-44ed-4465-901c-11d6caab2f8a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:49.591202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f368b-44ed-4465-901c-11d6caab2f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:49.591846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f368b-44ed-4465-901c-11d6caab2f8a None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:49.593197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f368b-44ed-4465-901c-11d6caab2f8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:49.593746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f368b-44ed-4465-901c-11d6caab2f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:49.596704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f368b-44ed-4465-901c-11d6caab2f8a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:49.604640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dd9f6-2068-4856-aa51-fc1c373b8ba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:49.608562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dd9f6-2068-4856-aa51-fc1c373b8ba1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:49.614745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 175/361] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:49.615867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f368b-44ed-4465-901c-11d6caab2f8a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:49.751164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:49.815344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f368b-44ed-4465-901c-11d6caab2f8a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:49.832156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 187/362] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:49.833699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dd9f6-2068-4856-aa51-fc1c373b8ba1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:49.880535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c208f-332a-48ba-b0c7-63860eaf8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:49.881300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c208f-332a-48ba-b0c7-63860eaf8101 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:49.881741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c208f-332a-48ba-b0c7-63860eaf8101 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:49.882207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c208f-332a-48ba-b0c7-63860eaf8101 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:49.883488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c208f-332a-48ba-b0c7-63860eaf8101 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:49.884667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c208f-332a-48ba-b0c7-63860eaf8101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:49.887618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c208f-332a-48ba-b0c7-63860eaf8101 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:49.902796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 176/363] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:49.904163 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c208f-332a-48ba-b0c7-63860eaf8101 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:49.922150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:50.033935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dd9f6-2068-4856-aa51-fc1c373b8ba1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:50.097439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c38b-f7bd-4fb6-9f29-c0f38b5cd261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:50.098530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c38b-f7bd-4fb6-9f29-c0f38b5cd261 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:50.099035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c38b-f7bd-4fb6-9f29-c0f38b5cd261 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:50.099532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c38b-f7bd-4fb6-9f29-c0f38b5cd261 None admin] PATH_INFO: `/v3/users/fb803c12f4614cbebbc85d288c1bb0ad` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:50.101569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c38b-f7bd-4fb6-9f29-c0f38b5cd261 None admin] RBAC: Authorizing `identity:get_user(user_id=fb803c12f4614cbebbc85d288c1bb0ad)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:50.103944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c38b-f7bd-4fb6-9f29-c0f38b5cd261 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:50.107037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 188/364] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:27:49 2022] GET /identity/v3/users/fb803c12f4614cbebbc85d288c1bb0ad => generated 293 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:50.107183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c208f-332a-48ba-b0c7-63860eaf8101 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:50.108045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c38b-f7bd-4fb6-9f29-c0f38b5cd261 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:50.177649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef860f-e31a-4cdb-a798-a6f4d413aaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:50.178607 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef860f-e31a-4cdb-a798-a6f4d413aaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:50.179110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef860f-e31a-4cdb-a798-a6f4d413aaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:50.179605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef860f-e31a-4cdb-a798-a6f4d413aaa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:50.185264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:50.315386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c38b-f7bd-4fb6-9f29-c0f38b5cd261 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:50.325803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef860f-e31a-4cdb-a798-a6f4d413aaa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:50.328179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef860f-e31a-4cdb-a798-a6f4d413aaa6 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:50.362603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:50.386543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a1097-6d46-40e3-9228-289114b54c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:50.387579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a1097-6d46-40e3-9228-289114b54c80 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:50.388055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a1097-6d46-40e3-9228-289114b54c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:50.388792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a1097-6d46-40e3-9228-289114b54c80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:50.533710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a1097-6d46-40e3-9228-289114b54c80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:50.536416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a1097-6d46-40e3-9228-289114b54c80 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:50.556398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 177/365] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:50.557994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef860f-e31a-4cdb-a798-a6f4d413aaa6 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:50.626165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:50.756573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 189/366] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:50.756573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a1097-6d46-40e3-9228-289114b54c80 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:50.775469 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef860f-e31a-4cdb-a798-a6f4d413aaa6 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:50.809242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:50.846841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0910286-35c3-4487-b858-4a3c5303e75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:50.847931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0910286-35c3-4487-b858-4a3c5303e75b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:50.848428 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0910286-35c3-4487-b858-4a3c5303e75b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:50.848936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0910286-35c3-4487-b858-4a3c5303e75b None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:50.850964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0910286-35c3-4487-b858-4a3c5303e75b None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:50.853830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0910286-35c3-4487-b858-4a3c5303e75b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:50.857064 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 178/367] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:50 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:50.858501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0910286-35c3-4487-b858-4a3c5303e75b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:50.972052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a1097-6d46-40e3-9228-289114b54c80 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:51.053180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f862c83-c4c1-42fe-98ef-5a3d54428981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:51.054230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862c83-c4c1-42fe-98ef-5a3d54428981 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.054729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862c83-c4c1-42fe-98ef-5a3d54428981 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.055193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f862c83-c4c1-42fe-98ef-5a3d54428981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.076206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0910286-35c3-4487-b858-4a3c5303e75b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:51.079537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:51.143010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9aac1c-a791-47f6-a117-7d3138632788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:51.144053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9aac1c-a791-47f6-a117-7d3138632788 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.144562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9aac1c-a791-47f6-a117-7d3138632788 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.145055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9aac1c-a791-47f6-a117-7d3138632788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.146481 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9aac1c-a791-47f6-a117-7d3138632788 None admin] RBAC: Adding query filter params (role.id=a88f94e8d7794f1b8513bad8de38ebb9, user.id=fb803c12f4614cbebbc85d288c1bb0ad, scope.system=all) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:51.147012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9aac1c-a791-47f6-a117-7d3138632788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:51.149944 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9aac1c-a791-47f6-a117-7d3138632788 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:51.168242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f862c83-c4c1-42fe-98ef-5a3d54428981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:51.170045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f862c83-c4c1-42fe-98ef-5a3d54428981 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:51.184522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 179/368] 10.222.0.83 () {56 vars in 1308 bytes} [Mon Aug 29 21:27:50 2022] GET /identity/v3/role_assignments?user.id=fb803c12f4614cbebbc85d288c1bb0ad&scope.system=all&role.id=a88f94e8d7794f1b8513bad8de38ebb9 => generated 510 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:51.184522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9aac1c-a791-47f6-a117-7d3138632788 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:51.201338 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:51.325261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 190/369] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:27:51.326795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f862c83-c4c1-42fe-98ef-5a3d54428981 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:51.395940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9aac1c-a791-47f6-a117-7d3138632788 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:51.444923 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af1580-1aac-4e9d-8d89-9aed17a82371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:51.447124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af1580-1aac-4e9d-8d89-9aed17a82371 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.447500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af1580-1aac-4e9d-8d89-9aed17a82371 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.447864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af1580-1aac-4e9d-8d89-9aed17a82371 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.449376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af1580-1aac-4e9d-8d89-9aed17a82371 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:51.451421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af1580-1aac-4e9d-8d89-9aed17a82371 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:51.454287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 180/370] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:51 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:51.458383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af1580-1aac-4e9d-8d89-9aed17a82371 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:51.502223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:51.519441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f862c83-c4c1-42fe-98ef-5a3d54428981 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:51.554860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:51.575438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5278a89-1cc2-4eda-b0ba-6a79d07f8822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:51.575438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5278a89-1cc2-4eda-b0ba-6a79d07f8822 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.575848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5278a89-1cc2-4eda-b0ba-6a79d07f8822 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.575978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5278a89-1cc2-4eda-b0ba-6a79d07f8822 None admin] PATH_INFO: `/v3/projects/f1c71f7fdbf248fba40d8efd925d9546` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.579143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5278a89-1cc2-4eda-b0ba-6a79d07f8822 None admin] RBAC: Authorizing `identity:get_project(project_id=f1c71f7fdbf248fba40d8efd925d9546)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:51.579143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5278a89-1cc2-4eda-b0ba-6a79d07f8822 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:51.582254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 191/371] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:51 2022] GET /identity/v3/projects/f1c71f7fdbf248fba40d8efd925d9546 => generated 344 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:51.582878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404818bb-a0f4-446e-9d35-493863644995 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.583155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404818bb-a0f4-446e-9d35-493863644995 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.583427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404818bb-a0f4-446e-9d35-493863644995 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.592058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 192/372] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:51.592058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404818bb-a0f4-446e-9d35-493863644995 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:51.630930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af1580-1aac-4e9d-8d89-9aed17a82371 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:51.693216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7ed7e-27d7-4620-ae2e-08031b76e8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:51.694184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7ed7e-27d7-4620-ae2e-08031b76e8ed None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.694706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7ed7e-27d7-4620-ae2e-08031b76e8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.695152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7ed7e-27d7-4620-ae2e-08031b76e8ed None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.697748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7ed7e-27d7-4620-ae2e-08031b76e8ed None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:51.700118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7ed7e-27d7-4620-ae2e-08031b76e8ed None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:51.702675 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 181/373] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:27:51 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:51.710973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7ed7e-27d7-4620-ae2e-08031b76e8ed None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:51.748455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404818bb-a0f4-446e-9d35-493863644995 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:51.793568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847daa4-9e09-415f-936a-c636be724fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:51.794568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847daa4-9e09-415f-936a-c636be724fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.794957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847daa4-9e09-415f-936a-c636be724fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.795335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847daa4-9e09-415f-936a-c636be724fb4 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.796728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847daa4-9e09-415f-936a-c636be724fb4 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:51.798380 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847daa4-9e09-415f-936a-c636be724fb4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:51.800312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 193/374] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:51 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:51.801799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05e152-3453-4b42-b174-a3771008aa00 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.802440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05e152-3453-4b42-b174-a3771008aa00 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.802737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05e152-3453-4b42-b174-a3771008aa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.824168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fc05e152-3453-4b42-b174-a3771008aa00 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:51.825669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fc05e152-3453-4b42-b174-a3771008aa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:51.835229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:51.844392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7ed7e-27d7-4620-ae2e-08031b76e8ed None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:51.893903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:51.899294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e1f45-cb50-4b02-9382-f016b3dca81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:51.900367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e1f45-cb50-4b02-9382-f016b3dca81a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:51.900903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e1f45-cb50-4b02-9382-f016b3dca81a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:51.901378 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e1f45-cb50-4b02-9382-f016b3dca81a None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:51.903429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e1f45-cb50-4b02-9382-f016b3dca81a None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:51.906184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e1f45-cb50-4b02-9382-f016b3dca81a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:51.908603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 194/375] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:51.909475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05e152-3453-4b42-b174-a3771008aa00 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:51.918353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 182/376] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:27:51 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:51.918353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e1f45-cb50-4b02-9382-f016b3dca81a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:52.075230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e1f45-cb50-4b02-9382-f016b3dca81a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:52.081266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05e152-3453-4b42-b174-a3771008aa00 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:52.127483 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231bb5c-1926-481e-901f-d389428ef0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:52.128023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bb5c-1926-481e-901f-d389428ef0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:52.128277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bb5c-1926-481e-901f-d389428ef0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:52.128552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bb5c-1926-481e-901f-d389428ef0f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:52.129301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231bb5c-1926-481e-901f-d389428ef0f3 None admin] RBAC: Adding query filter params (group.id=c5598164e722452c8998b8100b53c83b, role.id=23bfcdf883144a0b8740e12c6a6de7e3, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:52.129593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231bb5c-1926-481e-901f-d389428ef0f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:52.130630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3510ca-ffca-4340-be91-8cc226aea10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:52.131069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231bb5c-1926-481e-901f-d389428ef0f3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:52.131318 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3510ca-ffca-4340-be91-8cc226aea10a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:52.131609 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3510ca-ffca-4340-be91-8cc226aea10a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:52.131887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3510ca-ffca-4340-be91-8cc226aea10a None admin] PATH_INFO: `/v3/groups/60caf814f4e44c5bbd0a6d3f5543905c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:52.149148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 183/377] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 21:27:51 2022] GET /identity/v3/role_assignments?group.id=c5598164e722452c8998b8100b53c83b&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:52.149148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231bb5c-1926-481e-901f-d389428ef0f3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:52.149740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3510ca-ffca-4340-be91-8cc226aea10a None admin] RBAC: Authorizing `identity:get_group(group_id=60caf814f4e44c5bbd0a6d3f5543905c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:52.151242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3510ca-ffca-4340-be91-8cc226aea10a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:52.153973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 195/378] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:27:51 2022] GET /identity/v3/groups/60caf814f4e44c5bbd0a6d3f5543905c => generated 229 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:52.154599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3510ca-ffca-4340-be91-8cc226aea10a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:52.194478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:52.250315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:52.312526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231bb5c-1926-481e-901f-d389428ef0f3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:52.350425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3510ca-ffca-4340-be91-8cc226aea10a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:52.373163 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacffd4-b700-4531-964a-d0057ac966e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:52.374474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacffd4-b700-4531-964a-d0057ac966e4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:52.375081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacffd4-b700-4531-964a-d0057ac966e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:52.375678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cacffd4-b700-4531-964a-d0057ac966e4 None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:52.379349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacffd4-b700-4531-964a-d0057ac966e4 None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:52.384527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cacffd4-b700-4531-964a-d0057ac966e4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:52.389139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 184/379] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:27:52 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:52.390634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacffd4-b700-4531-964a-d0057ac966e4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:52.401516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb0b79-356f-411e-817c-2ff667db7bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:52.402141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb0b79-356f-411e-817c-2ff667db7bde None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:52.402503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb0b79-356f-411e-817c-2ff667db7bde None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:52.402774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb0b79-356f-411e-817c-2ff667db7bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:52.403513 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb0b79-356f-411e-817c-2ff667db7bde None admin] RBAC: Adding query filter params (group.id=c5598164e722452c8998b8100b53c83b, role.id=23bfcdf883144a0b8740e12c6a6de7e3, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:52.403819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb0b79-356f-411e-817c-2ff667db7bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:52.405470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb0b79-356f-411e-817c-2ff667db7bde None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:52.412450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 196/380] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 21:27:52 2022] GET /identity/v3/role_assignments?group.id=c5598164e722452c8998b8100b53c83b&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 260 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:52.413357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb0b79-356f-411e-817c-2ff667db7bde None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:52.609149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:52.613289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb0b79-356f-411e-817c-2ff667db7bde None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:52.624622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cacffd4-b700-4531-964a-d0057ac966e4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:52.657134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:52.699759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19b2e-2cd9-4138-8a64-52f7a078559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:52.700609 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19b2e-2cd9-4138-8a64-52f7a078559e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:52.701204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19b2e-2cd9-4138-8a64-52f7a078559e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:52.701781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c19b2e-2cd9-4138-8a64-52f7a078559e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:52.703632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c19b2e-2cd9-4138-8a64-52f7a078559e None admin] RBAC: Adding query filter params (group.id=c5598164e722452c8998b8100b53c83b, role.id=971e130ba91d4b7ab75b8e33d322760b, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:52.706379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c19b2e-2cd9-4138-8a64-52f7a078559e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:52.707090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c19b2e-2cd9-4138-8a64-52f7a078559e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:52.713861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4017-d947-45f8-9bc1-06e131feff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:52.715414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4017-d947-45f8-9bc1-06e131feff4a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:52.715969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4017-d947-45f8-9bc1-06e131feff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:52.716572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc4017-d947-45f8-9bc1-06e131feff4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:52.718062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc4017-d947-45f8-9bc1-06e131feff4a None admin] RBAC: Adding query filter params (group.id=60caf814f4e44c5bbd0a6d3f5543905c, role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=f1c71f7fdbf248fba40d8efd925d9546) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:52.718576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 197/381] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 21:27:52 2022] GET /identity/v3/role_assignments?group.id=c5598164e722452c8998b8100b53c83b&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=971e130ba91d4b7ab75b8e33d322760b => generated 260 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:52.718686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc4017-d947-45f8-9bc1-06e131feff4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:52.719865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19b2e-2cd9-4138-8a64-52f7a078559e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:52.721777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc4017-d947-45f8-9bc1-06e131feff4a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:52.736821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 185/382] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 21:27:52 2022] GET /identity/v3/role_assignments?group.id=60caf814f4e44c5bbd0a6d3f5543905c&scope.project.id=f1c71f7fdbf248fba40d8efd925d9546&role.id=c0316e22a13a4034846c451753b4c14e => generated 260 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:52.958872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c19b2e-2cd9-4138-8a64-52f7a078559e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:53.044155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c056fbe-3ec3-4ca5-9f1a-57ccb69adf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:53.045513 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c056fbe-3ec3-4ca5-9f1a-57ccb69adf24 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:53.046036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c056fbe-3ec3-4ca5-9f1a-57ccb69adf24 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:53.046510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c056fbe-3ec3-4ca5-9f1a-57ccb69adf24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:53.077261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c056fbe-3ec3-4ca5-9f1a-57ccb69adf24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1c056fbe-3ec3-4ca5-9f1a-57ccb69adf24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:53.094500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:53.095473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:53.096272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:53.097511 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 198/383] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:27:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:53.107840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4017-d947-45f8-9bc1-06e131feff4a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:53.292330 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc4017-d947-45f8-9bc1-06e131feff4a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:53.377615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59cc9f-9682-48fa-83ba-5d39cfb73127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:53.378692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59cc9f-9682-48fa-83ba-5d39cfb73127 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:53.379188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59cc9f-9682-48fa-83ba-5d39cfb73127 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:53.379664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59cc9f-9682-48fa-83ba-5d39cfb73127 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:53.380850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59cc9f-9682-48fa-83ba-5d39cfb73127 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:53.381343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59cc9f-9682-48fa-83ba-5d39cfb73127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:53.384011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59cc9f-9682-48fa-83ba-5d39cfb73127 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:53.400403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 186/384] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:53.406677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c056fbe-3ec3-4ca5-9f1a-57ccb69adf24 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:53.467993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:53.547324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c056fbe-3ec3-4ca5-9f1a-57ccb69adf24 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:53.595965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0d7cb-ca35-486d-9e09-5cd9165c3d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:53.596659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0d7cb-ca35-486d-9e09-5cd9165c3d05 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:53.596920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0d7cb-ca35-486d-9e09-5cd9165c3d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:53.597181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0d7cb-ca35-486d-9e09-5cd9165c3d05 None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:53.598402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0d7cb-ca35-486d-9e09-5cd9165c3d05 None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:53.599877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0d7cb-ca35-486d-9e09-5cd9165c3d05 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:53.601990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 199/385] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:27:53 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:53.609646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59cc9f-9682-48fa-83ba-5d39cfb73127 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:53.690166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:53.827799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59cc9f-9682-48fa-83ba-5d39cfb73127 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:53.890612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ce6dc-9c08-4c14-9bfc-e9e33f2c1375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:53.891690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ce6dc-9c08-4c14-9bfc-e9e33f2c1375 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:53.892180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ce6dc-9c08-4c14-9bfc-e9e33f2c1375 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:53.892701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ce6dc-9c08-4c14-9bfc-e9e33f2c1375 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:53.894693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ce6dc-9c08-4c14-9bfc-e9e33f2c1375 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:53.897433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ce6dc-9c08-4c14-9bfc-e9e33f2c1375 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:53.901604 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 187/386] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:53 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:53.909617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0d7cb-ca35-486d-9e09-5cd9165c3d05 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:54.100405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0d7cb-ca35-486d-9e09-5cd9165c3d05 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:54.124999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:54.186394 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7b2ff7-5eb3-45d1-bd73-b64f79f56ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:54.187573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b2ff7-5eb3-45d1-bd73-b64f79f56ccf None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:54.188043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b2ff7-5eb3-45d1-bd73-b64f79f56ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:54.188501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7b2ff7-5eb3-45d1-bd73-b64f79f56ccf None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/groups/c5598164e722452c8998b8100b53c83b/roles/971e130ba91d4b7ab75b8e33d322760b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:54.195643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b2ff7-5eb3-45d1-bd73-b64f79f56ccf None admin] RBAC: Authorizing `identity:create_grant(project_id=87dc8cdee5be43449bfb5448b4d713cc, group_id=c5598164e722452c8998b8100b53c83b, role_id=971e130ba91d4b7ab75b8e33d322760b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:54.204860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7b2ff7-5eb3-45d1-bd73-b64f79f56ccf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:54.384222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 200/387] 10.222.0.83 () {58 vars in 1442 bytes} [Mon Aug 29 21:27:53 2022] PUT /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/groups/c5598164e722452c8998b8100b53c83b/roles/971e130ba91d4b7ab75b8e33d322760b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:55.396802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c61ee-2431-4365-93fd-0c75c02f060f None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:55.397722 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c61ee-2431-4365-93fd-0c75c02f060f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:55.397722 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c61ee-2431-4365-93fd-0c75c02f060f None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:55.400610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 188/388] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:55.407180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c40fee-7ff9-43f9-a4f8-65a551debe4f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:55.407924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c40fee-7ff9-43f9-a4f8-65a551debe4f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:55.407924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c40fee-7ff9-43f9-a4f8-65a551debe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:55.444321 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c3c40fee-7ff9-43f9-a4f8-65a551debe4f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:55.446828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c3c40fee-7ff9-43f9-a4f8-65a551debe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:55.605639 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 201/389] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:55.904417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ee31-285f-40df-8cdf-073e4ce93425 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:55.904977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ee31-285f-40df-8cdf-073e4ce93425 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:55.905503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ee31-285f-40df-8cdf-073e4ce93425 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:55.908817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 189/390] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:55.915387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee8396-0f3f-4333-8ba8-c6a4923f9ace None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:55.915874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee8396-0f3f-4333-8ba8-c6a4923f9ace None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:55.916360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee8396-0f3f-4333-8ba8-c6a4923f9ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:55.954623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2eee8396-0f3f-4333-8ba8-c6a4923f9ace None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:55.956838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2eee8396-0f3f-4333-8ba8-c6a4923f9ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:56.088262 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377d6fd-b9e1-4950-a24c-6490281b0295 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:56.088796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377d6fd-b9e1-4950-a24c-6490281b0295 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:56.089610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377d6fd-b9e1-4950-a24c-6490281b0295 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:56.092826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 190/391] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:56.105046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719817e4-4c58-46ae-9425-30998ac136c6 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:56.105859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719817e4-4c58-46ae-9425-30998ac136c6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:56.106548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719817e4-4c58-46ae-9425-30998ac136c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:56.113249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 202/392] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:56.158461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-719817e4-4c58-46ae-9425-30998ac136c6 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:56.160149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-719817e4-4c58-46ae-9425-30998ac136c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:56.253316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee8396-0f3f-4333-8ba8-c6a4923f9ace None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:56.282929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 191/393] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:27:56.317242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:56.427664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee8396-0f3f-4333-8ba8-c6a4923f9ace None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:56.435227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06b64-8245-4f36-a7e6-2665da00f32a None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:56.435760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06b64-8245-4f36-a7e6-2665da00f32a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:56.435760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06b64-8245-4f36-a7e6-2665da00f32a None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:56.437325 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 192/394] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:27:56.437943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06b64-8245-4f36-a7e6-2665da00f32a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:56.468832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:56.473629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98486976-9919-4d86-a3b8-d8ea99cc4316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:56.474284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98486976-9919-4d86-a3b8-d8ea99cc4316 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:56.474581 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98486976-9919-4d86-a3b8-d8ea99cc4316 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:56.474837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98486976-9919-4d86-a3b8-d8ea99cc4316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:56.487914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98486976-9919-4d86-a3b8-d8ea99cc4316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-98486976-9919-4d86-a3b8-d8ea99cc4316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:56.493594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:56.494610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:56.495512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 203/395] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:27:56.497002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb91a5f-e24b-4581-b1bb-7781e09fdb86 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:56.497286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb91a5f-e24b-4581-b1bb-7781e09fdb86 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:56.497560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb91a5f-e24b-4581-b1bb-7781e09fdb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:56.519135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9bb91a5f-e24b-4581-b1bb-7781e09fdb86 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:56.520442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9bb91a5f-e24b-4581-b1bb-7781e09fdb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:56.593983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06b64-8245-4f36-a7e6-2665da00f32a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:56.628759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 204/396] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:56.630107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb91a5f-e24b-4581-b1bb-7781e09fdb86 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:56.651147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f9d9b-18af-49bb-8658-261db268f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:56.651806 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f9d9b-18af-49bb-8658-261db268f29f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:56.652183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f9d9b-18af-49bb-8658-261db268f29f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:56.652461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f9d9b-18af-49bb-8658-261db268f29f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:56.655717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:56.684696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f9d9b-18af-49bb-8658-261db268f29f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-f88f9d9b-18af-49bb-8658-261db268f29f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:56.689987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:56.691075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:27:56.691879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:27:56.702861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 193/397] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:27:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:56.709078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f9d9b-18af-49bb-8658-261db268f29f None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:56.771771 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb91a5f-e24b-4581-b1bb-7781e09fdb86 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:56.820974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff7d4-e96b-4954-97ee-55d3327792e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:56.822314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff7d4-e96b-4954-97ee-55d3327792e6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:56.823264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff7d4-e96b-4954-97ee-55d3327792e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:56.823726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfff7d4-e96b-4954-97ee-55d3327792e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:56.824641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff7d4-e96b-4954-97ee-55d3327792e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:56.825327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff7d4-e96b-4954-97ee-55d3327792e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:56.827659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfff7d4-e96b-4954-97ee-55d3327792e6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:56.840821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 205/398] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:56.842325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff7d4-e96b-4954-97ee-55d3327792e6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:56.867227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:56.892776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f9d9b-18af-49bb-8658-261db268f29f None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:56.937880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fe1ba-e517-4cd7-bac2-e206972c03b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:56.938537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe1ba-e517-4cd7-bac2-e206972c03b5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:56.938917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe1ba-e517-4cd7-bac2-e206972c03b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:56.939284 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34fe1ba-e517-4cd7-bac2-e206972c03b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:56.940133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fe1ba-e517-4cd7-bac2-e206972c03b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:56.940517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fe1ba-e517-4cd7-bac2-e206972c03b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:56.942037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34fe1ba-e517-4cd7-bac2-e206972c03b5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:56.953000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 194/399] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:56.954040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fe1ba-e517-4cd7-bac2-e206972c03b5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:56.961167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:56.990034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfff7d4-e96b-4954-97ee-55d3327792e6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.047703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8b23c-add7-47ad-b122-7629de472c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.049277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8b23c-add7-47ad-b122-7629de472c44 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.049851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8b23c-add7-47ad-b122-7629de472c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.050325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8b23c-add7-47ad-b122-7629de472c44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.066739 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f8b23c-add7-47ad-b122-7629de472c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-35f8b23c-add7-47ad-b122-7629de472c44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:57.073440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:57.074484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:57.075293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:57.078541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 206/400] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:27:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:57.079662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8b23c-add7-47ad-b122-7629de472c44 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.151892 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34fe1ba-e517-4cd7-bac2-e206972c03b5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.200729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8b23c-add7-47ad-b122-7629de472c44 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.223254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b95cb-e494-42ce-bb62-50d18f58311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.224554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b95cb-e494-42ce-bb62-50d18f58311f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.225153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b95cb-e494-42ce-bb62-50d18f58311f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.225744 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b95cb-e494-42ce-bb62-50d18f58311f None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.228636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b95cb-e494-42ce-bb62-50d18f58311f None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:57.231500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b95cb-e494-42ce-bb62-50d18f58311f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:57.239574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 195/401] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:27:56 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:57.239574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b95cb-e494-42ce-bb62-50d18f58311f None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.261016 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:57.268709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19ffd1-a4a8-4eb3-950b-134c076d413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.269987 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19ffd1-a4a8-4eb3-950b-134c076d413a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.270529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19ffd1-a4a8-4eb3-950b-134c076d413a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.271005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19ffd1-a4a8-4eb3-950b-134c076d413a None admin] PATH_INFO: `/v3/groups/60caf814f4e44c5bbd0a6d3f5543905c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.273190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19ffd1-a4a8-4eb3-950b-134c076d413a None admin] RBAC: Authorizing `identity:get_group(group_id=60caf814f4e44c5bbd0a6d3f5543905c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:57.276543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19ffd1-a4a8-4eb3-950b-134c076d413a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:57.285028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 207/402] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:27:57 2022] GET /identity/v3/groups/60caf814f4e44c5bbd0a6d3f5543905c => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:57.285028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19ffd1-a4a8-4eb3-950b-134c076d413a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.309716 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:57.445057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b95cb-e494-42ce-bb62-50d18f58311f None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.478100 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19ffd1-a4a8-4eb3-950b-134c076d413a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.515517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59a5a1-f8b6-4d3f-944e-8f727ea06aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.516615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a5a1-f8b6-4d3f-944e-8f727ea06aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.517066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a5a1-f8b6-4d3f-944e-8f727ea06aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.517507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a5a1-f8b6-4d3f-944e-8f727ea06aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.518663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59a5a1-f8b6-4d3f-944e-8f727ea06aa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:57.519174 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59a5a1-f8b6-4d3f-944e-8f727ea06aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:57.521759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59a5a1-f8b6-4d3f-944e-8f727ea06aa4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:57.538109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 196/403] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:57.539416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59a5a1-f8b6-4d3f-944e-8f727ea06aa4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.541050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d850b9-c231-4523-9dc3-c685314efc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.542124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d850b9-c231-4523-9dc3-c685314efc61 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.542599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d850b9-c231-4523-9dc3-c685314efc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.543061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d850b9-c231-4523-9dc3-c685314efc61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.562556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d850b9-c231-4523-9dc3-c685314efc61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-79d850b9-c231-4523-9dc3-c685314efc61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:57.572942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:57.574640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:57.575722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 208/404] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:27:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:57.578422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d850b9-c231-4523-9dc3-c685314efc61 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.651855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:57.708907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59a5a1-f8b6-4d3f-944e-8f727ea06aa4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.709944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:57.753002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d850b9-c231-4523-9dc3-c685314efc61 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.770873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba78106-7b58-4a46-aaf6-efb6feb2a4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.771691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba78106-7b58-4a46-aaf6-efb6feb2a4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.772086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba78106-7b58-4a46-aaf6-efb6feb2a4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.772509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba78106-7b58-4a46-aaf6-efb6feb2a4b6 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.773898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba78106-7b58-4a46-aaf6-efb6feb2a4b6 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:57.776178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba78106-7b58-4a46-aaf6-efb6feb2a4b6 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:57.778568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 197/405] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:57 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:57.780039 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d449f-a410-49f5-8ad1-22e9f749ee2e None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.780413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d449f-a410-49f5-8ad1-22e9f749ee2e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.780720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d449f-a410-49f5-8ad1-22e9f749ee2e None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.782051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 198/406] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:27:57.782798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d449f-a410-49f5-8ad1-22e9f749ee2e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.818872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a35e21-5829-4999-8bfd-e96122c0a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.819907 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35e21-5829-4999-8bfd-e96122c0a037 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.820366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35e21-5829-4999-8bfd-e96122c0a037 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.820856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a35e21-5829-4999-8bfd-e96122c0a037 None admin] PATH_INFO: `/v3/projects/f1c71f7fdbf248fba40d8efd925d9546` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.823501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a35e21-5829-4999-8bfd-e96122c0a037 None admin] RBAC: Authorizing `identity:get_project(project_id=f1c71f7fdbf248fba40d8efd925d9546)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:57.826275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a35e21-5829-4999-8bfd-e96122c0a037 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:57.828820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 209/407] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:57 2022] GET /identity/v3/projects/f1c71f7fdbf248fba40d8efd925d9546 => generated 344 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:57.830236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a35e21-5829-4999-8bfd-e96122c0a037 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.933366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d449f-a410-49f5-8ad1-22e9f749ee2e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:57.975325 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46821a6-b07e-486c-873c-512cdfc16aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:57.975969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46821a6-b07e-486c-873c-512cdfc16aad None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:57.976252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46821a6-b07e-486c-873c-512cdfc16aad None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:57.976619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46821a6-b07e-486c-873c-512cdfc16aad None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:57.977855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46821a6-b07e-486c-873c-512cdfc16aad None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:57.979313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46821a6-b07e-486c-873c-512cdfc16aad None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:57.981053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 199/408] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:27:57 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:57.982173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46821a6-b07e-486c-873c-512cdfc16aad None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:57.997043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:58.032230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a35e21-5829-4999-8bfd-e96122c0a037 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:58.099577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c42a6-60a5-46f6-94dc-fcdf2f9bab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:58.100626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c42a6-60a5-46f6-94dc-fcdf2f9bab8a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:58.101050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c42a6-60a5-46f6-94dc-fcdf2f9bab8a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:58.101479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c42a6-60a5-46f6-94dc-fcdf2f9bab8a None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:58.102956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c42a6-60a5-46f6-94dc-fcdf2f9bab8a None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:58.103429 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c42a6-60a5-46f6-94dc-fcdf2f9bab8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:58.105890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c42a6-60a5-46f6-94dc-fcdf2f9bab8a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:58.110129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:58.122642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 210/409] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:27:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:58.126316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa40d24-39b9-495a-a80d-4a165583bc96 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:58.126316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa40d24-39b9-495a-a80d-4a165583bc96 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:58.126316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa40d24-39b9-495a-a80d-4a165583bc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:58.128677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46821a6-b07e-486c-873c-512cdfc16aad None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:58.156169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-caa40d24-39b9-495a-a80d-4a165583bc96 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:27:58.157692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-caa40d24-39b9-495a-a80d-4a165583bc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:27:58.188412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29662ef8-e4ad-4313-b43a-d4e18fde4105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:58.189584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662ef8-e4ad-4313-b43a-d4e18fde4105 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:58.190079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662ef8-e4ad-4313-b43a-d4e18fde4105 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:58.190580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662ef8-e4ad-4313-b43a-d4e18fde4105 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/groups/c5598164e722452c8998b8100b53c83b/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:58.194181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29662ef8-e4ad-4313-b43a-d4e18fde4105 None admin] RBAC: Authorizing `identity:create_grant(project_id=87dc8cdee5be43449bfb5448b4d713cc, group_id=c5598164e722452c8998b8100b53c83b, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:58.197522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29662ef8-e4ad-4313-b43a-d4e18fde4105 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:58.242857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 211/410] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:27:58.243901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa40d24-39b9-495a-a80d-4a165583bc96 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:58.344619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 200/411] 10.222.0.83 () {58 vars in 1442 bytes} [Mon Aug 29 21:27:57 2022] PUT /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc/groups/c5598164e722452c8998b8100b53c83b/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:58.344619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29662ef8-e4ad-4313-b43a-d4e18fde4105 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:58.390962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa40d24-39b9-495a-a80d-4a165583bc96 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:58.427419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:58.437726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2d82f-ffcb-485c-8726-1a1434ce3fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:58.444672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d82f-ffcb-485c-8726-1a1434ce3fcc None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:58.444672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d82f-ffcb-485c-8726-1a1434ce3fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:58.444672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2d82f-ffcb-485c-8726-1a1434ce3fcc None admin] PATH_INFO: `/v3/projects/f1c71f7fdbf248fba40d8efd925d9546/groups/60caf814f4e44c5bbd0a6d3f5543905c/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:58.444672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2d82f-ffcb-485c-8726-1a1434ce3fcc None admin] RBAC: Authorizing `identity:create_grant(project_id=f1c71f7fdbf248fba40d8efd925d9546, group_id=60caf814f4e44c5bbd0a6d3f5543905c, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:58.444672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2d82f-ffcb-485c-8726-1a1434ce3fcc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:58.493097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:58.564217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29662ef8-e4ad-4313-b43a-d4e18fde4105 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:58.600018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 212/412] 10.222.0.83 () {58 vars in 1442 bytes} [Mon Aug 29 21:27:58 2022] PUT /identity/v3/projects/f1c71f7fdbf248fba40d8efd925d9546/groups/60caf814f4e44c5bbd0a6d3f5543905c/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:58.605925 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2d82f-ffcb-485c-8726-1a1434ce3fcc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:58.650374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14678134-dc2d-4a42-ae00-3c832724218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:58.651969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14678134-dc2d-4a42-ae00-3c832724218a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:58.652467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14678134-dc2d-4a42-ae00-3c832724218a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:58.653295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14678134-dc2d-4a42-ae00-3c832724218a None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:58.657246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14678134-dc2d-4a42-ae00-3c832724218a None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:58.660386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14678134-dc2d-4a42-ae00-3c832724218a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:58.663952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 201/413] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:58 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:58.675413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14678134-dc2d-4a42-ae00-3c832724218a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:58.768391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2d82f-ffcb-485c-8726-1a1434ce3fcc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:58.819978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb919b-90a3-41f8-b8db-989571e1db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:58.820995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb919b-90a3-41f8-b8db-989571e1db18 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:58.822469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb919b-90a3-41f8-b8db-989571e1db18 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:58.823243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb919b-90a3-41f8-b8db-989571e1db18 None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:58.824955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb919b-90a3-41f8-b8db-989571e1db18 None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:58.826795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb919b-90a3-41f8-b8db-989571e1db18 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:58.828992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 213/414] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:27:58 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:58.830118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb919b-90a3-41f8-b8db-989571e1db18 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:58.917634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:58.931889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14678134-dc2d-4a42-ae00-3c832724218a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:58.991084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb919b-90a3-41f8-b8db-989571e1db18 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:58.999565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3d22f-1e30-4287-82cf-539caf1420e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:59.000791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d22f-1e30-4287-82cf-539caf1420e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.001573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d22f-1e30-4287-82cf-539caf1420e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.002064 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3d22f-1e30-4287-82cf-539caf1420e7 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/groups/c5598164e722452c8998b8100b53c83b/roles/971e130ba91d4b7ab75b8e33d322760b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.006232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3d22f-1e30-4287-82cf-539caf1420e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9120de2e247f4ce5a58344a2f79fd2e5, group_id=c5598164e722452c8998b8100b53c83b, role_id=971e130ba91d4b7ab75b8e33d322760b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:59.013570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3d22f-1e30-4287-82cf-539caf1420e7 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:59.016631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:59.057174 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e33446-5605-4834-898e-611128a93b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:59.057842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e33446-5605-4834-898e-611128a93b6b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.058207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e33446-5605-4834-898e-611128a93b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.058454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e33446-5605-4834-898e-611128a93b6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.076089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e33446-5605-4834-898e-611128a93b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-01e33446-5605-4834-898e-611128a93b6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:27:59.087740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:27:59.089685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:27:59.092010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:27:59.101333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 214/415] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:27:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:27:59.101333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e33446-5605-4834-898e-611128a93b6b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:59.102041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 202/416] 10.222.0.83 () {58 vars in 1442 bytes} [Mon Aug 29 21:27:58 2022] PUT /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/groups/c5598164e722452c8998b8100b53c83b/roles/971e130ba91d4b7ab75b8e33d322760b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:27:59.109714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3d22f-1e30-4287-82cf-539caf1420e7 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:59.382232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3d22f-1e30-4287-82cf-539caf1420e7 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:59.390212 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e33446-5605-4834-898e-611128a93b6b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:59.423472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:59.423890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cafe8-7a41-453c-b194-830a1a6881ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:59.424694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cafe8-7a41-453c-b194-830a1a6881ce None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.424894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cafe8-7a41-453c-b194-830a1a6881ce None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.428588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cafe8-7a41-453c-b194-830a1a6881ce None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.428588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cafe8-7a41-453c-b194-830a1a6881ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:27:59.428588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cafe8-7a41-453c-b194-830a1a6881ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:59.428588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cafe8-7a41-453c-b194-830a1a6881ce None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:59.438012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 203/417] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:27:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:27:59.446970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cafe8-7a41-453c-b194-830a1a6881ce None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:59.461297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6be83-19be-4679-b9a3-5ed467f4b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:59.463009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6be83-19be-4679-b9a3-5ed467f4b7db None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.463982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6be83-19be-4679-b9a3-5ed467f4b7db None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.464615 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6be83-19be-4679-b9a3-5ed467f4b7db None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.466641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6be83-19be-4679-b9a3-5ed467f4b7db None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:59.469586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6be83-19be-4679-b9a3-5ed467f4b7db None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:59.472982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 215/418] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:27:59 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:27:59.481884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6be83-19be-4679-b9a3-5ed467f4b7db None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:27:59.586715 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:27:59.687097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cafe8-7a41-453c-b194-830a1a6881ce None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:59.767854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfbfb0-d120-4e9c-a576-a35cd6f5839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:59.769466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfbfb0-d120-4e9c-a576-a35cd6f5839c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.770275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfbfb0-d120-4e9c-a576-a35cd6f5839c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.771097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dfbfb0-d120-4e9c-a576-a35cd6f5839c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.875577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6be83-19be-4679-b9a3-5ed467f4b7db None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:27:59.958201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcb0e5-4b08-4673-a406-a01508afca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:27:59.959902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb0e5-4b08-4673-a406-a01508afca86 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:27:59.960750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb0e5-4b08-4673-a406-a01508afca86 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:27:59.961540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb0e5-4b08-4673-a406-a01508afca86 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/groups/c5598164e722452c8998b8100b53c83b/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:27:59.966257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcb0e5-4b08-4673-a406-a01508afca86 None admin] RBAC: Authorizing `identity:create_grant(project_id=9120de2e247f4ce5a58344a2f79fd2e5, group_id=c5598164e722452c8998b8100b53c83b, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:59.968516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcb0e5-4b08-4673-a406-a01508afca86 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:27:59.969220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfbfb0-d120-4e9c-a576-a35cd6f5839c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:27:59.972087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dfbfb0-d120-4e9c-a576-a35cd6f5839c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:00.084231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 216/419] 10.222.0.83 () {58 vars in 1442 bytes} [Mon Aug 29 21:27:59 2022] PUT /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5/groups/c5598164e722452c8998b8100b53c83b/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:28:00.113803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:00.203148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 204/420] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:27:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:00.209706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcb0e5-4b08-4673-a406-a01508afca86 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:00.304674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:00.404583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcb0e5-4b08-4673-a406-a01508afca86 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:00.463491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6626f75-6d91-4e05-b80c-84dd3ad68be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:00.464465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6626f75-6d91-4e05-b80c-84dd3ad68be1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:00.465278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6626f75-6d91-4e05-b80c-84dd3ad68be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:00.465759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6626f75-6d91-4e05-b80c-84dd3ad68be1 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:00.467813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6626f75-6d91-4e05-b80c-84dd3ad68be1 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:00.470437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6626f75-6d91-4e05-b80c-84dd3ad68be1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:00.474036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 217/421] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:28:00 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:00.480210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfbfb0-d120-4e9c-a576-a35cd6f5839c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:00.738302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dfbfb0-d120-4e9c-a576-a35cd6f5839c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:00.825766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2cf58-c3df-4658-88cd-433939f49f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:00.827117 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2cf58-c3df-4658-88cd-433939f49f5c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:00.827559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2cf58-c3df-4658-88cd-433939f49f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:00.827970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2cf58-c3df-4658-88cd-433939f49f5c None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:00.829902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2cf58-c3df-4658-88cd-433939f49f5c None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:00.832168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2cf58-c3df-4658-88cd-433939f49f5c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:00.835164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 205/422] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:28:00 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:00.844894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6626f75-6d91-4e05-b80c-84dd3ad68be1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:01.147768 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6626f75-6d91-4e05-b80c-84dd3ad68be1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:01.184988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:01.243908 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf27b6-b2c9-42ef-8e76-26d4717c222b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:01.244821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf27b6-b2c9-42ef-8e76-26d4717c222b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:01.245199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf27b6-b2c9-42ef-8e76-26d4717c222b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:01.245575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf27b6-b2c9-42ef-8e76-26d4717c222b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:01.246646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf27b6-b2c9-42ef-8e76-26d4717c222b None admin] RBAC: Adding query filter params (group.id=c5598164e722452c8998b8100b53c83b, role.id=971e130ba91d4b7ab75b8e33d322760b, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:01.247172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf27b6-b2c9-42ef-8e76-26d4717c222b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:01.250611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf27b6-b2c9-42ef-8e76-26d4717c222b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:01.266737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 218/423] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 21:28:00 2022] GET /identity/v3/role_assignments?group.id=c5598164e722452c8998b8100b53c83b&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=971e130ba91d4b7ab75b8e33d322760b => generated 611 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:01.938752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad160-e02d-442b-80c8-ad05adbbd0a4 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:01.939824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad160-e02d-442b-80c8-ad05adbbd0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:01.940322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad160-e02d-442b-80c8-ad05adbbd0a4 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:01.942940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 206/424] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:01.951855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be321b-8988-48f0-9b3d-c2a2cd45f1c4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:01.952337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be321b-8988-48f0-9b3d-c2a2cd45f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:01.952920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be321b-8988-48f0-9b3d-c2a2cd45f1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:01.958268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22e96-78a9-457a-90db-270579b77d8c None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:01.958624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22e96-78a9-457a-90db-270579b77d8c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:01.958990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b22e96-78a9-457a-90db-270579b77d8c None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:01.961227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 207/425] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:01.976233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fdd0c-01a8-4173-acf8-accfade950b3 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:01.976835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fdd0c-01a8-4173-acf8-accfade950b3 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:01.977314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fdd0c-01a8-4173-acf8-accfade950b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:01.988277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-94be321b-8988-48f0-9b3d-c2a2cd45f1c4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:01.990674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-94be321b-8988-48f0-9b3d-c2a2cd45f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:02.015849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-2b8fdd0c-01a8-4173-acf8-accfade950b3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:02.018116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2b8fdd0c-01a8-4173-acf8-accfade950b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:02.073765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:02.135532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 208/426] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:28:02.137320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 219/427] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:02.422473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fdd0c-01a8-4173-acf8-accfade950b3 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:02.544435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fdd0c-01a8-4173-acf8-accfade950b3 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:02.584881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e77bde-eed8-4081-8b52-e8a5aa5bdba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:02.585543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e77bde-eed8-4081-8b52-e8a5aa5bdba9 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:02.585823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e77bde-eed8-4081-8b52-e8a5aa5bdba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:02.586121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e77bde-eed8-4081-8b52-e8a5aa5bdba9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:02.599420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e77bde-eed8-4081-8b52-e8a5aa5bdba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-29e77bde-eed8-4081-8b52-e8a5aa5bdba9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:02.607334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:02.609184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:02.610782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 209/428] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:02.617074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be321b-8988-48f0-9b3d-c2a2cd45f1c4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:02.653723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e83010-62ea-4152-aae0-d750b0b12a40 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:02.654328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e83010-62ea-4152-aae0-d750b0b12a40 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:02.654871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e83010-62ea-4152-aae0-d750b0b12a40 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:02.657807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 210/429] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:02.665594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e83010-62ea-4152-aae0-d750b0b12a40 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:02.687655 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:02.791164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be321b-8988-48f0-9b3d-c2a2cd45f1c4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:02.809863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:02.825403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e83010-62ea-4152-aae0-d750b0b12a40 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:02.867399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a1c01-c5f6-4407-8c5f-2b167e550ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:02.868446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a1c01-c5f6-4407-8c5f-2b167e550ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:02.868978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a1c01-c5f6-4407-8c5f-2b167e550ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:02.869482 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a1c01-c5f6-4407-8c5f-2b167e550ad8 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:02.870769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a1c01-c5f6-4407-8c5f-2b167e550ad8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:02.871326 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a1c01-c5f6-4407-8c5f-2b167e550ad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:02.874057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a1c01-c5f6-4407-8c5f-2b167e550ad8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:02.889303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df7efe-0d71-4a34-baa4-8820cbdc1542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:02.890688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 220/430] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:28:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:02.890840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df7efe-0d71-4a34-baa4-8820cbdc1542 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:02.891436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df7efe-0d71-4a34-baa4-8820cbdc1542 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:02.892053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df7efe-0d71-4a34-baa4-8820cbdc1542 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:02.892974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e259be-62c1-48cd-ab02-040912f6682c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:02.893462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e259be-62c1-48cd-ab02-040912f6682c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:02.893952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e259be-62c1-48cd-ab02-040912f6682c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:02.913300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df7efe-0d71-4a34-baa4-8820cbdc1542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-09df7efe-0d71-4a34-baa4-8820cbdc1542 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:02.922422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:02.923979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:02.925714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:02.926919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-31e259be-62c1-48cd-ab02-040912f6682c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:02.927053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 211/431] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:28:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:02.927871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df7efe-0d71-4a34-baa4-8820cbdc1542 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:02.929450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-31e259be-62c1-48cd-ab02-040912f6682c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:03.051883 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 221/432] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:03.053036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e259be-62c1-48cd-ab02-040912f6682c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:03.057672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:03.091622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df7efe-0d71-4a34-baa4-8820cbdc1542 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.149414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebdfd4-7fc3-476b-9998-775eaf228265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:03.150411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebdfd4-7fc3-476b-9998-775eaf228265 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.150849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebdfd4-7fc3-476b-9998-775eaf228265 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.151299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebdfd4-7fc3-476b-9998-775eaf228265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.217366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:03.222940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e259be-62c1-48cd-ab02-040912f6682c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.277909 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebdfd4-7fc3-476b-9998-775eaf228265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:03.280588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebdfd4-7fc3-476b-9998-775eaf228265 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:03.283869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751b040-355d-4e20-b696-218770b883eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:03.284722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751b040-355d-4e20-b696-218770b883eb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.285184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751b040-355d-4e20-b696-218770b883eb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.285629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751b040-355d-4e20-b696-218770b883eb None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.286506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751b040-355d-4e20-b696-218770b883eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:03.287013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751b040-355d-4e20-b696-218770b883eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:03.289563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751b040-355d-4e20-b696-218770b883eb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:03.304540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 222/433] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:03.306720 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e91b7-af0d-457a-9fc6-e9ac63d3e057 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.307123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e91b7-af0d-457a-9fc6-e9ac63d3e057 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.307503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e91b7-af0d-457a-9fc6-e9ac63d3e057 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.309393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 223/434] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:03.311360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e91b7-af0d-457a-9fc6-e9ac63d3e057 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:03.437588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:03.455945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e91b7-af0d-457a-9fc6-e9ac63d3e057 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.467178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 212/435] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:03.468272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7999f-f96e-4251-bb61-342671dd608c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.468587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7999f-f96e-4251-bb61-342671dd608c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.468861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7999f-f96e-4251-bb61-342671dd608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.494681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-95c7999f-f96e-4251-bb61-342671dd608c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:03.494681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-95c7999f-f96e-4251-bb61-342671dd608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:03.506826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97422bfb-29af-448c-b95a-ad124dff4ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:03.507467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97422bfb-29af-448c-b95a-ad124dff4ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.507747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97422bfb-29af-448c-b95a-ad124dff4ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.508034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97422bfb-29af-448c-b95a-ad124dff4ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.543358 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:03.603612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 213/436] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:03.603877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7999f-f96e-4251-bb61-342671dd608c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:03.616081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97422bfb-29af-448c-b95a-ad124dff4ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:03.617857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97422bfb-29af-448c-b95a-ad124dff4ce0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:03.761403 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 224/437] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:28:03.761403 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97422bfb-29af-448c-b95a-ad124dff4ce0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:03.770593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7999f-f96e-4251-bb61-342671dd608c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.779484 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:03.808298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a85fc-a87b-4972-98d3-62848ffa8e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:03.808884 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a85fc-a87b-4972-98d3-62848ffa8e85 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:03.809264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a85fc-a87b-4972-98d3-62848ffa8e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:03.809594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a85fc-a87b-4972-98d3-62848ffa8e85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:03.821528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a85fc-a87b-4972-98d3-62848ffa8e85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-557a85fc-a87b-4972-98d3-62848ffa8e85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:03.826721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:03.827730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:03.828622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 214/438] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:28:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:03.829308 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a85fc-a87b-4972-98d3-62848ffa8e85 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:03.859860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:03.939046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97422bfb-29af-448c-b95a-ad124dff4ce0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.961097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a85fc-a87b-4972-98d3-62848ffa8e85 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:03.999179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2a0fc-3956-4ba0-816c-49f7aa8f7228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:04.003059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2a0fc-3956-4ba0-816c-49f7aa8f7228 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:04.003059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2a0fc-3956-4ba0-816c-49f7aa8f7228 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:04.003059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2a0fc-3956-4ba0-816c-49f7aa8f7228 None admin] PATH_INFO: `/v3/projects/87dc8cdee5be43449bfb5448b4d713cc` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:04.003531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e55e25-1039-4a00-9c0c-2e84902abc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:04.003681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2a0fc-3956-4ba0-816c-49f7aa8f7228 None admin] RBAC: Authorizing `identity:get_project(project_id=87dc8cdee5be43449bfb5448b4d713cc)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:04.003816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e55e25-1039-4a00-9c0c-2e84902abc25 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:04.004092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e55e25-1039-4a00-9c0c-2e84902abc25 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:04.004449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e55e25-1039-4a00-9c0c-2e84902abc25 None admin] PATH_INFO: `/v3/projects/f1c71f7fdbf248fba40d8efd925d9546` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:04.008074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e55e25-1039-4a00-9c0c-2e84902abc25 None admin] RBAC: Authorizing `identity:get_project(project_id=f1c71f7fdbf248fba40d8efd925d9546)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:04.008340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2a0fc-3956-4ba0-816c-49f7aa8f7228 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:04.008416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e55e25-1039-4a00-9c0c-2e84902abc25 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:04.009385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 215/439] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:28:03 2022] GET /identity/v3/projects/f1c71f7fdbf248fba40d8efd925d9546 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:04.009613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 225/440] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:28:03 2022] GET /identity/v3/projects/87dc8cdee5be43449bfb5448b4d713cc => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:04.011011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2a0fc-3956-4ba0-816c-49f7aa8f7228 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:04.013995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e55e25-1039-4a00-9c0c-2e84902abc25 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:04.056909 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:04.150766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e55e25-1039-4a00-9c0c-2e84902abc25 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:04.173726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2a0fc-3956-4ba0-816c-49f7aa8f7228 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:04.204525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:04.214930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a453-87f3-4ef2-8f0d-d60cf5685468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:04.215401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95066698-3dcf-426d-b7db-de7af24299ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:04.215772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a453-87f3-4ef2-8f0d-d60cf5685468 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:04.217870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066698-3dcf-426d-b7db-de7af24299ad None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:04.218067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a453-87f3-4ef2-8f0d-d60cf5685468 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:04.218218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066698-3dcf-426d-b7db-de7af24299ad None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:04.218361 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5a453-87f3-4ef2-8f0d-d60cf5685468 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:04.218490 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95066698-3dcf-426d-b7db-de7af24299ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:04.218610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5a453-87f3-4ef2-8f0d-d60cf5685468 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:04.218610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5a453-87f3-4ef2-8f0d-d60cf5685468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:04.219844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5a453-87f3-4ef2-8f0d-d60cf5685468 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:04.232084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95066698-3dcf-426d-b7db-de7af24299ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:04.232345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 216/441] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:04.233681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a453-87f3-4ef2-8f0d-d60cf5685468 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-95066698-3dcf-426d-b7db-de7af24299ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:04.240647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:04.241890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:04.242992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 226/442] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:04.244926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95066698-3dcf-426d-b7db-de7af24299ad None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:04.378032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:04.378303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95066698-3dcf-426d-b7db-de7af24299ad None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:04.386369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5a453-87f3-4ef2-8f0d-d60cf5685468 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:04.419026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f532447-8d07-4468-8539-d8455b34435d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:04.419578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f532447-8d07-4468-8539-d8455b34435d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:04.419852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f532447-8d07-4468-8539-d8455b34435d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:04.420129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f532447-8d07-4468-8539-d8455b34435d None admin] PATH_INFO: `/v3/groups/60caf814f4e44c5bbd0a6d3f5543905c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:04.421446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f532447-8d07-4468-8539-d8455b34435d None admin] RBAC: Authorizing `identity:get_group(group_id=60caf814f4e44c5bbd0a6d3f5543905c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:04.423030 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f532447-8d07-4468-8539-d8455b34435d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:04.424784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 227/443] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:28:04 2022] GET /identity/v3/groups/60caf814f4e44c5bbd0a6d3f5543905c => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:04.425749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f532447-8d07-4468-8539-d8455b34435d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:04.437826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74d1cf-39b3-4c83-abc9-2c8eb2ad4c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:04.438892 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d1cf-39b3-4c83-abc9-2c8eb2ad4c57 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:04.439383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d1cf-39b3-4c83-abc9-2c8eb2ad4c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:04.439857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d1cf-39b3-4c83-abc9-2c8eb2ad4c57 None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:04.442126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74d1cf-39b3-4c83-abc9-2c8eb2ad4c57 None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:04.444979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74d1cf-39b3-4c83-abc9-2c8eb2ad4c57 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:04.448430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 217/444] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:28:04 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:04.449699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74d1cf-39b3-4c83-abc9-2c8eb2ad4c57 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:04.519316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:04.585511 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f532447-8d07-4468-8539-d8455b34435d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:04.592143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74d1cf-39b3-4c83-abc9-2c8eb2ad4c57 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:04.634876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64938545-74ce-4f8a-813a-4937b1f3a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:04.635935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64938545-74ce-4f8a-813a-4937b1f3a67d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:04.636426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64938545-74ce-4f8a-813a-4937b1f3a67d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:04.636933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64938545-74ce-4f8a-813a-4937b1f3a67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:04.639747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782690c9-778a-4b93-a7f2-25fb4ea88bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:04.640371 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782690c9-778a-4b93-a7f2-25fb4ea88bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:04.640699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782690c9-778a-4b93-a7f2-25fb4ea88bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:04.640964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782690c9-778a-4b93-a7f2-25fb4ea88bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:04.641683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782690c9-778a-4b93-a7f2-25fb4ea88bd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:04.642117 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782690c9-778a-4b93-a7f2-25fb4ea88bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:04.643410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782690c9-778a-4b93-a7f2-25fb4ea88bd8 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:04.653344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 218/445] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:28:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:04.654223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782690c9-778a-4b93-a7f2-25fb4ea88bd8 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:04.696578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:04.757697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64938545-74ce-4f8a-813a-4937b1f3a67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:04.760575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64938545-74ce-4f8a-813a-4937b1f3a67d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:04.783106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782690c9-778a-4b93-a7f2-25fb4ea88bd8 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:04.828696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea08e5-8529-46e0-a2fa-48482bc4751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:04.829433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea08e5-8529-46e0-a2fa-48482bc4751e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:04.829795 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea08e5-8529-46e0-a2fa-48482bc4751e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:04.830174 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea08e5-8529-46e0-a2fa-48482bc4751e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:04.831048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea08e5-8529-46e0-a2fa-48482bc4751e None admin] RBAC: Adding query filter params (group.id=60caf814f4e44c5bbd0a6d3f5543905c, role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=f1c71f7fdbf248fba40d8efd925d9546) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:04.831444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea08e5-8529-46e0-a2fa-48482bc4751e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:04.833094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea08e5-8529-46e0-a2fa-48482bc4751e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:04.840762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 219/446] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 21:28:04 2022] GET /identity/v3/role_assignments?group.id=60caf814f4e44c5bbd0a6d3f5543905c&scope.project.id=f1c71f7fdbf248fba40d8efd925d9546&role.id=c0316e22a13a4034846c451753b4c14e => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:04.841646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea08e5-8529-46e0-a2fa-48482bc4751e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:04.868865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:04.932058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 228/447] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:04.933019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64938545-74ce-4f8a-813a-4937b1f3a67d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:05.013544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:05.031476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea08e5-8529-46e0-a2fa-48482bc4751e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:05.094703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bb9fe-74b5-45c3-b3e1-5afebd807635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:05.095763 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bb9fe-74b5-45c3-b3e1-5afebd807635 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:05.096220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bb9fe-74b5-45c3-b3e1-5afebd807635 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:05.096748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bb9fe-74b5-45c3-b3e1-5afebd807635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:05.098114 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bb9fe-74b5-45c3-b3e1-5afebd807635 None admin] RBAC: Adding query filter params (group.id=c5598164e722452c8998b8100b53c83b, role.id=23bfcdf883144a0b8740e12c6a6de7e3, scope.project.id=87dc8cdee5be43449bfb5448b4d713cc) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:05.098661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bb9fe-74b5-45c3-b3e1-5afebd807635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:05.101448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bb9fe-74b5-45c3-b3e1-5afebd807635 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:05.105514 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64938545-74ce-4f8a-813a-4937b1f3a67d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:05.112910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 220/448] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 21:28:04 2022] GET /identity/v3/role_assignments?group.id=c5598164e722452c8998b8100b53c83b&scope.project.id=87dc8cdee5be43449bfb5448b4d713cc&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 611 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:05.114412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bb9fe-74b5-45c3-b3e1-5afebd807635 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:05.167029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6bd6-bdd9-42a1-a51f-a4f5610ecf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:05.167821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6bd6-bdd9-42a1-a51f-a4f5610ecf0d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:05.168127 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6bd6-bdd9-42a1-a51f-a4f5610ecf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:05.168417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd6bd6-bdd9-42a1-a51f-a4f5610ecf0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:05.217013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:05.296696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd6bd6-bdd9-42a1-a51f-a4f5610ecf0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:05.299353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd6bd6-bdd9-42a1-a51f-a4f5610ecf0d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:05.301566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bb9fe-74b5-45c3-b3e1-5afebd807635 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:05.372987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8551923-44db-4fe5-9f33-b9bbf8eea055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:05.374049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551923-44db-4fe5-9f33-b9bbf8eea055 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:05.374772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551923-44db-4fe5-9f33-b9bbf8eea055 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:05.375066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8551923-44db-4fe5-9f33-b9bbf8eea055 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:05.376393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8551923-44db-4fe5-9f33-b9bbf8eea055 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:05.378540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8551923-44db-4fe5-9f33-b9bbf8eea055 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:05.381277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 221/449] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:28:05 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:05.389831 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8551923-44db-4fe5-9f33-b9bbf8eea055 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:05.437424 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:05.498270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 229/450] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:05.508033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6bd6-bdd9-42a1-a51f-a4f5610ecf0d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:05.593450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8551923-44db-4fe5-9f33-b9bbf8eea055 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:05.617920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:05.662896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc62fb-b796-4105-be3b-fc126187519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:05.663922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc62fb-b796-4105-be3b-fc126187519a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:05.664413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc62fb-b796-4105-be3b-fc126187519a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:05.664997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc62fb-b796-4105-be3b-fc126187519a None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:05.666811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc62fb-b796-4105-be3b-fc126187519a None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:05.669075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc62fb-b796-4105-be3b-fc126187519a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:05.671618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 222/451] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:28:05 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:05.678828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc62fb-b796-4105-be3b-fc126187519a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:05.712613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd6bd6-bdd9-42a1-a51f-a4f5610ecf0d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:05.784735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b17bc-688b-4aa9-962c-b2c2d44dece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:05.785773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b17bc-688b-4aa9-962c-b2c2d44dece7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:05.786241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b17bc-688b-4aa9-962c-b2c2d44dece7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:05.786697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2b17bc-688b-4aa9-962c-b2c2d44dece7 None admin] PATH_INFO: `/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:05.788693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b17bc-688b-4aa9-962c-b2c2d44dece7 None admin] RBAC: Authorizing `identity:get_project(project_id=9120de2e247f4ce5a58344a2f79fd2e5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:05.791815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2b17bc-688b-4aa9-962c-b2c2d44dece7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:05.796303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 230/452] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:28:05 2022] GET /identity/v3/projects/9120de2e247f4ce5a58344a2f79fd2e5 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:05.804817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b17bc-688b-4aa9-962c-b2c2d44dece7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:05.861971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:05.881074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc62fb-b796-4105-be3b-fc126187519a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:05.932342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5026120-0b68-4976-a0ab-60942a055497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:05.933454 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5026120-0b68-4976-a0ab-60942a055497 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:05.933936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5026120-0b68-4976-a0ab-60942a055497 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:05.934402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5026120-0b68-4976-a0ab-60942a055497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:05.935807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5026120-0b68-4976-a0ab-60942a055497 None admin] RBAC: Adding query filter params (group.id=c5598164e722452c8998b8100b53c83b, role.id=971e130ba91d4b7ab75b8e33d322760b, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:05.936348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5026120-0b68-4976-a0ab-60942a055497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:05.939063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5026120-0b68-4976-a0ab-60942a055497 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:05.950770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 223/453] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 21:28:05 2022] GET /identity/v3/role_assignments?group.id=c5598164e722452c8998b8100b53c83b&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=971e130ba91d4b7ab75b8e33d322760b => generated 611 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:05.965633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2b17bc-688b-4aa9-962c-b2c2d44dece7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:06.016155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:06.036745 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77512901-a704-4aa6-b7ca-1d5e75fe9ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:06.037920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77512901-a704-4aa6-b7ca-1d5e75fe9ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:06.038409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77512901-a704-4aa6-b7ca-1d5e75fe9ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:06.038893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77512901-a704-4aa6-b7ca-1d5e75fe9ff1 None admin] PATH_INFO: `/v3/groups/c5598164e722452c8998b8100b53c83b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:06.041866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77512901-a704-4aa6-b7ca-1d5e75fe9ff1 None admin] RBAC: Authorizing `identity:get_group(group_id=c5598164e722452c8998b8100b53c83b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:06.044804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77512901-a704-4aa6-b7ca-1d5e75fe9ff1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:06.053791 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 231/454] 10.222.0.83 () {56 vars in 1180 bytes} [Mon Aug 29 21:28:05 2022] GET /identity/v3/groups/c5598164e722452c8998b8100b53c83b => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:06.055570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5026120-0b68-4976-a0ab-60942a055497 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:06.228041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5026120-0b68-4976-a0ab-60942a055497 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:06.272110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ab1a3-ff4b-407f-bbe5-4f523747594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:06.272894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab1a3-ff4b-407f-bbe5-4f523747594c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:06.273261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab1a3-ff4b-407f-bbe5-4f523747594c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:06.273622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ab1a3-ff4b-407f-bbe5-4f523747594c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:06.275092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ab1a3-ff4b-407f-bbe5-4f523747594c None admin] RBAC: Adding query filter params (group.id=c5598164e722452c8998b8100b53c83b, role.id=23bfcdf883144a0b8740e12c6a6de7e3, scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:06.275501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ab1a3-ff4b-407f-bbe5-4f523747594c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:06.277155 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ab1a3-ff4b-407f-bbe5-4f523747594c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:06.284685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 224/455] 10.222.0.83 () {56 vars in 1376 bytes} [Mon Aug 29 21:28:06 2022] GET /identity/v3/role_assignments?group.id=c5598164e722452c8998b8100b53c83b&scope.project.id=9120de2e247f4ce5a58344a2f79fd2e5&role.id=23bfcdf883144a0b8740e12c6a6de7e3 => generated 611 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:09.325630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa540c2-963e-4da8-8f13-9f1e4e585a84 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:09.326904 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa540c2-963e-4da8-8f13-9f1e4e585a84 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:09.327638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa540c2-963e-4da8-8f13-9f1e4e585a84 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:09.329932 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 232/456] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:09.338032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad516c11-5b5b-4dd0-935a-c215509e53e0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:09.339026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad516c11-5b5b-4dd0-935a-c215509e53e0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:09.339511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad516c11-5b5b-4dd0-935a-c215509e53e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:09.373810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-ad516c11-5b5b-4dd0-935a-c215509e53e0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:09.375660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ad516c11-5b5b-4dd0-935a-c215509e53e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:09.393708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:09.478360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 225/457] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:28:09.763742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9c27-45c2-4547-b41b-01922f49addf None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:09.764217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9c27-45c2-4547-b41b-01922f49addf None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:09.764736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb9c27-45c2-4547-b41b-01922f49addf None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:09.767670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 233/458] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:09.777593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3018b-ddc3-4be0-9ede-fa833b8aa113 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:09.778069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3018b-ddc3-4be0-9ede-fa833b8aa113 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:09.778658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3018b-ddc3-4be0-9ede-fa833b8aa113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:09.822840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-42e3018b-ddc3-4be0-9ede-fa833b8aa113 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:09.824945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-42e3018b-ddc3-4be0-9ede-fa833b8aa113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:10.003916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 226/459] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:28:10.150404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb9c27-45c2-4547-b41b-01922f49addf None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:10.244429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b14ab-3b16-43af-9e4e-68da3bd71469 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.245457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b14ab-3b16-43af-9e4e-68da3bd71469 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.246288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b14ab-3b16-43af-9e4e-68da3bd71469 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.253843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 227/460] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:10.260555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f23f-53ec-4c3f-bc28-ee04d8c0bfd9 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.261484 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f23f-53ec-4c3f-bc28-ee04d8c0bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.262239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0f23f-53ec-4c3f-bc28-ee04d8c0bfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.293233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb9c27-45c2-4547-b41b-01922f49addf None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:10.321607 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-acb0f23f-53ec-4c3f-bc28-ee04d8c0bfd9 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:10.324531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-acb0f23f-53ec-4c3f-bc28-ee04d8c0bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:10.336263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f79ba-ce4c-47d6-b56f-1fb3d2d635aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:10.337133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f79ba-ce4c-47d6-b56f-1fb3d2d635aa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.337291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f79ba-ce4c-47d6-b56f-1fb3d2d635aa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.337625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f79ba-ce4c-47d6-b56f-1fb3d2d635aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.379303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f79ba-ce4c-47d6-b56f-1fb3d2d635aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:10.382507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f79ba-ce4c-47d6-b56f-1fb3d2d635aa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-7f5f79ba-ce4c-47d6-b56f-1fb3d2d635aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:10.427425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:10.429211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:10.431451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:10.431451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:10.431451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:10.433003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 234/461] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:10.437112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f79ba-ce4c-47d6-b56f-1fb3d2d635aa None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:10.495686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:10.521993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 228/462] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:10.532762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0f23f-53ec-4c3f-bc28-ee04d8c0bfd9 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:10.555264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:10.577012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f79ba-ce4c-47d6-b56f-1fb3d2d635aa None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:10.625848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9d623-0636-4dc1-afc5-a0f7ed282ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:10.626494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d623-0636-4dc1-afc5-a0f7ed282ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.626775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d623-0636-4dc1-afc5-a0f7ed282ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.627045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9d623-0636-4dc1-afc5-a0f7ed282ba2 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.627708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9d623-0636-4dc1-afc5-a0f7ed282ba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:10.628010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9d623-0636-4dc1-afc5-a0f7ed282ba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:10.629589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9d623-0636-4dc1-afc5-a0f7ed282ba2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:10.661052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 235/463] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:10.662056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9d623-0636-4dc1-afc5-a0f7ed282ba2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:10.752616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0f23f-53ec-4c3f-bc28-ee04d8c0bfd9 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:10.868131 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1404de-0ddd-4e0f-98ea-bd5af154ef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:10.869737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1404de-0ddd-4e0f-98ea-bd5af154ef5c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.870849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1404de-0ddd-4e0f-98ea-bd5af154ef5c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.875225 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1404de-0ddd-4e0f-98ea-bd5af154ef5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.901412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1404de-0ddd-4e0f-98ea-bd5af154ef5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:10.904445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1404de-0ddd-4e0f-98ea-bd5af154ef5c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:10.912141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9d623-0636-4dc1-afc5-a0f7ed282ba2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:10.915980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-ba1404de-0ddd-4e0f-98ea-bd5af154ef5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:10.937959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:10.940007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:10.942077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:10.942077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:10.942077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:10.945082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 229/464] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:10.947385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1404de-0ddd-4e0f-98ea-bd5af154ef5c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:10.971846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973225f-6bc0-4d05-90d3-aaa863674c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:10.972838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973225f-6bc0-4d05-90d3-aaa863674c1b None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:10.973162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973225f-6bc0-4d05-90d3-aaa863674c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:10.973448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973225f-6bc0-4d05-90d3-aaa863674c1b None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:10.974410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973225f-6bc0-4d05-90d3-aaa863674c1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:10.976841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973225f-6bc0-4d05-90d3-aaa863674c1b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:11.045434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:11.099520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 236/465] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:28:10 2022] POST /identity/v3/users => generated 246 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:28:11.110044 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973225f-6bc0-4d05-90d3-aaa863674c1b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:11.131029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1404de-0ddd-4e0f-98ea-bd5af154ef5c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:11.202203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb9f05-c5e1-4c84-b4c0-a30962fcd154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:11.203401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9f05-c5e1-4c84-b4c0-a30962fcd154 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.204167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9f05-c5e1-4c84-b4c0-a30962fcd154 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.204939 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb9f05-c5e1-4c84-b4c0-a30962fcd154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.229436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb9f05-c5e1-4c84-b4c0-a30962fcd154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:11.232773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb9f05-c5e1-4c84-b4c0-a30962fcd154 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-4eeb9f05-c5e1-4c84-b4c0-a30962fcd154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:11.264206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:11.265921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:11.267487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:11.267487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:11.267487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:11.271686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 230/466] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:11.274493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d9ad0-3edf-48d1-944f-1b46557e3809 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.275412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d9ad0-3edf-48d1-944f-1b46557e3809 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.276252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d9ad0-3edf-48d1-944f-1b46557e3809 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.279532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 231/467] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:11.281564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d9ad0-3edf-48d1-944f-1b46557e3809 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:11.353906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973225f-6bc0-4d05-90d3-aaa863674c1b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:11.413903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8413bfa-6948-465b-8655-24e8d111ddd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:11.414854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413bfa-6948-465b-8655-24e8d111ddd4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.415441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413bfa-6948-465b-8655-24e8d111ddd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.415946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413bfa-6948-465b-8655-24e8d111ddd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.416990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8413bfa-6948-465b-8655-24e8d111ddd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:11.417538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8413bfa-6948-465b-8655-24e8d111ddd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:11.419195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8413bfa-6948-465b-8655-24e8d111ddd4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:11.440734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 237/468] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:11.442759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b6d9d-5a64-4a94-83c2-8ee4955d3cfc None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.443253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b6d9d-5a64-4a94-83c2-8ee4955d3cfc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.443733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b6d9d-5a64-4a94-83c2-8ee4955d3cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.457535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d9ad0-3edf-48d1-944f-1b46557e3809 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:11.474856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:11.481279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-203b6d9d-5a64-4a94-83c2-8ee4955d3cfc None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:11.483435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-203b6d9d-5a64-4a94-83c2-8ee4955d3cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:11.514569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6fed2-3262-4e08-aafe-eded58617131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:11.515570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:11.515841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6fed2-3262-4e08-aafe-eded58617131 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.516329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6fed2-3262-4e08-aafe-eded58617131 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.516847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6fed2-3262-4e08-aafe-eded58617131 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.517887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6fed2-3262-4e08-aafe-eded58617131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:11.518457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6fed2-3262-4e08-aafe-eded58617131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:11.520113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6fed2-3262-4e08-aafe-eded58617131 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:11.543656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 232/469] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:11.545488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6fed2-3262-4e08-aafe-eded58617131 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:11.650257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 238/470] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:11.651598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b6d9d-5a64-4a94-83c2-8ee4955d3cfc None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:11.699876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6fed2-3262-4e08-aafe-eded58617131 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:11.779680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56caad-ad85-4d8e-9e03-3c9581010cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:11.780288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56caad-ad85-4d8e-9e03-3c9581010cc9 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.780604 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56caad-ad85-4d8e-9e03-3c9581010cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.780873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56caad-ad85-4d8e-9e03-3c9581010cc9 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.781818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56caad-ad85-4d8e-9e03-3c9581010cc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:11.783472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56caad-ad85-4d8e-9e03-3c9581010cc9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:11.822560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b6d9d-5a64-4a94-83c2-8ee4955d3cfc None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:11.867234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 233/471] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:28:11 2022] POST /identity/v3/users => generated 248 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:28:11.870937 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e5784-36b4-4dbc-8aca-ac40f2229165 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.871534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e5784-36b4-4dbc-8aca-ac40f2229165 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.872042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e5784-36b4-4dbc-8aca-ac40f2229165 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.874371 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 234/472] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:11.881220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e08e8-b6e7-4587-9c51-b101704aaf58 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.881969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e08e8-b6e7-4587-9c51-b101704aaf58 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.883309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e08e8-b6e7-4587-9c51-b101704aaf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.899463 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f0971-011c-419d-a3da-eb20015dba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:11.900145 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f0971-011c-419d-a3da-eb20015dba02 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:11.900474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f0971-011c-419d-a3da-eb20015dba02 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:11.900783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f0971-011c-419d-a3da-eb20015dba02 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:11.901478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f0971-011c-419d-a3da-eb20015dba02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:11.903798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f0971-011c-419d-a3da-eb20015dba02 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:11.910557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-374e08e8-b6e7-4587-9c51-b101704aaf58 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:11.912246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-374e08e8-b6e7-4587-9c51-b101704aaf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:11.953713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:12.012241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 235/473] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:28:12.041960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 239/474] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:28:11 2022] POST /identity/v3/users => generated 248 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:28:12.116184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e08e8-b6e7-4587-9c51-b101704aaf58 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:12.248579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e08e8-b6e7-4587-9c51-b101704aaf58 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:12.302588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41adbf-cf06-443f-9513-49de1d0fc84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:12.303600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41adbf-cf06-443f-9513-49de1d0fc84a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:12.304089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41adbf-cf06-443f-9513-49de1d0fc84a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:12.304600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41adbf-cf06-443f-9513-49de1d0fc84a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:12.325864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41adbf-cf06-443f-9513-49de1d0fc84a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:12.328705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41adbf-cf06-443f-9513-49de1d0fc84a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-9c41adbf-cf06-443f-9513-49de1d0fc84a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:12.363998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:12.364997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:12.365893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:12.365893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:12.365893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:12.367402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 236/475] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:12.374059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f0971-011c-419d-a3da-eb20015dba02 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:12.392238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:12.400534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41adbf-cf06-443f-9513-49de1d0fc84a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:12.419553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:12.568851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41adbf-cf06-443f-9513-49de1d0fc84a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:12.600038 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f0971-011c-419d-a3da-eb20015dba02 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:12.647059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cd50a-346f-4f02-9ae4-555829905992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:12.647966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cd50a-346f-4f02-9ae4-555829905992 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:12.648392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cd50a-346f-4f02-9ae4-555829905992 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:12.648833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cd50a-346f-4f02-9ae4-555829905992 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:12.649734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cd50a-346f-4f02-9ae4-555829905992 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:12.656622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cd50a-346f-4f02-9ae4-555829905992 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:12.666971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64895-de13-43f3-98f0-9c3e7bbaa23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:12.667983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64895-de13-43f3-98f0-9c3e7bbaa23b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:12.668451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64895-de13-43f3-98f0-9c3e7bbaa23b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:12.668990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64895-de13-43f3-98f0-9c3e7bbaa23b None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:12.670304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64895-de13-43f3-98f0-9c3e7bbaa23b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:12.670854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64895-de13-43f3-98f0-9c3e7bbaa23b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:12.674916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64895-de13-43f3-98f0-9c3e7bbaa23b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:12.704757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 240/476] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:12.710693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64895-de13-43f3-98f0-9c3e7bbaa23b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:12.721916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.sql.core [None req-396cd50a-346f-4f02-9ae4-555829905992 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 21:28:12.721916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 21:28:12.721916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [parameters: {'id': 'a08ea0f5c47c4bb88ccce374e952c2d2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 21:28:12.721916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81953) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-396cd50a-346f-4f02-9ae4-555829905992 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application result.read() Aug 29 21:28:12.768358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:28:12.770502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application yield resource Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise self.value Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application session.commit() Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 21:28:12.772710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self.session.flush() Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application compat.raise_( Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 21:28:12.774860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:28:12.776858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application result.read() Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:28:12.778514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [parameters: {'id': 'a08ea0f5c47c4bb88ccce374e952c2d2', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:12.780362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 21:28:12.782289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:12.789836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 237/477] 10.222.0.83 () {60 vars in 1131 bytes} [Mon Aug 29 21:28:12 2022] POST /identity/v3/roles => generated 144 bytes in 391 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:12.799137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cd50a-346f-4f02-9ae4-555829905992 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:12.950878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:12.973565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:12.998748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cd50a-346f-4f02-9ae4-555829905992 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:13.078567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb11fba-e1d5-44c6-aabe-1497dc798eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:13.080200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11fba-e1d5-44c6-aabe-1497dc798eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:13.080983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11fba-e1d5-44c6-aabe-1497dc798eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:13.081870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb11fba-e1d5-44c6-aabe-1497dc798eb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:13.103548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb11fba-e1d5-44c6-aabe-1497dc798eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:13.107096 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64895-de13-43f3-98f0-9c3e7bbaa23b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-9eb11fba-e1d5-44c6-aabe-1497dc798eb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:13.115103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:13.117119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 21:28:13.118685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:13.122673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 238/478] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:28:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:13.132523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb11fba-e1d5-44c6-aabe-1497dc798eb4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:13.204578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b9a2f-bf2c-426a-94d1-e1d02bfcc9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:13.206026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b9a2f-bf2c-426a-94d1-e1d02bfcc9c7 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:13.206759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b9a2f-bf2c-426a-94d1-e1d02bfcc9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:13.207477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b9a2f-bf2c-426a-94d1-e1d02bfcc9c7 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:13.208952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b9a2f-bf2c-426a-94d1-e1d02bfcc9c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:13.213375 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b9a2f-bf2c-426a-94d1-e1d02bfcc9c7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:13.357782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 241/479] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:28:12 2022] POST /identity/v3/users => generated 249 bytes in 647 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:28:13.403377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb11fba-e1d5-44c6-aabe-1497dc798eb4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:13.455693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105177a6-ea96-47d3-b184-44dd05e0ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:13.456208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105177a6-ea96-47d3-b184-44dd05e0ad68 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:13.456507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105177a6-ea96-47d3-b184-44dd05e0ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:13.456781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105177a6-ea96-47d3-b184-44dd05e0ad68 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:13.457476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105177a6-ea96-47d3-b184-44dd05e0ad68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:13.457775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105177a6-ea96-47d3-b184-44dd05e0ad68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:13.459229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105177a6-ea96-47d3-b184-44dd05e0ad68 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:13.461147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:13.472878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 239/480] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:14.618065 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9039b-ec73-49c1-843b-34c9526aba3b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:14.619138 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9039b-ec73-49c1-843b-34c9526aba3b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:14.619138 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9039b-ec73-49c1-843b-34c9526aba3b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:14.621033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 242/481] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:14.626851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a448-f1e7-4ead-926b-c51dcf6ffb30 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:14.627728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a448-f1e7-4ead-926b-c51dcf6ffb30 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:14.628184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a448-f1e7-4ead-926b-c51dcf6ffb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:14.653738 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e998a448-f1e7-4ead-926b-c51dcf6ffb30 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:14.655272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e998a448-f1e7-4ead-926b-c51dcf6ffb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:14.674797 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433e78-0bb5-4a87-82fb-c84e29a34400 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:14.675239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433e78-0bb5-4a87-82fb-c84e29a34400 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:14.675675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5433e78-0bb5-4a87-82fb-c84e29a34400 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:14.678386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 243/482] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:14.687585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacffa7a-b15e-4545-bee2-f84ff97cf10c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:14.688057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacffa7a-b15e-4545-bee2-f84ff97cf10c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:14.688506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacffa7a-b15e-4545-bee2-f84ff97cf10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:14.730436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-cacffa7a-b15e-4545-bee2-f84ff97cf10c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:14.732405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cacffa7a-b15e-4545-bee2-f84ff97cf10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:14.824669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 240/483] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:14.908879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 244/484] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:28:15.242185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a448-f1e7-4ead-926b-c51dcf6ffb30 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:15.346080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacffa7a-b15e-4545-bee2-f84ff97cf10c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:15.445135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a448-f1e7-4ead-926b-c51dcf6ffb30 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:15.486525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:15.501484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:15.511055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55255-3dd3-4d30-bc46-4308d5419703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:15.512018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55255-3dd3-4d30-bc46-4308d5419703 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:15.512449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55255-3dd3-4d30-bc46-4308d5419703 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:15.512882 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d55255-3dd3-4d30-bc46-4308d5419703 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:15.537478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d55255-3dd3-4d30-bc46-4308d5419703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-96d55255-3dd3-4d30-bc46-4308d5419703 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:15.545525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:15.546685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:15.547654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:15.550026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 241/485] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:15.562201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55255-3dd3-4d30-bc46-4308d5419703 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:15.601378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacffa7a-b15e-4545-bee2-f84ff97cf10c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:15.660078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1660fe-d812-488a-bcd0-c904c0100c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:15.661642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1660fe-d812-488a-bcd0-c904c0100c95 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:15.662548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1660fe-d812-488a-bcd0-c904c0100c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:15.662994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1660fe-d812-488a-bcd0-c904c0100c95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:15.678924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1660fe-d812-488a-bcd0-c904c0100c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-fe1660fe-d812-488a-bcd0-c904c0100c95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:15.685923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:15.687104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:15.688019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:15.690086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 245/486] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:15.691355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90151b4e-84ef-49c9-b05b-1b26b3935545 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:15.691637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90151b4e-84ef-49c9-b05b-1b26b3935545 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:15.692454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90151b4e-84ef-49c9-b05b-1b26b3935545 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:15.698992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 246/487] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:15.706301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90151b4e-84ef-49c9-b05b-1b26b3935545 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:15.735623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d55255-3dd3-4d30-bc46-4308d5419703 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:15.779119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26db3f-eb9b-4a80-be40-0b4de00c7a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:15.779803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26db3f-eb9b-4a80-be40-0b4de00c7a6f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:15.780085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26db3f-eb9b-4a80-be40-0b4de00c7a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:15.780354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26db3f-eb9b-4a80-be40-0b4de00c7a6f None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:15.781088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26db3f-eb9b-4a80-be40-0b4de00c7a6f None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:15.781390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26db3f-eb9b-4a80-be40-0b4de00c7a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:15.782807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26db3f-eb9b-4a80-be40-0b4de00c7a6f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:15.793109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 242/488] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:15.795596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf1219-103f-41b6-a810-0e2b64f716e4 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:15.796072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf1219-103f-41b6-a810-0e2b64f716e4 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:15.796572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf1219-103f-41b6-a810-0e2b64f716e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:15.819835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-15cf1219-103f-41b6-a810-0e2b64f716e4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:15.821102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-15cf1219-103f-41b6-a810-0e2b64f716e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:15.878729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:15.909197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90151b4e-84ef-49c9-b05b-1b26b3935545 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:15.910160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 243/489] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:15.911170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf1219-103f-41b6-a810-0e2b64f716e4 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:15.935060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:15.973507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b8d20-3e00-4469-aab1-0b5524c084f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:15.975036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b8d20-3e00-4469-aab1-0b5524c084f6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:15.975036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b8d20-3e00-4469-aab1-0b5524c084f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:15.975498 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b8d20-3e00-4469-aab1-0b5524c084f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:15.976719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b8d20-3e00-4469-aab1-0b5524c084f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:15.977218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b8d20-3e00-4469-aab1-0b5524c084f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:15.980524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b8d20-3e00-4469-aab1-0b5524c084f6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:15.995998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 247/490] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:16.013697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b8d20-3e00-4469-aab1-0b5524c084f6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:16.050083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf1219-103f-41b6-a810-0e2b64f716e4 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:16.089671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96410d-7d61-4a01-bc7c-6c1c80e26014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:16.090193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96410d-7d61-4a01-bc7c-6c1c80e26014 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:16.090473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96410d-7d61-4a01-bc7c-6c1c80e26014 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:16.090743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96410d-7d61-4a01-bc7c-6c1c80e26014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:16.103479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96410d-7d61-4a01-bc7c-6c1c80e26014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:16.105609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96410d-7d61-4a01-bc7c-6c1c80e26014 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-3d96410d-7d61-4a01-bc7c-6c1c80e26014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:16.122915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:16.125351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:16.127033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:16.127033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:16.127033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:16.127033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 244/491] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:16.138585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96410d-7d61-4a01-bc7c-6c1c80e26014 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:16.209950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:16.333240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96410d-7d61-4a01-bc7c-6c1c80e26014 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:16.380116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f0d98-4e8d-48d0-bb25-6c1af8a4754d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:16.380768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f0d98-4e8d-48d0-bb25-6c1af8a4754d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:16.381043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f0d98-4e8d-48d0-bb25-6c1af8a4754d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:16.381315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f0d98-4e8d-48d0-bb25-6c1af8a4754d None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:16.381986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f0d98-4e8d-48d0-bb25-6c1af8a4754d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:16.382289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f0d98-4e8d-48d0-bb25-6c1af8a4754d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:16.383771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f0d98-4e8d-48d0-bb25-6c1af8a4754d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:16.409274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 245/492] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:16.419162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b8d20-3e00-4469-aab1-0b5524c084f6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:16.422279 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f0d98-4e8d-48d0-bb25-6c1af8a4754d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:16.500631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a343898-d732-47e2-ade7-5471ca4db941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:16.501289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a343898-d732-47e2-ade7-5471ca4db941 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:16.501565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a343898-d732-47e2-ade7-5471ca4db941 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:16.501826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a343898-d732-47e2-ade7-5471ca4db941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:16.528988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a343898-d732-47e2-ade7-5471ca4db941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:16.532316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a343898-d732-47e2-ade7-5471ca4db941 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1a343898-d732-47e2-ade7-5471ca4db941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:16.567364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:16.569211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:16.570931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:16.570931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:16.570931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:16.572835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 248/493] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 559 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:16.572835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a343898-d732-47e2-ade7-5471ca4db941 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:16.581694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:16.601160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f0d98-4e8d-48d0-bb25-6c1af8a4754d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:16.645465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a80290-a108-4057-b967-79ecc1d81149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:16.646112 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a80290-a108-4057-b967-79ecc1d81149 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:16.646389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a80290-a108-4057-b967-79ecc1d81149 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:16.646750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a80290-a108-4057-b967-79ecc1d81149 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:16.655145 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:16.658144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a80290-a108-4057-b967-79ecc1d81149 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:16.659256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a80290-a108-4057-b967-79ecc1d81149 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-b0a80290-a108-4057-b967-79ecc1d81149 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:16.674696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:16.676910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:16.678674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:16.678674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:16.678674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:16.678674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:16.678674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:16.678674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:16.678674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:16.678674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:16.678674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:28:16.678674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:16.681505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 246/494] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 21:28:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:16.682549 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a80290-a108-4057-b967-79ecc1d81149 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:16.784142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a343898-d732-47e2-ade7-5471ca4db941 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:16.863585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4e087-6c60-4802-9e77-d6082af050af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:16.864556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4e087-6c60-4802-9e77-d6082af050af None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:16.865016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4e087-6c60-4802-9e77-d6082af050af None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:16.865463 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4e087-6c60-4802-9e77-d6082af050af None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:16.882550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a80290-a108-4057-b967-79ecc1d81149 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:16.886285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4e087-6c60-4802-9e77-d6082af050af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-bad4e087-6c60-4802-9e77-d6082af050af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:16.895708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:16.896838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:16.897669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 249/495] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:16.899545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4e087-6c60-4802-9e77-d6082af050af None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:16.947194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6acb4-b726-493e-9c5e-10e429ac9ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:16.948170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6acb4-b726-493e-9c5e-10e429ac9ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:16.948667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6acb4-b726-493e-9c5e-10e429ac9ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:16.949130 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6acb4-b726-493e-9c5e-10e429ac9ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:16.950251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6acb4-b726-493e-9c5e-10e429ac9ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:16.950746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6acb4-b726-493e-9c5e-10e429ac9ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:16.953262 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6acb4-b726-493e-9c5e-10e429ac9ad5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:16.976619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 247/496] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:16.979887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346a279-d966-49af-aeb4-c2fa90ce878b None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:16.986081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346a279-d966-49af-aeb4-c2fa90ce878b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:16.986081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346a279-d966-49af-aeb4-c2fa90ce878b None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:16.986081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 248/497] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:16.986081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346a279-d966-49af-aeb4-c2fa90ce878b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:17.012470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:17.057192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:17.073914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4e087-6c60-4802-9e77-d6082af050af None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:17.118632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f165d90-ae6f-4574-81e9-00dc550bb88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:17.119953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165d90-ae6f-4574-81e9-00dc550bb88d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:17.120225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165d90-ae6f-4574-81e9-00dc550bb88d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:17.120528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165d90-ae6f-4574-81e9-00dc550bb88d None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:17.121411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f165d90-ae6f-4574-81e9-00dc550bb88d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:17.121731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f165d90-ae6f-4574-81e9-00dc550bb88d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:17.123270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f165d90-ae6f-4574-81e9-00dc550bb88d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:17.167382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 250/498] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 21:28:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:17.175099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f165d90-ae6f-4574-81e9-00dc550bb88d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:17.195657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346a279-d966-49af-aeb4-c2fa90ce878b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:17.251856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359ef42-7b60-4fb6-a3ec-8c4974dfa8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:17.252682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ef42-7b60-4fb6-a3ec-8c4974dfa8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:17.253016 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ef42-7b60-4fb6-a3ec-8c4974dfa8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:17.253447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ef42-7b60-4fb6-a3ec-8c4974dfa8a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:17.254240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359ef42-7b60-4fb6-a3ec-8c4974dfa8a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:17.254707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359ef42-7b60-4fb6-a3ec-8c4974dfa8a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:17.256199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359ef42-7b60-4fb6-a3ec-8c4974dfa8a2 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:17.266864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 249/499] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:17.268299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2731b7-8dd1-466d-bac9-ca9712218d94 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:17.268705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2731b7-8dd1-466d-bac9-ca9712218d94 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:17.268942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2731b7-8dd1-466d-bac9-ca9712218d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:17.289881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-aa2731b7-8dd1-466d-bac9-ca9712218d94 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:17.291694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-aa2731b7-8dd1-466d-bac9-ca9712218d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:17.317678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f165d90-ae6f-4574-81e9-00dc550bb88d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:17.367663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da573e5-a4db-4e80-9778-988b9eddf729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:17.368827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da573e5-a4db-4e80-9778-988b9eddf729 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:17.369237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da573e5-a4db-4e80-9778-988b9eddf729 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:17.369685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da573e5-a4db-4e80-9778-988b9eddf729 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:17.382788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da573e5-a4db-4e80-9778-988b9eddf729 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:17.385905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da573e5-a4db-4e80-9778-988b9eddf729 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:17.395478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 250/500] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:17.395478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5872b3-45fe-4893-80c1-4476874c0e17 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:17.395478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5872b3-45fe-4893-80c1-4476874c0e17 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:17.395478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5872b3-45fe-4893-80c1-4476874c0e17 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:17.395478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 251/501] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:17.395478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5872b3-45fe-4893-80c1-4476874c0e17 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:17.403337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-4da573e5-a4db-4e80-9778-988b9eddf729 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:17.411452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:17.412515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:17.413477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:17.413477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:17.413477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:17.413477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:17.413477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:17.413477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:17.413477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:17.413477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:17.413477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:28:17.413477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:17.414488 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 251/502] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:17.416227 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da573e5-a4db-4e80-9778-988b9eddf729 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:17.421972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:17.557150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5872b3-45fe-4893-80c1-4476874c0e17 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:17.564443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da573e5-a4db-4e80-9778-988b9eddf729 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:17.613511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044cf29-8371-49eb-8d18-8114a3f7e00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:17.614464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044cf29-8371-49eb-8d18-8114a3f7e00a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:17.614931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044cf29-8371-49eb-8d18-8114a3f7e00a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:17.615392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044cf29-8371-49eb-8d18-8114a3f7e00a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:17.635094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9391b64-2f89-4512-a437-5b315e8b3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:17.637107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9391b64-2f89-4512-a437-5b315e8b3e92 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:17.637844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9391b64-2f89-4512-a437-5b315e8b3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:17.638869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9391b64-2f89-4512-a437-5b315e8b3e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:17.662497 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9391b64-2f89-4512-a437-5b315e8b3e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:17.667087 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9391b64-2f89-4512-a437-5b315e8b3e92 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b9391b64-2f89-4512-a437-5b315e8b3e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:17.698890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:17.699914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:17.700995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:17.700995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:17.700995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:17.701236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 252/503] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:17.702649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdcb1-583b-4ca8-a17e-20a7114f4e8f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:17.702933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdcb1-583b-4ca8-a17e-20a7114f4e8f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:17.703210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386bdcb1-583b-4ca8-a17e-20a7114f4e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:17.729717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044cf29-8371-49eb-8d18-8114a3f7e00a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:17.730764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-386bdcb1-583b-4ca8-a17e-20a7114f4e8f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:17.731234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044cf29-8371-49eb-8d18-8114a3f7e00a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:17.732171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-386bdcb1-583b-4ca8-a17e-20a7114f4e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:17.733624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:17.794070 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:17.828743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 253/504] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:17.828743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bdcb1-583b-4ca8-a17e-20a7114f4e8f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:17.899146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 252/505] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:17.901112 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044cf29-8371-49eb-8d18-8114a3f7e00a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:18.014034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386bdcb1-583b-4ca8-a17e-20a7114f4e8f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:18.049769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044cf29-8371-49eb-8d18-8114a3f7e00a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:18.051724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:18.084823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f2325-b2a1-4dbc-9d3c-2ac6f19243ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:18.085917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f2325-b2a1-4dbc-9d3c-2ac6f19243ff None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.086406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f2325-b2a1-4dbc-9d3c-2ac6f19243ff None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.087000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f2325-b2a1-4dbc-9d3c-2ac6f19243ff None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.088572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f2325-b2a1-4dbc-9d3c-2ac6f19243ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:18.089021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f2325-b2a1-4dbc-9d3c-2ac6f19243ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:18.091489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f2325-b2a1-4dbc-9d3c-2ac6f19243ff None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:18.097404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a677bc1-d092-422f-aab6-3e1df73deefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:18.098182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a677bc1-d092-422f-aab6-3e1df73deefa None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.098525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a677bc1-d092-422f-aab6-3e1df73deefa None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.098861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a677bc1-d092-422f-aab6-3e1df73deefa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.112473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a677bc1-d092-422f-aab6-3e1df73deefa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-9a677bc1-d092-422f-aab6-3e1df73deefa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:18.117409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:18.119115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 253/506] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:18.121241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a677bc1-d092-422f-aab6-3e1df73deefa None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:18.131485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 254/507] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 21:28:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:18.132185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f2325-b2a1-4dbc-9d3c-2ac6f19243ff None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:18.205665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:18.279780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a677bc1-d092-422f-aab6-3e1df73deefa None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:18.286653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f2325-b2a1-4dbc-9d3c-2ac6f19243ff None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:18.335482 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cb106-bf18-4d23-b5d5-2fd35b523165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:18.336211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cb106-bf18-4d23-b5d5-2fd35b523165 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.336619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cb106-bf18-4d23-b5d5-2fd35b523165 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.336989 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cb106-bf18-4d23-b5d5-2fd35b523165 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.338452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cb106-bf18-4d23-b5d5-2fd35b523165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:18.338829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cb106-bf18-4d23-b5d5-2fd35b523165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:18.340306 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208cb106-bf18-4d23-b5d5-2fd35b523165 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:18.344468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9540c-4073-4778-bc27-6761fc6ba3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:18.345531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9540c-4073-4778-bc27-6761fc6ba3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.345983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9540c-4073-4778-bc27-6761fc6ba3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.346422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f9540c-4073-4778-bc27-6761fc6ba3c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.356520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 254/508] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:18.357407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cb106-bf18-4d23-b5d5-2fd35b523165 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:18.365933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9540c-4073-4778-bc27-6761fc6ba3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:18.368680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f9540c-4073-4778-bc27-6761fc6ba3c5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:18.392508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d4f9540c-4073-4778-bc27-6761fc6ba3c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:18.396366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:18.398393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:18.400777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:18.400777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:18.400777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:18.400777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 255/509] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:18.400777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9540c-4073-4778-bc27-6761fc6ba3c5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:18.509915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cb106-bf18-4d23-b5d5-2fd35b523165 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:18.538648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:18.546305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f9540c-4073-4778-bc27-6761fc6ba3c5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:18.550447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a03e0-6540-4fa3-a6b6-1969d3dbfdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:18.551090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a03e0-6540-4fa3-a6b6-1969d3dbfdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.556940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a03e0-6540-4fa3-a6b6-1969d3dbfdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.556940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a03e0-6540-4fa3-a6b6-1969d3dbfdd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.565323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a03e0-6540-4fa3-a6b6-1969d3dbfdd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:18.567106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a03e0-6540-4fa3-a6b6-1969d3dbfdd1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-664a03e0-6540-4fa3-a6b6-1969d3dbfdd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:18.585575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:18.587803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:18.589556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:18.589556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:18.589556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:18.589556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 255/510] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:18.589556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a03e0-6540-4fa3-a6b6-1969d3dbfdd1 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:18.595868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6261e3-79e0-43ae-9b73-14959e77b0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:18.596516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6261e3-79e0-43ae-9b73-14959e77b0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.596796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6261e3-79e0-43ae-9b73-14959e77b0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.597069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6261e3-79e0-43ae-9b73-14959e77b0a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.597748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6261e3-79e0-43ae-9b73-14959e77b0a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:18.598050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6261e3-79e0-43ae-9b73-14959e77b0a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:18.599502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6261e3-79e0-43ae-9b73-14959e77b0a4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:18.611443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 256/511] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:18.612084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6261e3-79e0-43ae-9b73-14959e77b0a4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:18.682465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:18.714362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a03e0-6540-4fa3-a6b6-1969d3dbfdd1 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:18.733373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6261e3-79e0-43ae-9b73-14959e77b0a4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:18.762615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fed55-2069-429d-955c-9d656eddca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:18.763492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fed55-2069-429d-955c-9d656eddca4e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.763941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fed55-2069-429d-955c-9d656eddca4e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.764455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fed55-2069-429d-955c-9d656eddca4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.779747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78613c-4989-4827-98e2-058aa2b3f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:18.780466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78613c-4989-4827-98e2-058aa2b3f602 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:18.780895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78613c-4989-4827-98e2-058aa2b3f602 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:18.781253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78613c-4989-4827-98e2-058aa2b3f602 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:18.790260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78613c-4989-4827-98e2-058aa2b3f602 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:18.791799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78613c-4989-4827-98e2-058aa2b3f602 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-5b78613c-4989-4827-98e2-058aa2b3f602 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:18.804689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:18.815052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 257/512] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:18.815982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78613c-4989-4827-98e2-058aa2b3f602 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:18.846286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:18.892303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fed55-2069-429d-955c-9d656eddca4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:18.894364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fed55-2069-429d-955c-9d656eddca4e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:18.977689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78613c-4989-4827-98e2-058aa2b3f602 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:19.023610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b23862-6e78-49c7-a1c3-35ff4977a910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:19.024232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b23862-6e78-49c7-a1c3-35ff4977a910 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:19.025169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b23862-6e78-49c7-a1c3-35ff4977a910 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:19.025321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:19.025969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b23862-6e78-49c7-a1c3-35ff4977a910 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:19.026555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b23862-6e78-49c7-a1c3-35ff4977a910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:19.026962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b23862-6e78-49c7-a1c3-35ff4977a910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:19.028593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b23862-6e78-49c7-a1c3-35ff4977a910 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:19.043803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 258/513] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:19.045344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b23862-6e78-49c7-a1c3-35ff4977a910 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:19.073661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 256/514] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:19.075161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fed55-2069-429d-955c-9d656eddca4e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:19.155912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:19.181491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b23862-6e78-49c7-a1c3-35ff4977a910 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:19.226459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8834e1a-7e8d-4966-bd76-7e72d3f07753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:19.227380 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8834e1a-7e8d-4966-bd76-7e72d3f07753 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:19.227959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8834e1a-7e8d-4966-bd76-7e72d3f07753 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:19.228363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8834e1a-7e8d-4966-bd76-7e72d3f07753 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:19.229475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8834e1a-7e8d-4966-bd76-7e72d3f07753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:19.229967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8834e1a-7e8d-4966-bd76-7e72d3f07753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:19.232202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8834e1a-7e8d-4966-bd76-7e72d3f07753 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:19.239759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fed55-2069-429d-955c-9d656eddca4e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:19.257651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 259/515] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:19.257651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8834e1a-7e8d-4966-bd76-7e72d3f07753 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:19.293082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561e986-73a0-4f3f-b93d-a77bbf296e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:19.293783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e986-73a0-4f3f-b93d-a77bbf296e37 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:19.294154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e986-73a0-4f3f-b93d-a77bbf296e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:19.294509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e986-73a0-4f3f-b93d-a77bbf296e37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:19.311317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561e986-73a0-4f3f-b93d-a77bbf296e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:19.313800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561e986-73a0-4f3f-b93d-a77bbf296e37 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-d561e986-73a0-4f3f-b93d-a77bbf296e37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:19.336091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:19.338007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:19.338915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:19.338915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:19.338915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:19.339089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 257/516] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:19.340710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561e986-73a0-4f3f-b93d-a77bbf296e37 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:19.385465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:19.430852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8834e1a-7e8d-4966-bd76-7e72d3f07753 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:19.473973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561e986-73a0-4f3f-b93d-a77bbf296e37 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:19.495107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c31ff-8b4a-4873-90f6-ecced732fc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:19.496159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c31ff-8b4a-4873-90f6-ecced732fc05 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:19.496684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c31ff-8b4a-4873-90f6-ecced732fc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:19.497116 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c31ff-8b4a-4873-90f6-ecced732fc05 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:19.498472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c31ff-8b4a-4873-90f6-ecced732fc05 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:19.498999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c31ff-8b4a-4873-90f6-ecced732fc05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:19.501887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c31ff-8b4a-4873-90f6-ecced732fc05 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:19.517759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:19.521052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a88f-7451-40b7-9fe7-6e92d20d1a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:19.521837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a88f-7451-40b7-9fe7-6e92d20d1a9e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:19.522198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a88f-7451-40b7-9fe7-6e92d20d1a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:19.522553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a88f-7451-40b7-9fe7-6e92d20d1a9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:19.531816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31a88f-7451-40b7-9fe7-6e92d20d1a9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:19.533771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31a88f-7451-40b7-9fe7-6e92d20d1a9e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:19.536113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 260/517] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 21:28:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:19.536862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c31ff-8b4a-4873-90f6-ecced732fc05 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-7f31a88f-7451-40b7-9fe7-6e92d20d1a9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:19.555363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:19.557528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:19.559261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:19.559261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:19.559261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:19.559261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:19.559261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:19.559261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:19.559261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:19.559261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:19.559261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 258/518] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:19.559261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a88f-7451-40b7-9fe7-6e92d20d1a9e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:19.678909 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:19.694007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c31ff-8b4a-4873-90f6-ecced732fc05 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:19.706719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a88f-7451-40b7-9fe7-6e92d20d1a9e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:19.732415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf604ef-3bc8-4cf2-b3dc-e820e1408eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:19.733094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf604ef-3bc8-4cf2-b3dc-e820e1408eeb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:19.733378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf604ef-3bc8-4cf2-b3dc-e820e1408eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:19.733651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf604ef-3bc8-4cf2-b3dc-e820e1408eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:19.745403 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf604ef-3bc8-4cf2-b3dc-e820e1408eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:19.747086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf604ef-3bc8-4cf2-b3dc-e820e1408eeb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:19.761739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49662a92-6801-4400-8018-a812536cce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:19.762762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49662a92-6801-4400-8018-a812536cce61 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:19.763198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49662a92-6801-4400-8018-a812536cce61 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:19.763638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49662a92-6801-4400-8018-a812536cce61 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-7bf604ef-3bc8-4cf2-b3dc-e820e1408eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:19.764349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:19.765465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:19.766417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:19.766417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:19.766417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:19.766584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49662a92-6801-4400-8018-a812536cce61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:19.766584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49662a92-6801-4400-8018-a812536cce61 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:19.768667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 261/519] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:19.769878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf604ef-3bc8-4cf2-b3dc-e820e1408eeb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:19.825334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:19.882248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf604ef-3bc8-4cf2-b3dc-e820e1408eeb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:19.892310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 259/520] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:28:19 2022] POST /identity/v3/users => generated 247 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:28:19.893299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49662a92-6801-4400-8018-a812536cce61 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:19.947780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ac980-38af-44d8-8200-18194d4528ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:19.948919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ac980-38af-44d8-8200-18194d4528ba None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:19.949413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ac980-38af-44d8-8200-18194d4528ba None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:19.949900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ac980-38af-44d8-8200-18194d4528ba None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:19.951247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ac980-38af-44d8-8200-18194d4528ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:19.951773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ac980-38af-44d8-8200-18194d4528ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:19.954818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ac980-38af-44d8-8200-18194d4528ba None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:19.984575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 262/521] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:19.984575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ac980-38af-44d8-8200-18194d4528ba None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:20.093634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49662a92-6801-4400-8018-a812536cce61 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:20.165324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf740c84-a0c2-4d07-9737-4bb3995de4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:20.166524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf740c84-a0c2-4d07-9737-4bb3995de4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:20.167004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf740c84-a0c2-4d07-9737-4bb3995de4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:20.167548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf740c84-a0c2-4d07-9737-4bb3995de4a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:20.181097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ac980-38af-44d8-8200-18194d4528ba None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:20.193187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:20.204293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:20.252001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e49960-3780-4443-8c66-43639ade0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:20.253134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e49960-3780-4443-8c66-43639ade0bcb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:20.253592 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e49960-3780-4443-8c66-43639ade0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:20.254072 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e49960-3780-4443-8c66-43639ade0bcb None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:20.255291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e49960-3780-4443-8c66-43639ade0bcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:20.255807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e49960-3780-4443-8c66-43639ade0bcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:20.258641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e49960-3780-4443-8c66-43639ade0bcb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:20.296751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 263/522] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:20.296751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e49960-3780-4443-8c66-43639ade0bcb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:20.341388 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf740c84-a0c2-4d07-9737-4bb3995de4a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:20.342937 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf740c84-a0c2-4d07-9737-4bb3995de4a3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:20.488765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e49960-3780-4443-8c66-43639ade0bcb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:20.505459 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 260/523] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:20.507069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf740c84-a0c2-4d07-9737-4bb3995de4a3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:20.554903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82c6b0-7c2b-4245-8b8d-59f6290846a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:20.556801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82c6b0-7c2b-4245-8b8d-59f6290846a5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:20.557181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82c6b0-7c2b-4245-8b8d-59f6290846a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:20.557572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82c6b0-7c2b-4245-8b8d-59f6290846a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:20.558694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82c6b0-7c2b-4245-8b8d-59f6290846a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:20.559189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82c6b0-7c2b-4245-8b8d-59f6290846a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:20.561795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82c6b0-7c2b-4245-8b8d-59f6290846a5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:20.584809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 264/524] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:20.586262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82c6b0-7c2b-4245-8b8d-59f6290846a5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:20.600007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:20.639924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:20.708714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf740c84-a0c2-4d07-9737-4bb3995de4a3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:20.781126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a4eeb-bf6c-4236-82a8-c60c0bb0c5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:20.782174 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a4eeb-bf6c-4236-82a8-c60c0bb0c5ad None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:20.782672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a4eeb-bf6c-4236-82a8-c60c0bb0c5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:20.783158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a4eeb-bf6c-4236-82a8-c60c0bb0c5ad None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:20.787282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82c6b0-7c2b-4245-8b8d-59f6290846a5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:20.798470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a4eeb-bf6c-4236-82a8-c60c0bb0c5ad None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:20.801248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a4eeb-bf6c-4236-82a8-c60c0bb0c5ad None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-b27a4eeb-bf6c-4236-82a8-c60c0bb0c5ad None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:20.825093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:20.827300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 261/525] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:20.829326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a4eeb-bf6c-4236-82a8-c60c0bb0c5ad None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:20.864858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fa484-2afa-4286-8538-3e7373acc97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:20.865955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fa484-2afa-4286-8538-3e7373acc97a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:20.866439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fa484-2afa-4286-8538-3e7373acc97a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:20.867007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fa484-2afa-4286-8538-3e7373acc97a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:20.868364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fa484-2afa-4286-8538-3e7373acc97a None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=8434659c6b164b97b5ac27fb7e4d6a26) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:20.868960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fa484-2afa-4286-8538-3e7373acc97a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:20.871723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2fa484-2afa-4286-8538-3e7373acc97a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:20.888543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 265/526] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:20 2022] GET /identity/v3/role_assignments?user.id=8434659c6b164b97b5ac27fb7e4d6a26&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:20.888543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fa484-2afa-4286-8538-3e7373acc97a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:21.074196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a4eeb-bf6c-4236-82a8-c60c0bb0c5ad None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:21.078096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:21.126429 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:21.151826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75e6a9-52f7-4304-816c-08569abcc823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:21.152684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fa484-2afa-4286-8538-3e7373acc97a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:21.154996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75e6a9-52f7-4304-816c-08569abcc823 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:21.154996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75e6a9-52f7-4304-816c-08569abcc823 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:21.155296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75e6a9-52f7-4304-816c-08569abcc823 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:21.177409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75e6a9-52f7-4304-816c-08569abcc823 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:21.180233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75e6a9-52f7-4304-816c-08569abcc823 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-fb75e6a9-52f7-4304-816c-08569abcc823 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:21.210480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:21.212337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:21.214061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:21.214061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:21.214061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:21.214061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 262/527] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:21.214487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75e6a9-52f7-4304-816c-08569abcc823 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:21.234486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842acd27-236f-41f8-99ed-1e3246b88227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:21.239596 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842acd27-236f-41f8-99ed-1e3246b88227 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:21.239596 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842acd27-236f-41f8-99ed-1e3246b88227 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:21.239596 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842acd27-236f-41f8-99ed-1e3246b88227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:21.250688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842acd27-236f-41f8-99ed-1e3246b88227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:21.253321 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842acd27-236f-41f8-99ed-1e3246b88227 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-842acd27-236f-41f8-99ed-1e3246b88227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:21.277675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:21.278999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:21.280620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:21.280620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:21.280620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:21.280620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:21.280620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:21.280620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:21.280620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:21.280620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:21.280620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 266/528] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:21.282263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842acd27-236f-41f8-99ed-1e3246b88227 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:21.455993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75e6a9-52f7-4304-816c-08569abcc823 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:21.475229 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842acd27-236f-41f8-99ed-1e3246b88227 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:21.530945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf803362-fb74-4fe3-bb3e-ae9aa3d377df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:21.531983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf803362-fb74-4fe3-bb3e-ae9aa3d377df None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:21.532476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf803362-fb74-4fe3-bb3e-ae9aa3d377df None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:21.533334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf803362-fb74-4fe3-bb3e-ae9aa3d377df None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:21.534739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf803362-fb74-4fe3-bb3e-ae9aa3d377df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:21.535281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf803362-fb74-4fe3-bb3e-ae9aa3d377df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:21.535382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b5e6c-3808-4fa5-9e8e-86f00293f4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:21.536470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5e6c-3808-4fa5-9e8e-86f00293f4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:21.537075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5e6c-3808-4fa5-9e8e-86f00293f4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:21.537621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5e6c-3808-4fa5-9e8e-86f00293f4c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:21.538260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf803362-fb74-4fe3-bb3e-ae9aa3d377df None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:21.538933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b5e6c-3808-4fa5-9e8e-86f00293f4c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:21.539563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b5e6c-3808-4fa5-9e8e-86f00293f4c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:21.542383 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b5e6c-3808-4fa5-9e8e-86f00293f4c0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:21.566432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 267/529] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:21.568111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b5e6c-3808-4fa5-9e8e-86f00293f4c0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:21.603808 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:21.616291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 263/530] 10.222.0.83 () {56 vars in 1139 bytes} [Mon Aug 29 21:28:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:21.617745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf803362-fb74-4fe3-bb3e-ae9aa3d377df None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:21.684945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:21.790935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b5e6c-3808-4fa5-9e8e-86f00293f4c0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:21.813785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf803362-fb74-4fe3-bb3e-ae9aa3d377df None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:21.862950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff48ff1-d208-44f4-b2b5-da0ca90c3ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:21.864779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff48ff1-d208-44f4-b2b5-da0ca90c3ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:21.865611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff48ff1-d208-44f4-b2b5-da0ca90c3ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:21.867148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff48ff1-d208-44f4-b2b5-da0ca90c3ae2 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:21.869404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff48ff1-d208-44f4-b2b5-da0ca90c3ae2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:21.870360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff48ff1-d208-44f4-b2b5-da0ca90c3ae2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:21.873620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff48ff1-d208-44f4-b2b5-da0ca90c3ae2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:21.878146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765561-962c-4854-9b3f-0b4cc14e9e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:21.878799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765561-962c-4854-9b3f-0b4cc14e9e78 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:21.879074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765561-962c-4854-9b3f-0b4cc14e9e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:21.879349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765561-962c-4854-9b3f-0b4cc14e9e78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:21.887877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8765561-962c-4854-9b3f-0b4cc14e9e78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:21.889402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8765561-962c-4854-9b3f-0b4cc14e9e78 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-b8765561-962c-4854-9b3f-0b4cc14e9e78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:21.903493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:21.905111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:21.906805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:21.906805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:21.906805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:21.906805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:21.906805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:21.906805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:21.906805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:21.906805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:21.906805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 264/531] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:21.906805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765561-962c-4854-9b3f-0b4cc14e9e78 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:21.916049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 268/532] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:21.925979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff48ff1-d208-44f4-b2b5-da0ca90c3ae2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:21.990070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:22.032464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765561-962c-4854-9b3f-0b4cc14e9e78 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:22.072365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b884e-bcd0-4d1c-abd6-49e4ba28479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:22.072920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b884e-bcd0-4d1c-abd6-49e4ba28479b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:22.073201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b884e-bcd0-4d1c-abd6-49e4ba28479b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:22.073468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b884e-bcd0-4d1c-abd6-49e4ba28479b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:22.084443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:22.155869 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b884e-bcd0-4d1c-abd6-49e4ba28479b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:22.157381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b884e-bcd0-4d1c-abd6-49e4ba28479b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:22.158252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff48ff1-d208-44f4-b2b5-da0ca90c3ae2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:22.235058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c5f3-dbdf-4a65-a679-f17fb1e3c16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:22.236817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c5f3-dbdf-4a65-a679-f17fb1e3c16c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:22.237747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c5f3-dbdf-4a65-a679-f17fb1e3c16c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:22.238570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c5f3-dbdf-4a65-a679-f17fb1e3c16c None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:22.240342 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96c5f3-dbdf-4a65-a679-f17fb1e3c16c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:22.241479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:22.243802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96c5f3-dbdf-4a65-a679-f17fb1e3c16c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:22.248892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96c5f3-dbdf-4a65-a679-f17fb1e3c16c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:22.282210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 265/534] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:22.282210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b884e-bcd0-4d1c-abd6-49e4ba28479b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:22.283314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 269/534] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:22.287813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c5f3-dbdf-4a65-a679-f17fb1e3c16c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:22.403227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b884e-bcd0-4d1c-abd6-49e4ba28479b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:22.445332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67b52e-2c65-4919-91ef-fc4edc8238de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:22.445970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67b52e-2c65-4919-91ef-fc4edc8238de None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:22.446274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67b52e-2c65-4919-91ef-fc4edc8238de None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:22.446525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67b52e-2c65-4919-91ef-fc4edc8238de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:22.447831 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67b52e-2c65-4919-91ef-fc4edc8238de None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=07be3fbf45dc407ba3b6ad4d1e6ea042) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:22.448153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67b52e-2c65-4919-91ef-fc4edc8238de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:22.449893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67b52e-2c65-4919-91ef-fc4edc8238de None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:22.456687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 266/535] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:22 2022] GET /identity/v3/role_assignments?user.id=07be3fbf45dc407ba3b6ad4d1e6ea042&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:22.458642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67b52e-2c65-4919-91ef-fc4edc8238de None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:22.506769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:22.592517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c5f3-dbdf-4a65-a679-f17fb1e3c16c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:22.595156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67b52e-2c65-4919-91ef-fc4edc8238de None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:22.653158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:22.662026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c27a-0607-4fa7-92c3-e7118e2e6e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:22.663535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c27a-0607-4fa7-92c3-e7118e2e6e97 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:22.664263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c27a-0607-4fa7-92c3-e7118e2e6e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:22.665079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c27a-0607-4fa7-92c3-e7118e2e6e97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:22.671247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7c27a-0607-4fa7-92c3-e7118e2e6e97 None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=edf63df08ae14d09b5cbdb102d6609ec) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:22.671247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7c27a-0607-4fa7-92c3-e7118e2e6e97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:22.671247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7c27a-0607-4fa7-92c3-e7118e2e6e97 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:22.688836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926c1b4-c9e3-433e-be98-5dd8977aba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:22.688836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926c1b4-c9e3-433e-be98-5dd8977aba40 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:22.688836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926c1b4-c9e3-433e-be98-5dd8977aba40 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:22.688836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926c1b4-c9e3-433e-be98-5dd8977aba40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:22.689444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 270/536] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:22 2022] GET /identity/v3/role_assignments?user.id=edf63df08ae14d09b5cbdb102d6609ec&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 259 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:22.698967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ae310-2600-4323-bff6-67aa5ad2ba9c None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:22.699494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ae310-2600-4323-bff6-67aa5ad2ba9c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:22.699979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ae310-2600-4323-bff6-67aa5ad2ba9c None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:22.704175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 271/537] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:22 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:22.720419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f99171-5e70-4188-a145-dcc683e9283b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:22.721979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f99171-5e70-4188-a145-dcc683e9283b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:22.722524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f99171-5e70-4188-a145-dcc683e9283b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:22.741880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926c1b4-c9e3-433e-be98-5dd8977aba40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:22.744921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926c1b4-c9e3-433e-be98-5dd8977aba40 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:22.760664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f0f99171-5e70-4188-a145-dcc683e9283b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:22.763112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f0f99171-5e70-4188-a145-dcc683e9283b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-b926c1b4-c9e3-433e-be98-5dd8977aba40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:22.800528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:22.802293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:22.804697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:22.804697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:22.804697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:22.804697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 267/538] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:22.815035 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926c1b4-c9e3-433e-be98-5dd8977aba40 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:22.955653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 272/539] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 21:28:23.086514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:23.115340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926c1b4-c9e3-433e-be98-5dd8977aba40 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:23.209510 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236ddf6-d5ae-4450-8a62-0ce4cc6f89d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:23.210461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236ddf6-d5ae-4450-8a62-0ce4cc6f89d1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:23.210865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236ddf6-d5ae-4450-8a62-0ce4cc6f89d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:23.211316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236ddf6-d5ae-4450-8a62-0ce4cc6f89d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:23.213110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236ddf6-d5ae-4450-8a62-0ce4cc6f89d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:23.213626 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236ddf6-d5ae-4450-8a62-0ce4cc6f89d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:23.216303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236ddf6-d5ae-4450-8a62-0ce4cc6f89d1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:23.239721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 268/540] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:23.248653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f99171-5e70-4188-a145-dcc683e9283b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:23.499532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f99171-5e70-4188-a145-dcc683e9283b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:23.557416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:23.583516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c2e1b-10a6-4f39-b448-fed5e1c5fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:23.584590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c2e1b-10a6-4f39-b448-fed5e1c5fa3f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:23.585092 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c2e1b-10a6-4f39-b448-fed5e1c5fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:23.585576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c2e1b-10a6-4f39-b448-fed5e1c5fa3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:23.604652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c2e1b-10a6-4f39-b448-fed5e1c5fa3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:23.607803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c2e1b-10a6-4f39-b448-fed5e1c5fa3f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-f99c2e1b-10a6-4f39-b448-fed5e1c5fa3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:23.637351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:23.638865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:23.640541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:23.640541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:23.640541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:23.640541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:23.640541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:23.640541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:23.640541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:23.640541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:23.648527 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 273/541] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:23.652118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236ddf6-d5ae-4450-8a62-0ce4cc6f89d1 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:23.716414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c2e1b-10a6-4f39-b448-fed5e1c5fa3f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:23.931826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236ddf6-d5ae-4450-8a62-0ce4cc6f89d1 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:24.020426 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a6d6f-dc2d-47cc-9489-27ac24998eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:24.026553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6d6f-dc2d-47cc-9489-27ac24998eac None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:24.027534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6d6f-dc2d-47cc-9489-27ac24998eac None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:24.028305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6d6f-dc2d-47cc-9489-27ac24998eac None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:24.030046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a6d6f-dc2d-47cc-9489-27ac24998eac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:24.030914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a6d6f-dc2d-47cc-9489-27ac24998eac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:24.035870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a6d6f-dc2d-47cc-9489-27ac24998eac None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:24.080510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c2e1b-10a6-4f39-b448-fed5e1c5fa3f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:24.110904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 269/542] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:24.113257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb120-2301-41db-aa64-e4927ef6279b None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:24.113749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb120-2301-41db-aa64-e4927ef6279b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:24.114221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb120-2301-41db-aa64-e4927ef6279b None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:24.117185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 270/543] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:24.123626 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb120-2301-41db-aa64-e4927ef6279b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:24.140931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:24.181247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e2ea7-0073-4d00-818b-9ab8de75991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:24.183094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e2ea7-0073-4d00-818b-9ab8de75991c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:24.184012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e2ea7-0073-4d00-818b-9ab8de75991c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:24.184787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e2ea7-0073-4d00-818b-9ab8de75991c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:24.206141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e2ea7-0073-4d00-818b-9ab8de75991c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-164e2ea7-0073-4d00-818b-9ab8de75991c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:24.219776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:24.221520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:24.224037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:24.228699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 274/544] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 512 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:24.231517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676ef18-84f4-4641-a878-bed6501609e2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:24.238842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676ef18-84f4-4641-a878-bed6501609e2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:24.238842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676ef18-84f4-4641-a878-bed6501609e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:24.266363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b676ef18-84f4-4641-a878-bed6501609e2 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:24.268984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b676ef18-84f4-4641-a878-bed6501609e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:24.336625 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb120-2301-41db-aa64-e4927ef6279b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:24.389081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:24.408517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c076e-2a3d-4e5f-9398-17ab0bd6cfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:24.408517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c076e-2a3d-4e5f-9398-17ab0bd6cfb8 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:24.408517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c076e-2a3d-4e5f-9398-17ab0bd6cfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:24.408517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c076e-2a3d-4e5f-9398-17ab0bd6cfb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:24.410332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c076e-2a3d-4e5f-9398-17ab0bd6cfb8 None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=2adcc3ba3bdf4b92bd719f60e0b263ed) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:24.410332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c076e-2a3d-4e5f-9398-17ab0bd6cfb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:24.410612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 275/545] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:24.411355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c076e-2a3d-4e5f-9398-17ab0bd6cfb8 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:24.412901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676ef18-84f4-4641-a878-bed6501609e2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:24.423379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 271/546] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:24 2022] GET /identity/v3/role_assignments?user.id=2adcc3ba3bdf4b92bd719f60e0b263ed&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:24.703575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676ef18-84f4-4641-a878-bed6501609e2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:24.763270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75c082-41e8-4942-975a-96bdcabd3f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:24.764336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75c082-41e8-4942-975a-96bdcabd3f0a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:24.764859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75c082-41e8-4942-975a-96bdcabd3f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:24.765326 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75c082-41e8-4942-975a-96bdcabd3f0a None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:24.766557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75c082-41e8-4942-975a-96bdcabd3f0a None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:24.767073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75c082-41e8-4942-975a-96bdcabd3f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:24.770119 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75c082-41e8-4942-975a-96bdcabd3f0a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:24.795694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 276/547] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:24.805049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c076e-2a3d-4e5f-9398-17ab0bd6cfb8 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:24.983365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:25.041242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c076e-2a3d-4e5f-9398-17ab0bd6cfb8 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:25.107559 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75c082-41e8-4942-975a-96bdcabd3f0a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:25.143011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2659d-1d32-4262-b9d1-33a2e48d3c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:25.144084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2659d-1d32-4262-b9d1-33a2e48d3c11 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:25.144606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2659d-1d32-4262-b9d1-33a2e48d3c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:25.145091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2659d-1d32-4262-b9d1-33a2e48d3c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:25.190043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2659d-1d32-4262-b9d1-33a2e48d3c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:25.192855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d2659d-1d32-4262-b9d1-33a2e48d3c11 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-71d2659d-1d32-4262-b9d1-33a2e48d3c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:25.231048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:25.232324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:25.233442 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:25.233442 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:25.233442 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:25.233635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 272/548] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:25.242879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2659d-1d32-4262-b9d1-33a2e48d3c11 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:25.256523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:25.427740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75c082-41e8-4942-975a-96bdcabd3f0a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:25.462569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2659d-1d32-4262-b9d1-33a2e48d3c11 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:25.541044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:25.568201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ebb97-48e0-4b18-a819-9cff00729f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:25.569308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ebb97-48e0-4b18-a819-9cff00729f3f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:25.569775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ebb97-48e0-4b18-a819-9cff00729f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:25.572406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ebb97-48e0-4b18-a819-9cff00729f3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:25.582808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a70db-2e60-4775-be87-e131bacc6b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:25.583877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a70db-2e60-4775-be87-e131bacc6b48 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:25.584365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a70db-2e60-4775-be87-e131bacc6b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:25.584871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a70db-2e60-4775-be87-e131bacc6b48 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:25.586083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a70db-2e60-4775-be87-e131bacc6b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:25.586613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a70db-2e60-4775-be87-e131bacc6b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:25.589838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a70db-2e60-4775-be87-e131bacc6b48 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:25.617249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ebb97-48e0-4b18-a819-9cff00729f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a98ebb97-48e0-4b18-a819-9cff00729f3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:25.629838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:25.631278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:25.632269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:25.633087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 273/549] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:25.633213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 277/550] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 526 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:25.639013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a70db-2e60-4775-be87-e131bacc6b48 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:25.641176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ebb97-48e0-4b18-a819-9cff00729f3f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:25.870314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:25.879395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ebb97-48e0-4b18-a819-9cff00729f3f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:25.958881 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53547-eb2b-4917-886b-208cf6632ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:25.960231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53547-eb2b-4917-886b-208cf6632ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:25.960749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53547-eb2b-4917-886b-208cf6632ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:25.961288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b53547-eb2b-4917-886b-208cf6632ad5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:25.978340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b53547-eb2b-4917-886b-208cf6632ad5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:25.982193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b53547-eb2b-4917-886b-208cf6632ad5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:25.986236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a70db-2e60-4775-be87-e131bacc6b48 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-39b53547-eb2b-4917-886b-208cf6632ad5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:26.007523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:26.009955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:26.011809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 278/551] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:28:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:26.030147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53547-eb2b-4917-886b-208cf6632ad5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:26.082790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d28a6-e2a7-4990-b6ab-6517443243fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:26.083861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d28a6-e2a7-4990-b6ab-6517443243fe None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:26.084345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d28a6-e2a7-4990-b6ab-6517443243fe None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:26.084884 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d28a6-e2a7-4990-b6ab-6517443243fe None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:26.086683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d28a6-e2a7-4990-b6ab-6517443243fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:26.087194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d28a6-e2a7-4990-b6ab-6517443243fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:26.091977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d28a6-e2a7-4990-b6ab-6517443243fe None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:26.117610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 274/552] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:26.120177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3bfe-e7b8-43bf-b411-769dab168de6 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:26.120793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3bfe-e7b8-43bf-b411-769dab168de6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:26.121191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3bfe-e7b8-43bf-b411-769dab168de6 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:26.124249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 275/553] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:26.135535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe3bfe-e7b8-43bf-b411-769dab168de6 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:26.240443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:26.268846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b53547-eb2b-4917-886b-208cf6632ad5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:26.323613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe3bfe-e7b8-43bf-b411-769dab168de6 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:26.328602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc532ec-9ada-40bb-b9f9-f390f7b196d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:26.329636 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc532ec-9ada-40bb-b9f9-f390f7b196d8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:26.330113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc532ec-9ada-40bb-b9f9-f390f7b196d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:26.330579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc532ec-9ada-40bb-b9f9-f390f7b196d8 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:26.331916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc532ec-9ada-40bb-b9f9-f390f7b196d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:26.332452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc532ec-9ada-40bb-b9f9-f390f7b196d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:26.335201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc532ec-9ada-40bb-b9f9-f390f7b196d8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:26.367360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 279/554] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 21:28:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:26.370347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132a07-535b-4b97-a342-5910ea2b0ee3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:26.370910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132a07-535b-4b97-a342-5910ea2b0ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:26.371356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132a07-535b-4b97-a342-5910ea2b0ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:26.378366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251263c4-7119-4675-a5c9-7ec6882899ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:26.379035 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251263c4-7119-4675-a5c9-7ec6882899ca None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:26.379318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251263c4-7119-4675-a5c9-7ec6882899ca None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:26.379595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251263c4-7119-4675-a5c9-7ec6882899ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:26.392502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251263c4-7119-4675-a5c9-7ec6882899ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:26.393996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251263c4-7119-4675-a5c9-7ec6882899ca None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:26.404185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-33132a07-535b-4b97-a342-5910ea2b0ee3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:26.406472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-33132a07-535b-4b97-a342-5910ea2b0ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-251263c4-7119-4675-a5c9-7ec6882899ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:26.412390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:26.414288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:26.417032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:26.417032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:26.417032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:26.417032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 276/555] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:26.417032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbc53-30f6-4213-bf31-07648ab63a92 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:26.417589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbc53-30f6-4213-bf31-07648ab63a92 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:26.417898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbc53-30f6-4213-bf31-07648ab63a92 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:26.420003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 277/556] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:26.421098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcbc53-30f6-4213-bf31-07648ab63a92 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:26.435462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:26.520735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 280/557] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:26.522023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33132a07-535b-4b97-a342-5910ea2b0ee3 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:26.588805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:26.593376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcbc53-30f6-4213-bf31-07648ab63a92 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:26.656517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cb48e-1966-469a-8565-98b21ab9c11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:26.657460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cb48e-1966-469a-8565-98b21ab9c11c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:26.658009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cb48e-1966-469a-8565-98b21ab9c11c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:26.658460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cb48e-1966-469a-8565-98b21ab9c11c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:26.710407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33132a07-535b-4b97-a342-5910ea2b0ee3 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:26.761782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cb48e-1966-469a-8565-98b21ab9c11c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:26.763638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cb48e-1966-469a-8565-98b21ab9c11c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:26.791453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b8dc74-d3e5-413c-b1f1-5131ece56aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:26.792510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8dc74-d3e5-413c-b1f1-5131ece56aac None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:26.793020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8dc74-d3e5-413c-b1f1-5131ece56aac None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:26.793491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b8dc74-d3e5-413c-b1f1-5131ece56aac None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:26.794784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8dc74-d3e5-413c-b1f1-5131ece56aac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:26.795496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8dc74-d3e5-413c-b1f1-5131ece56aac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:26.797401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b8dc74-d3e5-413c-b1f1-5131ece56aac None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:26.827386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 281/558] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:26.827386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24565b8b-fcb2-4358-849a-50b64ab8e763 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:26.827386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24565b8b-fcb2-4358-849a-50b64ab8e763 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:26.827386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24565b8b-fcb2-4358-849a-50b64ab8e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:26.855123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:26.862358 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-24565b8b-fcb2-4358-849a-50b64ab8e763 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:26.863981 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-24565b8b-fcb2-4358-849a-50b64ab8e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:26.961530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 282/559] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:26.963655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24565b8b-fcb2-4358-849a-50b64ab8e763 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:26.973199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:26.975089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 278/560] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:26.980347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cb48e-1966-469a-8565-98b21ab9c11c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:27.199353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24565b8b-fcb2-4358-849a-50b64ab8e763 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:27.215114 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cb48e-1966-469a-8565-98b21ab9c11c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:27.277216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e910d-4861-40e9-bd80-371474546a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:27.278135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e910d-4861-40e9-bd80-371474546a67 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:27.278606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e910d-4861-40e9-bd80-371474546a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:27.279075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e910d-4861-40e9-bd80-371474546a67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:27.281996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f693-bfe6-46e0-9172-0ef1faff3e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:27.283190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f693-bfe6-46e0-9172-0ef1faff3e45 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:27.283768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f693-bfe6-46e0-9172-0ef1faff3e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:27.284313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:27.284534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50f693-bfe6-46e0-9172-0ef1faff3e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:27.293600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e910d-4861-40e9-bd80-371474546a67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:27.299590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e910d-4861-40e9-bd80-371474546a67 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:27.309886 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f693-bfe6-46e0-9172-0ef1faff3e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:27.312775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50f693-bfe6-46e0-9172-0ef1faff3e45 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-c39e910d-4861-40e9-bd80-371474546a67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:27.319846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:27.322158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:27.324412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:27.324412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:27.324412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:27.324412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:27.324412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:27.324412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:27.324412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:27.324412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:27.324412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:28:27.324412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:27.332740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 283/561] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 21:28:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:27.332740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e910d-4861-40e9-bd80-371474546a67 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-6e50f693-bfe6-46e0-9172-0ef1faff3e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:27.340943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:27.343243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:27.345907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:27.345907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:27.345907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:27.345907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 279/562] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:27.345907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f693-bfe6-46e0-9172-0ef1faff3e45 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:27.453312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:27.531032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e910d-4861-40e9-bd80-371474546a67 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:27.534902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50f693-bfe6-46e0-9172-0ef1faff3e45 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:27.583937 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c358-490f-40f3-9dc7-ac0d7995e23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:27.584596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c358-490f-40f3-9dc7-ac0d7995e23d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:27.584881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c358-490f-40f3-9dc7-ac0d7995e23d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:27.585158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c358-490f-40f3-9dc7-ac0d7995e23d None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:27.585934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777c358-490f-40f3-9dc7-ac0d7995e23d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:27.586245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777c358-490f-40f3-9dc7-ac0d7995e23d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:27.588320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777c358-490f-40f3-9dc7-ac0d7995e23d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:27.600799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d50885-6439-4fa3-89a2-4a4cddbf73b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:27.601905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50885-6439-4fa3-89a2-4a4cddbf73b2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:27.602408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50885-6439-4fa3-89a2-4a4cddbf73b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:27.602890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d50885-6439-4fa3-89a2-4a4cddbf73b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:27.618414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 280/563] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 21:28:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:27.618414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c358-490f-40f3-9dc7-ac0d7995e23d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:27.630379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d50885-6439-4fa3-89a2-4a4cddbf73b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a3d50885-6439-4fa3-89a2-4a4cddbf73b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:27.639728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:27.641812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 284/564] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:27.644131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d50885-6439-4fa3-89a2-4a4cddbf73b2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:27.727239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:27.798984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d50885-6439-4fa3-89a2-4a4cddbf73b2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:27.828985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c358-490f-40f3-9dc7-ac0d7995e23d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:27.843631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:27.871006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcc6db-b4e4-4804-a797-252085f7b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:27.872205 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcc6db-b4e4-4804-a797-252085f7b398 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:27.872761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcc6db-b4e4-4804-a797-252085f7b398 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:27.873275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcc6db-b4e4-4804-a797-252085f7b398 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:27.879902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2db10f-c72e-4414-a1aa-34c5bf76a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:27.880752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2db10f-c72e-4414-a1aa-34c5bf76a3ae None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:27.881177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2db10f-c72e-4414-a1aa-34c5bf76a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:27.881591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2db10f-c72e-4414-a1aa-34c5bf76a3ae None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:27.882409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2db10f-c72e-4414-a1aa-34c5bf76a3ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:27.882849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2db10f-c72e-4414-a1aa-34c5bf76a3ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:27.884659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2db10f-c72e-4414-a1aa-34c5bf76a3ae None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:27.895821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcc6db-b4e4-4804-a797-252085f7b398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:27.910197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 281/565] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:27.910197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2db10f-c72e-4414-a1aa-34c5bf76a3ae None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-20fcc6db-b4e4-4804-a797-252085f7b398 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:27.910582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:27.912112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 285/566] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:27.916354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcc6db-b4e4-4804-a797-252085f7b398 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:28.048158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcc6db-b4e4-4804-a797-252085f7b398 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:28.058990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2db10f-c72e-4414-a1aa-34c5bf76a3ae None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:28.070126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:28.093394 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72d3c3-6647-4fd0-aa0a-560fa07d8998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:28.094148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72d3c3-6647-4fd0-aa0a-560fa07d8998 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:28.094516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72d3c3-6647-4fd0-aa0a-560fa07d8998 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:28.094918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72d3c3-6647-4fd0-aa0a-560fa07d8998 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:28.095692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72d3c3-6647-4fd0-aa0a-560fa07d8998 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:28.096095 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72d3c3-6647-4fd0-aa0a-560fa07d8998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:28.097728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d72d3c3-6647-4fd0-aa0a-560fa07d8998 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:28.101607 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45262-a53c-4527-a3da-9c0515b1e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:28.102330 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45262-a53c-4527-a3da-9c0515b1e407 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:28.102673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45262-a53c-4527-a3da-9c0515b1e407 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:28.103007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc45262-a53c-4527-a3da-9c0515b1e407 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:28.109946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 286/567] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:28.110942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72d3c3-6647-4fd0-aa0a-560fa07d8998 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:28.119508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc45262-a53c-4527-a3da-9c0515b1e407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:28.121235 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc45262-a53c-4527-a3da-9c0515b1e407 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-ecc45262-a53c-4527-a3da-9c0515b1e407 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:28.142523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:28.144453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:28.146850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:28.146850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:28.146850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:28.146850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 282/568] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:28.146850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45262-a53c-4527-a3da-9c0515b1e407 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:28.183628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:28.253074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72d3c3-6647-4fd0-aa0a-560fa07d8998 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:28.298780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc45262-a53c-4527-a3da-9c0515b1e407 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:28.301348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f214df-dc3b-460b-8722-07792d7324bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:28.302113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f214df-dc3b-460b-8722-07792d7324bb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:28.302557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f214df-dc3b-460b-8722-07792d7324bb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:28.303007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f214df-dc3b-460b-8722-07792d7324bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:28.314503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f214df-dc3b-460b-8722-07792d7324bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:28.316647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f214df-dc3b-460b-8722-07792d7324bb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-30f214df-dc3b-460b-8722-07792d7324bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:28.330613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:28.332182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:28.333448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:28.333448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:28.333448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:28.333448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:28.333448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:28.333448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:28.333448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:28.333448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:28.333448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 287/569] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:28.334582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711689b-60e2-4736-94b3-cda7351eb265 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:28.335071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711689b-60e2-4736-94b3-cda7351eb265 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:28.335549 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711689b-60e2-4736-94b3-cda7351eb265 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:28.338845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 288/570] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:28.342714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711689b-60e2-4736-94b3-cda7351eb265 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:28.352935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbddf3-2112-4559-ba42-49d04cd005a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:28.353690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbddf3-2112-4559-ba42-49d04cd005a4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:28.354026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbddf3-2112-4559-ba42-49d04cd005a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:28.354443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbddf3-2112-4559-ba42-49d04cd005a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:28.355136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbddf3-2112-4559-ba42-49d04cd005a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:28.355535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbddf3-2112-4559-ba42-49d04cd005a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:28.357256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fbddf3-2112-4559-ba42-49d04cd005a4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:28.370483 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 283/571] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:28.371698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbddf3-2112-4559-ba42-49d04cd005a4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:28.408142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:28.482781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:28.492330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711689b-60e2-4736-94b3-cda7351eb265 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:28.506592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbddf3-2112-4559-ba42-49d04cd005a4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:28.531569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea49f1f-f99c-419f-9235-5f7653aa7348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:28.532232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49f1f-f99c-419f-9235-5f7653aa7348 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:28.532543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49f1f-f99c-419f-9235-5f7653aa7348 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:28.532833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea49f1f-f99c-419f-9235-5f7653aa7348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:28.545541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea49f1f-f99c-419f-9235-5f7653aa7348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:28.547130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea49f1f-f99c-419f-9235-5f7653aa7348 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:28.559671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4887ad-c967-409b-9425-1d9293a3d171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:28.560447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4887ad-c967-409b-9425-1d9293a3d171 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:28.560928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4887ad-c967-409b-9425-1d9293a3d171 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:28.561332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4887ad-c967-409b-9425-1d9293a3d171 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:28.562118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4887ad-c967-409b-9425-1d9293a3d171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:28.562592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4887ad-c967-409b-9425-1d9293a3d171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:28.564115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4887ad-c967-409b-9425-1d9293a3d171 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-0ea49f1f-f99c-419f-9235-5f7653aa7348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:28.565493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:28.567613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:28.568949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:28.568949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:28.568949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:28.568949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 289/572] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:28.568949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea49f1f-f99c-419f-9235-5f7653aa7348 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:28.585600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 284/573] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:28.587456 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca5c0-fe87-4cb6-a273-555d87964446 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:28.587885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca5c0-fe87-4cb6-a273-555d87964446 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:28.588452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fca5c0-fe87-4cb6-a273-555d87964446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:28.609886 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-05fca5c0-fe87-4cb6-a273-555d87964446 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:28.611155 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-05fca5c0-fe87-4cb6-a273-555d87964446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:28.689009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:28.701501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea49f1f-f99c-419f-9235-5f7653aa7348 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:28.708379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 285/574] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:28.710655 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fca5c0-fe87-4cb6-a273-555d87964446 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:28.741337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaf14c-f2db-4e76-a0fc-943874b2d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:28.742583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaf14c-f2db-4e76-a0fc-943874b2d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:28.742879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaf14c-f2db-4e76-a0fc-943874b2d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:28.743159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caaf14c-f2db-4e76-a0fc-943874b2d5c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:28.744397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaf14c-f2db-4e76-a0fc-943874b2d5c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:28.744737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaf14c-f2db-4e76-a0fc-943874b2d5c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:28.746214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caaf14c-f2db-4e76-a0fc-943874b2d5c1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:28.760798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 290/575] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:28.767263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaf14c-f2db-4e76-a0fc-943874b2d5c1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:28.853334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:28.913872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fca5c0-fe87-4cb6-a273-555d87964446 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:28.942727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caaf14c-f2db-4e76-a0fc-943874b2d5c1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:28.960088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331591-eedb-4534-ab9a-8e15f35cfc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:28.960820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331591-eedb-4534-ab9a-8e15f35cfc96 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:28.961108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331591-eedb-4534-ab9a-8e15f35cfc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:28.961389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53331591-eedb-4534-ab9a-8e15f35cfc96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:28.975341 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53331591-eedb-4534-ab9a-8e15f35cfc96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:28.976976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53331591-eedb-4534-ab9a-8e15f35cfc96 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-53331591-eedb-4534-ab9a-8e15f35cfc96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:28.998136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:28.999772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:29.001685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:29.001685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:29.001685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:29.004426 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 286/576] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:29.005473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331591-eedb-4534-ab9a-8e15f35cfc96 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:29.022639 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8812666-4d75-4e93-9cb8-68fd240e9fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:29.023645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8812666-4d75-4e93-9cb8-68fd240e9fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:29.024091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8812666-4d75-4e93-9cb8-68fd240e9fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:29.024597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8812666-4d75-4e93-9cb8-68fd240e9fb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:29.025752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8812666-4d75-4e93-9cb8-68fd240e9fb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:29.026281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8812666-4d75-4e93-9cb8-68fd240e9fb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:29.028854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8812666-4d75-4e93-9cb8-68fd240e9fb9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:29.051001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 291/577] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:29.052986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8812666-4d75-4e93-9cb8-68fd240e9fb9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:29.076176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:29.147657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53331591-eedb-4534-ab9a-8e15f35cfc96 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:29.175975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:29.192562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8812666-4d75-4e93-9cb8-68fd240e9fb9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:29.192783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6f156-4a66-48cd-9531-39f39fba460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:29.193687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6f156-4a66-48cd-9531-39f39fba460e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:29.194150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6f156-4a66-48cd-9531-39f39fba460e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:29.194603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6f156-4a66-48cd-9531-39f39fba460e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:29.206728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6f156-4a66-48cd-9531-39f39fba460e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:29.209381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6f156-4a66-48cd-9531-39f39fba460e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-a6b6f156-4a66-48cd-9531-39f39fba460e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:29.223748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:29.231492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:29.233179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:29.233179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:29.233179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:29.233179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:29.233179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:29.233179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:29.233179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:29.233179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:29.233179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 287/578] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:29.233179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6f156-4a66-48cd-9531-39f39fba460e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:29.250281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7392a09-5cf0-4820-90b5-86c900ed4e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:29.251155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7392a09-5cf0-4820-90b5-86c900ed4e7b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:29.251461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7392a09-5cf0-4820-90b5-86c900ed4e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:29.251751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7392a09-5cf0-4820-90b5-86c900ed4e7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:29.252519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7392a09-5cf0-4820-90b5-86c900ed4e7b None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=87128016ec014aa8b8f2fcc8ecf1037d) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:29.252909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7392a09-5cf0-4820-90b5-86c900ed4e7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:29.254772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7392a09-5cf0-4820-90b5-86c900ed4e7b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:29.261155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 292/579] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:29 2022] GET /identity/v3/role_assignments?user.id=87128016ec014aa8b8f2fcc8ecf1037d&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:29.262035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7392a09-5cf0-4820-90b5-86c900ed4e7b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:29.376845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6f156-4a66-48cd-9531-39f39fba460e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:29.395601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:29.425402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588cac8-1de2-42ac-97e0-5731cb236d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:29.426018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588cac8-1de2-42ac-97e0-5731cb236d2b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:29.426287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588cac8-1de2-42ac-97e0-5731cb236d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:29.426558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588cac8-1de2-42ac-97e0-5731cb236d2b None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:29.427236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588cac8-1de2-42ac-97e0-5731cb236d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:29.427545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588cac8-1de2-42ac-97e0-5731cb236d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:29.429095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588cac8-1de2-42ac-97e0-5731cb236d2b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:29.430421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7392a09-5cf0-4820-90b5-86c900ed4e7b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:29.449078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 288/580] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:29.450203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588cac8-1de2-42ac-97e0-5731cb236d2b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:29.485339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c933fb-72c0-42a2-963b-8562fc37f1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:29.486390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c933fb-72c0-42a2-963b-8562fc37f1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:29.486710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c933fb-72c0-42a2-963b-8562fc37f1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:29.486960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c933fb-72c0-42a2-963b-8562fc37f1b6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:29.499741 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c933fb-72c0-42a2-963b-8562fc37f1b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:29.502786 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c933fb-72c0-42a2-963b-8562fc37f1b6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:29.515516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-87c933fb-72c0-42a2-963b-8562fc37f1b6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:29.522373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:29.523411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:29.524575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:29.524575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:29.524575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:29.524575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:29.524575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:29.524575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:29.524575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:29.524575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:29.524575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:28:29.524575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:29.532397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 293/581] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:29.533846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c933fb-72c0-42a2-963b-8562fc37f1b6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:29.591002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588cac8-1de2-42ac-97e0-5731cb236d2b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:29.644073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a3170-06e8-4255-881f-2c65bfc6f0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:29.645142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3170-06e8-4255-881f-2c65bfc6f0dc None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:29.645605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3170-06e8-4255-881f-2c65bfc6f0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:29.646059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3170-06e8-4255-881f-2c65bfc6f0dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:29.662124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a3170-06e8-4255-881f-2c65bfc6f0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-5e7a3170-06e8-4255-881f-2c65bfc6f0dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:29.669063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:29.670908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 289/582] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:29.672601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a3170-06e8-4255-881f-2c65bfc6f0dc None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:29.693134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c933fb-72c0-42a2-963b-8562fc37f1b6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:29.741621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a143f-5263-4688-ba19-a457d9fdba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:29.742664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a143f-5263-4688-ba19-a457d9fdba87 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:29.743080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a143f-5263-4688-ba19-a457d9fdba87 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:29.743544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a143f-5263-4688-ba19-a457d9fdba87 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:29.744436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a143f-5263-4688-ba19-a457d9fdba87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:29.744921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a143f-5263-4688-ba19-a457d9fdba87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:29.746692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a143f-5263-4688-ba19-a457d9fdba87 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:29.748859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:29.761859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 294/583] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:29.766656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a143f-5263-4688-ba19-a457d9fdba87 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:29.832634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a3170-06e8-4255-881f-2c65bfc6f0dc None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:29.838601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:29.881425 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854b266-cef3-448c-9604-a283f21d0a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:29.882090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854b266-cef3-448c-9604-a283f21d0a61 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:29.882367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854b266-cef3-448c-9604-a283f21d0a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:29.882669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854b266-cef3-448c-9604-a283f21d0a61 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:29.893499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854b266-cef3-448c-9604-a283f21d0a61 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:29.895013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854b266-cef3-448c-9604-a283f21d0a61 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-a854b266-cef3-448c-9604-a283f21d0a61 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:29.910287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:29.913880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 290/584] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:29.916056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854b266-cef3-448c-9604-a283f21d0a61 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:29.935161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a143f-5263-4688-ba19-a457d9fdba87 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:30.017132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf2cee-bcef-4b32-bcbe-10612d022f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:30.018232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2cee-bcef-4b32-bcbe-10612d022f10 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:30.018708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2cee-bcef-4b32-bcbe-10612d022f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:30.019171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf2cee-bcef-4b32-bcbe-10612d022f10 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:30.020559 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf2cee-bcef-4b32-bcbe-10612d022f10 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:30.021098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf2cee-bcef-4b32-bcbe-10612d022f10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:30.023817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf2cee-bcef-4b32-bcbe-10612d022f10 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:30.053445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 295/585] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 21:28:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:30.053445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf2cee-bcef-4b32-bcbe-10612d022f10 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:30.095588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854b266-cef3-448c-9604-a283f21d0a61 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:30.148012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:30.158120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b70da-fdab-42b9-9b7d-2c048abf21f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:30.159039 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b70da-fdab-42b9-9b7d-2c048abf21f0 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:30.159493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b70da-fdab-42b9-9b7d-2c048abf21f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:30.159941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b70da-fdab-42b9-9b7d-2c048abf21f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:30.161139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b70da-fdab-42b9-9b7d-2c048abf21f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:30.164208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b70da-fdab-42b9-9b7d-2c048abf21f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:30.164208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b70da-fdab-42b9-9b7d-2c048abf21f0 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:30.185618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 291/586] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:30.185618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b70da-fdab-42b9-9b7d-2c048abf21f0 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:30.229070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:30.234009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf2cee-bcef-4b32-bcbe-10612d022f10 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:30.298747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021ab4-7fb5-42ab-8c1f-a5db0e8111f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:30.299802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021ab4-7fb5-42ab-8c1f-a5db0e8111f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:30.300349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021ab4-7fb5-42ab-8c1f-a5db0e8111f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:30.301050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9021ab4-7fb5-42ab-8c1f-a5db0e8111f5 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/8434659c6b164b97b5ac27fb7e4d6a26/roles/987f120590e04a9aa6b494c08604a0cd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:30.330390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9021ab4-7fb5-42ab-8c1f-a5db0e8111f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=8434659c6b164b97b5ac27fb7e4d6a26, role_id=987f120590e04a9aa6b494c08604a0cd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:30.333033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9021ab4-7fb5-42ab-8c1f-a5db0e8111f5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:30.365714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b70da-fdab-42b9-9b7d-2c048abf21f0 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:30.417954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b811-34d2-49da-b18c-2f7a7fcbd795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:30.418261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 296/587] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:28:30 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/8434659c6b164b97b5ac27fb7e4d6a26/roles/987f120590e04a9aa6b494c08604a0cd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:28:30.418953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b811-34d2-49da-b18c-2f7a7fcbd795 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:30.419182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b811-34d2-49da-b18c-2f7a7fcbd795 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:30.419552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339b811-34d2-49da-b18c-2f7a7fcbd795 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:30.420432 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b811-34d2-49da-b18c-2f7a7fcbd795 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:30.420902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b811-34d2-49da-b18c-2f7a7fcbd795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:30.421564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021ab4-7fb5-42ab-8c1f-a5db0e8111f5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:30.422629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339b811-34d2-49da-b18c-2f7a7fcbd795 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:30.452099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 292/588] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 21:28:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:30.452099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b811-34d2-49da-b18c-2f7a7fcbd795 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:30.588859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:30.613715 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339b811-34d2-49da-b18c-2f7a7fcbd795 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:30.646552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9021ab4-7fb5-42ab-8c1f-a5db0e8111f5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:30.650765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:30.667950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe28a0-c057-4722-8b3f-6a58b32d31dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:30.668844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe28a0-c057-4722-8b3f-6a58b32d31dd None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:30.669813 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe28a0-c057-4722-8b3f-6a58b32d31dd None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:30.670196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe28a0-c057-4722-8b3f-6a58b32d31dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:30.694574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe28a0-c057-4722-8b3f-6a58b32d31dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:30.698187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe28a0-c057-4722-8b3f-6a58b32d31dd None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:30.721253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172a4d7-167c-4b5b-bec6-aca3810223d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:30.721917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172a4d7-167c-4b5b-bec6-aca3810223d0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:30.722212 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172a4d7-167c-4b5b-bec6-aca3810223d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:30.722461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172a4d7-167c-4b5b-bec6-aca3810223d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-60fe28a0-c057-4722-8b3f-6a58b32d31dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:30.731489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:30.733370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:30.734460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:30.734460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:30.734460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:30.736324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 293/589] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:30.736324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe28a0-c057-4722-8b3f-6a58b32d31dd None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:30.743602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172a4d7-167c-4b5b-bec6-aca3810223d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:30.747073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172a4d7-167c-4b5b-bec6-aca3810223d0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2172a4d7-167c-4b5b-bec6-aca3810223d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:30.767573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:30.769640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:30.771421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:30.771421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:30.771421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:30.771421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 297/590] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:30.771421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172a4d7-167c-4b5b-bec6-aca3810223d0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:30.952017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe28a0-c057-4722-8b3f-6a58b32d31dd None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:30.975570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172a4d7-167c-4b5b-bec6-aca3810223d0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:30.996638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b17f4-2a82-46b0-a259-4f1dd6d5bc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:30.997932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b17f4-2a82-46b0-a259-4f1dd6d5bc7d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:30.998717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b17f4-2a82-46b0-a259-4f1dd6d5bc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:30.999206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b17f4-2a82-46b0-a259-4f1dd6d5bc7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:31.003685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:31.015384 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b17f4-2a82-46b0-a259-4f1dd6d5bc7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:31.017696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b17f4-2a82-46b0-a259-4f1dd6d5bc7d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-405b17f4-2a82-46b0-a259-4f1dd6d5bc7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:31.041100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:31.042162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:31.043099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:31.043099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:31.043099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:31.045678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 294/591] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:31.047029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b17f4-2a82-46b0-a259-4f1dd6d5bc7d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:31.052238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e09f38-8ffa-4ef7-a6a5-a6c8a3b8f62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:31.054730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e09f38-8ffa-4ef7-a6a5-a6c8a3b8f62e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:31.055278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e09f38-8ffa-4ef7-a6a5-a6c8a3b8f62e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:31.055756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e09f38-8ffa-4ef7-a6a5-a6c8a3b8f62e None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:31.057594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e09f38-8ffa-4ef7-a6a5-a6c8a3b8f62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:31.058140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e09f38-8ffa-4ef7-a6a5-a6c8a3b8f62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:31.061941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e09f38-8ffa-4ef7-a6a5-a6c8a3b8f62e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:31.086465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 298/592] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:31.088081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e09f38-8ffa-4ef7-a6a5-a6c8a3b8f62e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:31.118150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:31.176706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b17f4-2a82-46b0-a259-4f1dd6d5bc7d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:31.220600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50250d-cc56-485b-9d4a-fd59f2a95ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:31.221622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50250d-cc56-485b-9d4a-fd59f2a95ecb None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:31.222169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50250d-cc56-485b-9d4a-fd59f2a95ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:31.222682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50250d-cc56-485b-9d4a-fd59f2a95ecb None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:31.223749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50250d-cc56-485b-9d4a-fd59f2a95ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:31.224392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50250d-cc56-485b-9d4a-fd59f2a95ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:31.226155 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50250d-cc56-485b-9d4a-fd59f2a95ecb None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:31.242912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 295/593] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:31.244841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50250d-cc56-485b-9d4a-fd59f2a95ecb None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:31.287871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e09f38-8ffa-4ef7-a6a5-a6c8a3b8f62e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:31.320365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:31.333136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04a0e2-e30c-4785-bfec-9e3ac4b98d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:31.340971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a0e2-e30c-4785-bfec-9e3ac4b98d2b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:31.340971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a0e2-e30c-4785-bfec-9e3ac4b98d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:31.340971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04a0e2-e30c-4785-bfec-9e3ac4b98d2b None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:31.340971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04a0e2-e30c-4785-bfec-9e3ac4b98d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:31.340971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04a0e2-e30c-4785-bfec-9e3ac4b98d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:31.340971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04a0e2-e30c-4785-bfec-9e3ac4b98d2b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:31.356947 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 299/594] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:31.358311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04a0e2-e30c-4785-bfec-9e3ac4b98d2b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:31.410346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50250d-cc56-485b-9d4a-fd59f2a95ecb None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:31.464928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e839f54-aa74-4697-8ed8-f995d0e592f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:31.466994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839f54-aa74-4697-8ed8-f995d0e592f0 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:31.467488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839f54-aa74-4697-8ed8-f995d0e592f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:31.467952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e839f54-aa74-4697-8ed8-f995d0e592f0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:31.488476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839f54-aa74-4697-8ed8-f995d0e592f0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:31.493165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e839f54-aa74-4697-8ed8-f995d0e592f0 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:31.498329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-5e839f54-aa74-4697-8ed8-f995d0e592f0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:31.516743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:31.517775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:31.518731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:31.518731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:31.518731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:31.518731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:31.518731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:31.518731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:31.518731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:31.518731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:31.518731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:28:31.518731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:31.521555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 296/595] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:31.522601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e839f54-aa74-4697-8ed8-f995d0e592f0 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:31.566043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04a0e2-e30c-4785-bfec-9e3ac4b98d2b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:31.642166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40235cda-100d-4ed5-83bc-e07e6137b941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:31.643076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40235cda-100d-4ed5-83bc-e07e6137b941 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:31.643622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40235cda-100d-4ed5-83bc-e07e6137b941 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:31.644071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40235cda-100d-4ed5-83bc-e07e6137b941 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:31.653019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40235cda-100d-4ed5-83bc-e07e6137b941 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:31.655112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40235cda-100d-4ed5-83bc-e07e6137b941 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-40235cda-100d-4ed5-83bc-e07e6137b941 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:31.668893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:31.670164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:31.671114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:31.671114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:31.671114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:31.671114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:31.671114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:31.671114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:31.671114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:31.671114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:31.671552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e839f54-aa74-4697-8ed8-f995d0e592f0 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:31.673457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 300/596] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:31.674484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40235cda-100d-4ed5-83bc-e07e6137b941 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:31.692376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:31.757719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4278e-7b75-4037-9d74-36c137403e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:31.759280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4278e-7b75-4037-9d74-36c137403e6b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:31.760724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4278e-7b75-4037-9d74-36c137403e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:31.761192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4278e-7b75-4037-9d74-36c137403e6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:31.778075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4278e-7b75-4037-9d74-36c137403e6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:31.781179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4278e-7b75-4037-9d74-36c137403e6b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-50b4278e-7b75-4037-9d74-36c137403e6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:31.797199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:31.798832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:31.801267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:31.801267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:31.801267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:31.801267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:31.801267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:31.801267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:31.801267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:31.801267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:31.803381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 297/597] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:31.804589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4278e-7b75-4037-9d74-36c137403e6b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:31.847056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40235cda-100d-4ed5-83bc-e07e6137b941 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:31.896077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb85e78-d671-4a20-a730-0faf24007544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:31.896916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb85e78-d671-4a20-a730-0faf24007544 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:31.897259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb85e78-d671-4a20-a730-0faf24007544 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:31.897597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb85e78-d671-4a20-a730-0faf24007544 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:31.898568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb85e78-d671-4a20-a730-0faf24007544 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:31.898941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb85e78-d671-4a20-a730-0faf24007544 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:31.901561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb85e78-d671-4a20-a730-0faf24007544 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:31.903133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:31.928795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 301/598] 10.222.0.83 () {56 vars in 1139 bytes} [Mon Aug 29 21:28:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:31.930423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb85e78-d671-4a20-a730-0faf24007544 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:32.008810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4278e-7b75-4037-9d74-36c137403e6b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:32.060546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb85e78-d671-4a20-a730-0faf24007544 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:32.083738 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399ba1e-9582-402e-a9f7-016e0673e81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:32.085294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399ba1e-9582-402e-a9f7-016e0673e81f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:32.086256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399ba1e-9582-402e-a9f7-016e0673e81f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:32.087119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399ba1e-9582-402e-a9f7-016e0673e81f None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:32.088898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399ba1e-9582-402e-a9f7-016e0673e81f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:32.089695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399ba1e-9582-402e-a9f7-016e0673e81f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:32.092631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399ba1e-9582-402e-a9f7-016e0673e81f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:32.128106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 298/599] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:32.130301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399ba1e-9582-402e-a9f7-016e0673e81f None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:32.133970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677437d-ce9c-418c-84c9-d37ba3965e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:32.135277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677437d-ce9c-418c-84c9-d37ba3965e63 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:32.135844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677437d-ce9c-418c-84c9-d37ba3965e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:32.136292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677437d-ce9c-418c-84c9-d37ba3965e63 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:32.137803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677437d-ce9c-418c-84c9-d37ba3965e63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:32.138430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677437d-ce9c-418c-84c9-d37ba3965e63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:32.141080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677437d-ce9c-418c-84c9-d37ba3965e63 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:32.172650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 302/600] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:32.174493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677437d-ce9c-418c-84c9-d37ba3965e63 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:32.191720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:32.283584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:32.341126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399ba1e-9582-402e-a9f7-016e0673e81f None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:32.380963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677437d-ce9c-418c-84c9-d37ba3965e63 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:32.412165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a48d-e2a0-4fbf-adb3-cd733d46fde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:32.413691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a48d-e2a0-4fbf-adb3-cd733d46fde3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:32.414434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a48d-e2a0-4fbf-adb3-cd733d46fde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:32.415153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a48d-e2a0-4fbf-adb3-cd733d46fde3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:32.435998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110a48d-e2a0-4fbf-adb3-cd733d46fde3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:32.439052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110a48d-e2a0-4fbf-adb3-cd733d46fde3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:32.450914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc4611-ef8b-4e1a-9153-047edb4fb379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:32.452115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc4611-ef8b-4e1a-9153-047edb4fb379 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:32.452653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc4611-ef8b-4e1a-9153-047edb4fb379 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:32.453124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc4611-ef8b-4e1a-9153-047edb4fb379 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/07be3fbf45dc407ba3b6ad4d1e6ea042/roles/987f120590e04a9aa6b494c08604a0cd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-a110a48d-e2a0-4fbf-adb3-cd733d46fde3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:32.472246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:32.473945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:32.475521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:32.475521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:32.475521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:32.479732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 299/601] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:32.481681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a48d-e2a0-4fbf-adb3-cd733d46fde3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:32.490865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc4611-ef8b-4e1a-9153-047edb4fb379 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=07be3fbf45dc407ba3b6ad4d1e6ea042, role_id=987f120590e04a9aa6b494c08604a0cd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:32.493689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc4611-ef8b-4e1a-9153-047edb4fb379 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:32.628625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 303/602] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:28:32 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/07be3fbf45dc407ba3b6ad4d1e6ea042/roles/987f120590e04a9aa6b494c08604a0cd => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:28:32.628625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc4611-ef8b-4e1a-9153-047edb4fb379 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:32.708674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:32.772536 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a48d-e2a0-4fbf-adb3-cd733d46fde3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:32.896299 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc4611-ef8b-4e1a-9153-047edb4fb379 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:32.899160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:32.918482 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db385813-7a82-448e-a570-2e079c37b449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:32.919523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db385813-7a82-448e-a570-2e079c37b449 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:32.919977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db385813-7a82-448e-a570-2e079c37b449 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:32.920447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db385813-7a82-448e-a570-2e079c37b449 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/edf63df08ae14d09b5cbdb102d6609ec/roles/987f120590e04a9aa6b494c08604a0cd` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:32.950512 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db385813-7a82-448e-a570-2e079c37b449 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=edf63df08ae14d09b5cbdb102d6609ec, role_id=987f120590e04a9aa6b494c08604a0cd)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:32.953621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db385813-7a82-448e-a570-2e079c37b449 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:32.965306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd34e14-9c84-4a41-8aea-873f086dfbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:32.966372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd34e14-9c84-4a41-8aea-873f086dfbb4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:32.966851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd34e14-9c84-4a41-8aea-873f086dfbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:32.967310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd34e14-9c84-4a41-8aea-873f086dfbb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:32.968681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd34e14-9c84-4a41-8aea-873f086dfbb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:32.969206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd34e14-9c84-4a41-8aea-873f086dfbb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:32.972105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd34e14-9c84-4a41-8aea-873f086dfbb4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:32.994316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 304/603] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:32.996414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c372b-d3f9-48b8-adad-e6a565266247 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:32.997012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c372b-d3f9-48b8-adad-e6a565266247 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:32.997508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c372b-d3f9-48b8-adad-e6a565266247 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:33.004621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 305/604] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:33.004621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a487-ee4c-4cc4-b217-f5b03f69b340 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:33.004621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a487-ee4c-4cc4-b217-f5b03f69b340 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:33.004621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a487-ee4c-4cc4-b217-f5b03f69b340 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:33.007750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 306/605] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:33.011036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028a487-ee4c-4cc4-b217-f5b03f69b340 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:33.110876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 300/606] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:28:32 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/edf63df08ae14d09b5cbdb102d6609ec/roles/987f120590e04a9aa6b494c08604a0cd => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:28:33.112811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedac11-7578-48e6-8620-abce347e8163 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:33.113328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedac11-7578-48e6-8620-abce347e8163 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:33.113643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedac11-7578-48e6-8620-abce347e8163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:33.138270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0fedac11-7578-48e6-8620-abce347e8163 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:33.139864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0fedac11-7578-48e6-8620-abce347e8163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:33.267293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 301/607] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:33.269125 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabdeb8-6502-4351-ae2d-bac20fcb3963 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:33.269534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabdeb8-6502-4351-ae2d-bac20fcb3963 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:33.269986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabdeb8-6502-4351-ae2d-bac20fcb3963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:33.285745 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028a487-ee4c-4cc4-b217-f5b03f69b340 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:33.320455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9aabdeb8-6502-4351-ae2d-bac20fcb3963 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:33.321947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9aabdeb8-6502-4351-ae2d-bac20fcb3963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:33.367745 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368c9a-afe7-43f0-8139-dd32e075aeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:33.369398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368c9a-afe7-43f0-8139-dd32e075aeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:33.369895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368c9a-afe7-43f0-8139-dd32e075aeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:33.370379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a368c9a-afe7-43f0-8139-dd32e075aeb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:33.385092 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a368c9a-afe7-43f0-8139-dd32e075aeb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:33.388066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a368c9a-afe7-43f0-8139-dd32e075aeb9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-8a368c9a-afe7-43f0-8139-dd32e075aeb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:33.412264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:33.413879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:33.416139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:33.416139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:33.416139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:33.416139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:33.416139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:33.416139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:33.416139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:33.416139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:33.416139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 307/608] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 407 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:33.424835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368c9a-afe7-43f0-8139-dd32e075aeb9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:33.455224 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:33.478013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:33.479849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 302/609] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:33.633246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a368c9a-afe7-43f0-8139-dd32e075aeb9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:33.640067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabdeb8-6502-4351-ae2d-bac20fcb3963 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:33.707747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9138699-6b31-4dc1-9125-f76d35aa913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:33.712066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9138699-6b31-4dc1-9125-f76d35aa913b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:33.712984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9138699-6b31-4dc1-9125-f76d35aa913b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:33.713713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9138699-6b31-4dc1-9125-f76d35aa913b None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:33.717516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9138699-6b31-4dc1-9125-f76d35aa913b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:33.720135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9138699-6b31-4dc1-9125-f76d35aa913b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:33.723142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9138699-6b31-4dc1-9125-f76d35aa913b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:33.786683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 308/610] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:33.796920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9138699-6b31-4dc1-9125-f76d35aa913b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:33.886296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabdeb8-6502-4351-ae2d-bac20fcb3963 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:33.952895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b9cd8-f522-4edb-a9dd-11aecf2749f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:33.954406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b9cd8-f522-4edb-a9dd-11aecf2749f2 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:33.955145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b9cd8-f522-4edb-a9dd-11aecf2749f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:33.955898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b9cd8-f522-4edb-a9dd-11aecf2749f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:33.976777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b9cd8-f522-4edb-a9dd-11aecf2749f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-c78b9cd8-f522-4edb-a9dd-11aecf2749f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:33.994312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:33.997839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:33.999360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 303/611] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:34.012245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b9cd8-f522-4edb-a9dd-11aecf2749f2 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:34.092747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:34.118406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9138699-6b31-4dc1-9125-f76d35aa913b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:34.142767 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:34.178060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d2725-5681-44c7-a08f-0fc47337d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:34.179115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d2725-5681-44c7-a08f-0fc47337d0f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:34.179632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d2725-5681-44c7-a08f-0fc47337d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:34.180066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d2725-5681-44c7-a08f-0fc47337d0f1 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/2adcc3ba3bdf4b92bd719f60e0b263ed/roles/987f120590e04a9aa6b494c08604a0cd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:34.217474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d2725-5681-44c7-a08f-0fc47337d0f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=2adcc3ba3bdf4b92bd719f60e0b263ed, role_id=987f120590e04a9aa6b494c08604a0cd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:34.221674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d2725-5681-44c7-a08f-0fc47337d0f1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:34.251785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b9cd8-f522-4edb-a9dd-11aecf2749f2 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:34.326553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa664d5f-7b72-4f83-9309-bd9af075b098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:34.327562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa664d5f-7b72-4f83-9309-bd9af075b098 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:34.328119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa664d5f-7b72-4f83-9309-bd9af075b098 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:34.328613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa664d5f-7b72-4f83-9309-bd9af075b098 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:34.330096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa664d5f-7b72-4f83-9309-bd9af075b098 None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:34.336828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa664d5f-7b72-4f83-9309-bd9af075b098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:34.336828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa664d5f-7b72-4f83-9309-bd9af075b098 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:34.337139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 309/612] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:28:33 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/2adcc3ba3bdf4b92bd719f60e0b263ed/roles/987f120590e04a9aa6b494c08604a0cd => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:28:34.339677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d2725-5681-44c7-a08f-0fc47337d0f1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:34.374882 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 304/613] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:34.381844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa664d5f-7b72-4f83-9309-bd9af075b098 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:34.702877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa664d5f-7b72-4f83-9309-bd9af075b098 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:34.708335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d2725-5681-44c7-a08f-0fc47337d0f1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:34.737912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:34.810863 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a6236-051e-4d8b-8a29-8da412522f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:34.814410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a6236-051e-4d8b-8a29-8da412522f4d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:34.815414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:34.816901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a6236-051e-4d8b-8a29-8da412522f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:34.818857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a6236-051e-4d8b-8a29-8da412522f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:34.839304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f877-b692-4035-a4e0-71ec66eb734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:34.840867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f877-b692-4035-a4e0-71ec66eb734c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:34.841649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f877-b692-4035-a4e0-71ec66eb734c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:34.842459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f877-b692-4035-a4e0-71ec66eb734c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:34.868059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a6236-051e-4d8b-8a29-8da412522f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:34.874074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a6236-051e-4d8b-8a29-8da412522f4d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:34.886950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3f877-b692-4035-a4e0-71ec66eb734c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-bdb3f877-b692-4035-a4e0-71ec66eb734c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:34.905307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:34.907067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:34.908721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:34.918210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 310/614] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 576 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:34.926287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f877-b692-4035-a4e0-71ec66eb734c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-2e3a6236-051e-4d8b-8a29-8da412522f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:34.931750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:34.933576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:34.936891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:34.936891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:34.936891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:34.936891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 305/615] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 554 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:34.942663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a6236-051e-4d8b-8a29-8da412522f4d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:35.315468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f877-b692-4035-a4e0-71ec66eb734c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:35.330914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a6236-051e-4d8b-8a29-8da412522f4d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:35.433752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d9041-1898-4840-a78e-67770573b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:35.434758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9041-1898-4840-a78e-67770573b312 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:35.435319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9041-1898-4840-a78e-67770573b312 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:35.435771 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9041-1898-4840-a78e-67770573b312 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:35.439919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d9041-1898-4840-a78e-67770573b312 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:35.440459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d9041-1898-4840-a78e-67770573b312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:35.443027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d9041-1898-4840-a78e-67770573b312 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:35.448001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f894bb3-38d0-4462-8781-7e18e0d3c219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:35.449040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f894bb3-38d0-4462-8781-7e18e0d3c219 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:35.449528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f894bb3-38d0-4462-8781-7e18e0d3c219 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:35.450024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f894bb3-38d0-4462-8781-7e18e0d3c219 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:35.450910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f894bb3-38d0-4462-8781-7e18e0d3c219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:35.451450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f894bb3-38d0-4462-8781-7e18e0d3c219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:35.453118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f894bb3-38d0-4462-8781-7e18e0d3c219 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:35.460316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 311/616] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:35.474956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d9041-1898-4840-a78e-67770573b312 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:35.481930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 306/617] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:35.493621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f894bb3-38d0-4462-8781-7e18e0d3c219 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:35.567876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:35.603074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:35.702524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d9041-1898-4840-a78e-67770573b312 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:35.794254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f894bb3-38d0-4462-8781-7e18e0d3c219 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:35.835056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a840ff9-074b-4ddf-8e24-cf1873a4f88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:35.836990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a840ff9-074b-4ddf-8e24-cf1873a4f88a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:35.838187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a840ff9-074b-4ddf-8e24-cf1873a4f88a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:35.840417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a840ff9-074b-4ddf-8e24-cf1873a4f88a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:35.878990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a840ff9-074b-4ddf-8e24-cf1873a4f88a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:35.883940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a840ff9-074b-4ddf-8e24-cf1873a4f88a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:35.925206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a434321-a537-4f5e-94da-f749c79b3350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:35.925883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434321-a537-4f5e-94da-f749c79b3350 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:35.926165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434321-a537-4f5e-94da-f749c79b3350 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:35.926439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a434321-a537-4f5e-94da-f749c79b3350 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-8a840ff9-074b-4ddf-8e24-cf1873a4f88a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:35.933085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:35.934790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:35.936512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:35.936512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:35.936512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:35.942257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 312/618] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:35.947873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a840ff9-074b-4ddf-8e24-cf1873a4f88a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:35.952018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a434321-a537-4f5e-94da-f749c79b3350 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:35.955983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a434321-a537-4f5e-94da-f749c79b3350 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-9a434321-a537-4f5e-94da-f749c79b3350 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:35.968785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:35.970478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 307/619] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:28:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342ac9-4cdb-4ab6-8ca6-ac5df5baca5a None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:35.972228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342ac9-4cdb-4ab6-8ca6-ac5df5baca5a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:35.973611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8342ac9-4cdb-4ab6-8ca6-ac5df5baca5a None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:35.980594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 308/620] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:35.980594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8342ac9-4cdb-4ab6-8ca6-ac5df5baca5a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:36.157320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a840ff9-074b-4ddf-8e24-cf1873a4f88a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:36.170515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:36.175862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:36.195619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8342ac9-4cdb-4ab6-8ca6-ac5df5baca5a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:36.247343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46477e5f-5220-4308-8743-e73f3740baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:36.248558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46477e5f-5220-4308-8743-e73f3740baa2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:36.249047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46477e5f-5220-4308-8743-e73f3740baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:36.249443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4054a3-2644-46b9-b632-b06b6517d749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:36.249610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46477e5f-5220-4308-8743-e73f3740baa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:36.250066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4054a3-2644-46b9-b632-b06b6517d749 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:36.250344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4054a3-2644-46b9-b632-b06b6517d749 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:36.250611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4054a3-2644-46b9-b632-b06b6517d749 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:36.250764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46477e5f-5220-4308-8743-e73f3740baa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:36.251185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46477e5f-5220-4308-8743-e73f3740baa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:36.251631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4054a3-2644-46b9-b632-b06b6517d749 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:36.251917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4054a3-2644-46b9-b632-b06b6517d749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:36.253410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4054a3-2644-46b9-b632-b06b6517d749 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:36.254184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46477e5f-5220-4308-8743-e73f3740baa2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:36.278680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 313/621] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:36.281523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e9fb-0112-4ea0-8176-76a4ce399b58 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:36.282123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e9fb-0112-4ea0-8176-76a4ce399b58 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:36.282692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2e9fb-0112-4ea0-8176-76a4ce399b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:36.292610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 309/622] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 21:28:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:36.295405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d8cb-b3ad-4b16-ae79-9a162af64649 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:36.296248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d8cb-b3ad-4b16-ae79-9a162af64649 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:36.296784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d8cb-b3ad-4b16-ae79-9a162af64649 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:36.305986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 310/623] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:36.305986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25d8cb-b3ad-4b16-ae79-9a162af64649 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:36.320977 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2ae2e9fb-0112-4ea0-8176-76a4ce399b58 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:36.323242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2ae2e9fb-0112-4ea0-8176-76a4ce399b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:36.468682 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 314/624] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:36.470764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2e9fb-0112-4ea0-8176-76a4ce399b58 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:36.521099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25d8cb-b3ad-4b16-ae79-9a162af64649 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:36.608412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc2595-7d99-4865-86d8-a2bf7daad2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:36.609514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc2595-7d99-4865-86d8-a2bf7daad2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:36.610354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc2595-7d99-4865-86d8-a2bf7daad2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:36.610826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc2595-7d99-4865-86d8-a2bf7daad2b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:36.628320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc2595-7d99-4865-86d8-a2bf7daad2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:36.631167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc2595-7d99-4865-86d8-a2bf7daad2b1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-d0cc2595-7d99-4865-86d8-a2bf7daad2b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:36.662176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:36.664017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 311/625] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 21:28:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:36.666845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11329ad-e0ca-4e64-b59d-019aba430ec2 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:36.669373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11329ad-e0ca-4e64-b59d-019aba430ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:36.669373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11329ad-e0ca-4e64-b59d-019aba430ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:36.680822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:36.685778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:36.699089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2e9fb-0112-4ea0-8176-76a4ce399b58 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:36.712047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-f11329ad-e0ca-4e64-b59d-019aba430ec2 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:36.714541 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f11329ad-e0ca-4e64-b59d-019aba430ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:36.781195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b252e89-768c-4e01-99eb-ef1a2179cecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:36.782275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252e89-768c-4e01-99eb-ef1a2179cecf None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:36.782735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252e89-768c-4e01-99eb-ef1a2179cecf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:36.783454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252e89-768c-4e01-99eb-ef1a2179cecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:36.805734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b252e89-768c-4e01-99eb-ef1a2179cecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:36.809617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b252e89-768c-4e01-99eb-ef1a2179cecf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1b252e89-768c-4e01-99eb-ef1a2179cecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:36.843076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:36.845719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:36.847508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:36.847508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:36.847508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:36.847508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 315/626] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:36.847508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b252e89-768c-4e01-99eb-ef1a2179cecf None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:36.877405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 312/627] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:36.878585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11329ad-e0ca-4e64-b59d-019aba430ec2 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:37.099022 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11329ad-e0ca-4e64-b59d-019aba430ec2 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:37.116965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b252e89-768c-4e01-99eb-ef1a2179cecf None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:37.151519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:37.159185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c236e52-30c1-4064-a923-006bf8be1697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:37.160337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c236e52-30c1-4064-a923-006bf8be1697 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:37.160594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c236e52-30c1-4064-a923-006bf8be1697 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:37.161056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c236e52-30c1-4064-a923-006bf8be1697 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:37.162114 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c236e52-30c1-4064-a923-006bf8be1697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:37.162501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c236e52-30c1-4064-a923-006bf8be1697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:37.166406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c236e52-30c1-4064-a923-006bf8be1697 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:37.166540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c42b7d-0e0c-48c4-ac66-80561d5e4ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:37.167313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c42b7d-0e0c-48c4-ac66-80561d5e4ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:37.167737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c42b7d-0e0c-48c4-ac66-80561d5e4ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:37.168149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c42b7d-0e0c-48c4-ac66-80561d5e4ce8 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:37.169088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c42b7d-0e0c-48c4-ac66-80561d5e4ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:37.169570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c42b7d-0e0c-48c4-ac66-80561d5e4ce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:37.171644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c42b7d-0e0c-48c4-ac66-80561d5e4ce8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:37.189124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 313/628] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:37.190875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c236e52-30c1-4064-a923-006bf8be1697 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:37.194954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 316/629] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 21:28:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:37.203870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c42b7d-0e0c-48c4-ac66-80561d5e4ce8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:37.223841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:37.394169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c236e52-30c1-4064-a923-006bf8be1697 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:37.424918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c42b7d-0e0c-48c4-ac66-80561d5e4ce8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:37.442682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a8fda-5379-43c9-91e4-5e10d4530f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:37.443796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a8fda-5379-43c9-91e4-5e10d4530f0c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:37.444351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a8fda-5379-43c9-91e4-5e10d4530f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:37.445133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a8fda-5379-43c9-91e4-5e10d4530f0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:37.460198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a8fda-5379-43c9-91e4-5e10d4530f0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-d23a8fda-5379-43c9-91e4-5e10d4530f0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:37.466638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:37.468745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:37.470380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:37.471657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 314/630] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:37.472811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a8fda-5379-43c9-91e4-5e10d4530f0c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:37.496661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbff48f-6443-4836-8e73-5a44b4c7ba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:37.497678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbff48f-6443-4836-8e73-5a44b4c7ba36 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:37.498138 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbff48f-6443-4836-8e73-5a44b4c7ba36 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:37.498574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbff48f-6443-4836-8e73-5a44b4c7ba36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:37.584206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:37.637034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbff48f-6443-4836-8e73-5a44b4c7ba36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:37.639997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbff48f-6443-4836-8e73-5a44b4c7ba36 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:37.661931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:37.672225 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a8fda-5379-43c9-91e4-5e10d4530f0c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:37.726336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4710e-21f6-4cb0-9afa-938ccf53abea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:37.727375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4710e-21f6-4cb0-9afa-938ccf53abea None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:37.727861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4710e-21f6-4cb0-9afa-938ccf53abea None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:37.728337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4710e-21f6-4cb0-9afa-938ccf53abea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:37.743621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4710e-21f6-4cb0-9afa-938ccf53abea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:37.746428 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4710e-21f6-4cb0-9afa-938ccf53abea None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-56d4710e-21f6-4cb0-9afa-938ccf53abea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:37.770340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:37.771362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:37.772285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:37.772285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:37.772285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:37.772285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:37.772285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:37.772285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:37.772285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:37.772285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:37.773535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 315/631] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:37.774435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4710e-21f6-4cb0-9afa-938ccf53abea None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:37.837506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 317/632] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:37.838898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbff48f-6443-4836-8e73-5a44b4c7ba36 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:37.946386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4710e-21f6-4cb0-9afa-938ccf53abea None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:37.969496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:38.000019 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db21a8-80ac-493b-8ae6-09955d1d8fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:38.000895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db21a8-80ac-493b-8ae6-09955d1d8fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:38.001286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db21a8-80ac-493b-8ae6-09955d1d8fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:38.001933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db21a8-80ac-493b-8ae6-09955d1d8fa0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:38.021148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9db21a8-80ac-493b-8ae6-09955d1d8fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-a9db21a8-80ac-493b-8ae6-09955d1d8fa0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:38.027411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:38.029197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:38.030691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 316/633] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:38.031934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db21a8-80ac-493b-8ae6-09955d1d8fa0 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:38.039014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbff48f-6443-4836-8e73-5a44b4c7ba36 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:38.050131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:38.095933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de39004-8b36-4f69-8caa-9311f7d66ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:38.096934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de39004-8b36-4f69-8caa-9311f7d66ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:38.097328 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de39004-8b36-4f69-8caa-9311f7d66ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:38.097724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de39004-8b36-4f69-8caa-9311f7d66ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:38.098674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de39004-8b36-4f69-8caa-9311f7d66ee4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:38.099084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de39004-8b36-4f69-8caa-9311f7d66ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:38.101110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de39004-8b36-4f69-8caa-9311f7d66ee4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:38.111468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 318/634] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:38.119655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b2bd3-42f2-4ccf-a1ad-6adab32fd2f3 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:38.119655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b2bd3-42f2-4ccf-a1ad-6adab32fd2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:38.119655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b2bd3-42f2-4ccf-a1ad-6adab32fd2f3 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:38.119655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 319/635] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:38.119655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b2bd3-42f2-4ccf-a1ad-6adab32fd2f3 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:38.203482 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db21a8-80ac-493b-8ae6-09955d1d8fa0 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:38.265126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e13b0-4014-4573-bff5-eea8ef9279b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:38.266085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e13b0-4014-4573-bff5-eea8ef9279b2 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:38.266524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e13b0-4014-4573-bff5-eea8ef9279b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:38.266893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e13b0-4014-4573-bff5-eea8ef9279b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:38.268069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e13b0-4014-4573-bff5-eea8ef9279b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:38.268567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e13b0-4014-4573-bff5-eea8ef9279b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:38.271139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e13b0-4014-4573-bff5-eea8ef9279b2 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:38.287010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 317/636] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:38.288414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e13b0-4014-4573-bff5-eea8ef9279b2 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:38.308806 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b2bd3-42f2-4ccf-a1ad-6adab32fd2f3 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:38.332422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:38.374558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4237b-089f-456e-b401-f4a924c6c9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:38.375489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4237b-089f-456e-b401-f4a924c6c9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:38.375777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4237b-089f-456e-b401-f4a924c6c9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:38.376252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4237b-089f-456e-b401-f4a924c6c9d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:38.390405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4237b-089f-456e-b401-f4a924c6c9d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:38.392229 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4237b-089f-456e-b401-f4a924c6c9d6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-18e4237b-089f-456e-b401-f4a924c6c9d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:38.410218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:38.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:38.413872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:38.413872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:38.413872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:38.413872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 320/637] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:38.413872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4237b-089f-456e-b401-f4a924c6c9d6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:38.439954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:38.464865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e13b0-4014-4573-bff5-eea8ef9279b2 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:38.517986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441375e3-cce3-45ac-b98e-d62dd523ef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:38.518659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441375e3-cce3-45ac-b98e-d62dd523ef56 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:38.518932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441375e3-cce3-45ac-b98e-d62dd523ef56 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:38.519205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441375e3-cce3-45ac-b98e-d62dd523ef56 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:38.520004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441375e3-cce3-45ac-b98e-d62dd523ef56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:38.520309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441375e3-cce3-45ac-b98e-d62dd523ef56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:38.521868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441375e3-cce3-45ac-b98e-d62dd523ef56 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:38.532535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 318/638] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:38.534742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910eda6-4e0e-4e5a-9827-337dec102877 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:38.535217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910eda6-4e0e-4e5a-9827-337dec102877 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:38.535694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910eda6-4e0e-4e5a-9827-337dec102877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:38.563333 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-f910eda6-4e0e-4e5a-9827-337dec102877 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:38.564734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f910eda6-4e0e-4e5a-9827-337dec102877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:38.569817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4237b-089f-456e-b401-f4a924c6c9d6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:38.612297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eb368-c2e5-47cc-bedc-fdf62980042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:38.613327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eb368-c2e5-47cc-bedc-fdf62980042f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:38.613867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eb368-c2e5-47cc-bedc-fdf62980042f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:38.614295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eb368-c2e5-47cc-bedc-fdf62980042f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:38.631424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299eb368-c2e5-47cc-bedc-fdf62980042f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:38.633316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299eb368-c2e5-47cc-bedc-fdf62980042f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-299eb368-c2e5-47cc-bedc-fdf62980042f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:38.652858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:38.654603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:38.656958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:38.656958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:38.656958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:38.656958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 321/639] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:38.656958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eb368-c2e5-47cc-bedc-fdf62980042f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:38.660953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 319/640] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:38.662089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910eda6-4e0e-4e5a-9827-337dec102877 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:38.704868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:38.796403 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:38.830751 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910eda6-4e0e-4e5a-9827-337dec102877 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:38.856537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eb368-c2e5-47cc-bedc-fdf62980042f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:38.875322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a6a10-8f31-4175-b3e2-b4ea5bc5846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:38.875954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a6a10-8f31-4175-b3e2-b4ea5bc5846d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:38.876256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a6a10-8f31-4175-b3e2-b4ea5bc5846d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:38.876760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a6a10-8f31-4175-b3e2-b4ea5bc5846d None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:38.877503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a6a10-8f31-4175-b3e2-b4ea5bc5846d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:38.877811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a6a10-8f31-4175-b3e2-b4ea5bc5846d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:38.879242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a6a10-8f31-4175-b3e2-b4ea5bc5846d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:38.899893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 320/641] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:38.899893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a6a10-8f31-4175-b3e2-b4ea5bc5846d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:38.927463 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18abb7-8e1a-4871-83b4-fac5d3109447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:38.928432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18abb7-8e1a-4871-83b4-fac5d3109447 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:38.928850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18abb7-8e1a-4871-83b4-fac5d3109447 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:38.929213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18abb7-8e1a-4871-83b4-fac5d3109447 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/87128016ec014aa8b8f2fcc8ecf1037d/roles/987f120590e04a9aa6b494c08604a0cd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:38.949691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18abb7-8e1a-4871-83b4-fac5d3109447 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=87128016ec014aa8b8f2fcc8ecf1037d, role_id=987f120590e04a9aa6b494c08604a0cd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:38.951169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18abb7-8e1a-4871-83b4-fac5d3109447 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:39.011567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:39.028142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a6a10-8f31-4175-b3e2-b4ea5bc5846d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:39.063473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 322/642] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:28:38 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/87128016ec014aa8b8f2fcc8ecf1037d/roles/987f120590e04a9aa6b494c08604a0cd => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:28:39.064922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18abb7-8e1a-4871-83b4-fac5d3109447 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:39.075700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc8823-20fe-4d6b-b42b-1b538753d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:39.076587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8823-20fe-4d6b-b42b-1b538753d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:39.077427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8823-20fe-4d6b-b42b-1b538753d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:39.077730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8823-20fe-4d6b-b42b-1b538753d0d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:39.092935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc8823-20fe-4d6b-b42b-1b538753d0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:39.094922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc8823-20fe-4d6b-b42b-1b538753d0d2 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-8bfc8823-20fe-4d6b-b42b-1b538753d0d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:39.119331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:39.120545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:39.121489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:39.121489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:39.121489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:39.121708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 321/643] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:39.122631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc8823-20fe-4d6b-b42b-1b538753d0d2 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:39.267165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18abb7-8e1a-4871-83b4-fac5d3109447 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:39.321198 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:39.337078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc8823-20fe-4d6b-b42b-1b538753d0d2 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:39.342864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77224d02-a389-4f01-aab7-28e2f721fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:39.344634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77224d02-a389-4f01-aab7-28e2f721fc4a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:39.344634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77224d02-a389-4f01-aab7-28e2f721fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:39.344973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77224d02-a389-4f01-aab7-28e2f721fc4a None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:39.345917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77224d02-a389-4f01-aab7-28e2f721fc4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:39.346424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77224d02-a389-4f01-aab7-28e2f721fc4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:39.349026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77224d02-a389-4f01-aab7-28e2f721fc4a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:39.377920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 323/644] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:39.377920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77224d02-a389-4f01-aab7-28e2f721fc4a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:39.417203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db3df1-c5a9-4ad1-a13c-fa771b5207a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:39.418307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db3df1-c5a9-4ad1-a13c-fa771b5207a8 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:39.418817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db3df1-c5a9-4ad1-a13c-fa771b5207a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:39.419344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db3df1-c5a9-4ad1-a13c-fa771b5207a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:39.425260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:39.434952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db3df1-c5a9-4ad1-a13c-fa771b5207a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:39.437876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db3df1-c5a9-4ad1-a13c-fa771b5207a8 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-f4db3df1-c5a9-4ad1-a13c-fa771b5207a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:39.461870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:39.464250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:39.467936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:39.467936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:39.467936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:39.467936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:39.467936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:39.467936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:39.467936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:39.467936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:39.470002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 322/645] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:39.471599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db3df1-c5a9-4ad1-a13c-fa771b5207a8 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:39.577262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77224d02-a389-4f01-aab7-28e2f721fc4a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:39.644575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b2abb-7fda-440b-8977-d92a09f41004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:39.645635 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2abb-7fda-440b-8977-d92a09f41004 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:39.646097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2abb-7fda-440b-8977-d92a09f41004 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:39.646564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b2abb-7fda-440b-8977-d92a09f41004 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:39.657928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db3df1-c5a9-4ad1-a13c-fa771b5207a8 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:39.667012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b2abb-7fda-440b-8977-d92a09f41004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-7d6b2abb-7fda-440b-8977-d92a09f41004 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:39.676817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:39.678705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 324/646] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:39.681330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b2abb-7fda-440b-8977-d92a09f41004 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:39.711246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893492e-e6db-4a43-a7e0-219650551d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:39.712039 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893492e-e6db-4a43-a7e0-219650551d85 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:39.712187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893492e-e6db-4a43-a7e0-219650551d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:39.712407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893492e-e6db-4a43-a7e0-219650551d85 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:39.713150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893492e-e6db-4a43-a7e0-219650551d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:39.713459 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893492e-e6db-4a43-a7e0-219650551d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:39.714870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893492e-e6db-4a43-a7e0-219650551d85 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:39.729903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 323/647] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:39.730825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893492e-e6db-4a43-a7e0-219650551d85 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:39.768075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:39.819026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:39.875247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b2abb-7fda-440b-8977-d92a09f41004 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:39.901949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893492e-e6db-4a43-a7e0-219650551d85 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:39.938556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de703b2-e324-4462-8ad6-d6c6935787f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:39.939495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de703b2-e324-4462-8ad6-d6c6935787f3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:39.939939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de703b2-e324-4462-8ad6-d6c6935787f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:39.940382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de703b2-e324-4462-8ad6-d6c6935787f3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:39.953477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de703b2-e324-4462-8ad6-d6c6935787f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:39.955226 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de703b2-e324-4462-8ad6-d6c6935787f3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:39.958554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d1742-2818-4342-83f7-38f4787d9900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:39.960353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d1742-2818-4342-83f7-38f4787d9900 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:39.960998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d1742-2818-4342-83f7-38f4787d9900 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:39.961481 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d1742-2818-4342-83f7-38f4787d9900 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:39.962854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d1742-2818-4342-83f7-38f4787d9900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:39.963585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d1742-2818-4342-83f7-38f4787d9900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:39.966858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202d1742-2818-4342-83f7-38f4787d9900 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-0de703b2-e324-4462-8ad6-d6c6935787f3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:39.970258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:39.972239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:39.973814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 325/648] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:39.974966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de703b2-e324-4462-8ad6-d6c6935787f3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:39.990773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 324/649] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:39.992585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d1742-2818-4342-83f7-38f4787d9900 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:40.119483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de703b2-e324-4462-8ad6-d6c6935787f3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:40.121401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:40.168970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c57801-8fea-451f-abfa-cc8487772964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:40.170097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c57801-8fea-451f-abfa-cc8487772964 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:40.171075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c57801-8fea-451f-abfa-cc8487772964 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:40.171266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d1742-2818-4342-83f7-38f4787d9900 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:40.171556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c57801-8fea-451f-abfa-cc8487772964 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:40.172673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c57801-8fea-451f-abfa-cc8487772964 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:40.173148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c57801-8fea-451f-abfa-cc8487772964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:40.174734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c57801-8fea-451f-abfa-cc8487772964 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:40.187163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 326/650] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:40.188732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c57801-8fea-451f-abfa-cc8487772964 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:40.198528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:40.228325 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2540b3-a746-4cb9-b687-33220a385f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:40.229507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2540b3-a746-4cb9-b687-33220a385f8e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:40.229795 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2540b3-a746-4cb9-b687-33220a385f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:40.230038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2540b3-a746-4cb9-b687-33220a385f8e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:40.241389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2540b3-a746-4cb9-b687-33220a385f8e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:40.242866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2540b3-a746-4cb9-b687-33220a385f8e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-2f2540b3-a746-4cb9-b687-33220a385f8e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:40.257397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:40.259295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:40.261185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:40.261185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:40.261185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:40.261185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:40.261185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:40.261185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:40.261185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:40.261185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:40.261185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:28:40.261185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:40.263839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 325/651] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:40.264842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2540b3-a746-4cb9-b687-33220a385f8e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:40.380384 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c57801-8fea-451f-abfa-cc8487772964 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:40.436949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2540b3-a746-4cb9-b687-33220a385f8e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:40.443312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423f338-7c92-48f2-b3c8-cb051b928f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:40.444342 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f338-7c92-48f2-b3c8-cb051b928f56 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:40.444854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f338-7c92-48f2-b3c8-cb051b928f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:40.445266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f338-7c92-48f2-b3c8-cb051b928f56 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:40.446476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423f338-7c92-48f2-b3c8-cb051b928f56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:40.446893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423f338-7c92-48f2-b3c8-cb051b928f56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:40.449306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423f338-7c92-48f2-b3c8-cb051b928f56 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:40.485266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1057a-36d0-4038-a842-df78cef39ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:40.485552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 327/652] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 21:28:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:40.486855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1057a-36d0-4038-a842-df78cef39ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:40.487016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423f338-7c92-48f2-b3c8-cb051b928f56 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:40.487761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1057a-36d0-4038-a842-df78cef39ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:40.488242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1057a-36d0-4038-a842-df78cef39ad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:40.489662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1057a-36d0-4038-a842-df78cef39ad9 None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=8434659c6b164b97b5ac27fb7e4d6a26) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:40.490205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1057a-36d0-4038-a842-df78cef39ad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:40.493098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1057a-36d0-4038-a842-df78cef39ad9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:40.504727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 326/653] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:40 2022] GET /identity/v3/role_assignments?user.id=8434659c6b164b97b5ac27fb7e4d6a26&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:40.506524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1057a-36d0-4038-a842-df78cef39ad9 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:40.561022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:40.594606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:40.710610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423f338-7c92-48f2-b3c8-cb051b928f56 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:40.727203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1057a-36d0-4038-a842-df78cef39ad9 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:40.778475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8bf59-9197-48b9-88f8-6617d3b5d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:40.779651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bf59-9197-48b9-88f8-6617d3b5d6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:40.780098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bf59-9197-48b9-88f8-6617d3b5d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:40.780606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8bf59-9197-48b9-88f8-6617d3b5d6c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:40.800462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8bf59-9197-48b9-88f8-6617d3b5d6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:40.801407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba416698-c0f5-4b8e-8a42-c76fbd522be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:40.802160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba416698-c0f5-4b8e-8a42-c76fbd522be9 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:40.802569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba416698-c0f5-4b8e-8a42-c76fbd522be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:40.802977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba416698-c0f5-4b8e-8a42-c76fbd522be9 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:40.803342 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8bf59-9197-48b9-88f8-6617d3b5d6c7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:40.804110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba416698-c0f5-4b8e-8a42-c76fbd522be9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:40.804644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba416698-c0f5-4b8e-8a42-c76fbd522be9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:40.806689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba416698-c0f5-4b8e-8a42-c76fbd522be9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:40.837259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 327/654] 10.222.0.83 () {56 vars in 1137 bytes} [Mon Aug 29 21:28:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:40.837259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba416698-c0f5-4b8e-8a42-c76fbd522be9 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b3e8bf59-9197-48b9-88f8-6617d3b5d6c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:40.845844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:40.847756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:40.849607 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:40.849607 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:40.849607 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:40.853417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 328/655] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:40.855206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8bf59-9197-48b9-88f8-6617d3b5d6c7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:41.046570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:41.048034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:41.055543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba416698-c0f5-4b8e-8a42-c76fbd522be9 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:41.115292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8bf59-9197-48b9-88f8-6617d3b5d6c7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:41.129645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19052814-54c1-4045-9a36-857dfc809637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:41.130706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19052814-54c1-4045-9a36-857dfc809637 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:41.131202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19052814-54c1-4045-9a36-857dfc809637 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:41.131685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19052814-54c1-4045-9a36-857dfc809637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:41.190936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b2665-4636-42d3-a514-e6f1a29aae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:41.191962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b2665-4636-42d3-a514-e6f1a29aae8b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:41.192436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b2665-4636-42d3-a514-e6f1a29aae8b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:41.193019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b2665-4636-42d3-a514-e6f1a29aae8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:41.294225 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19052814-54c1-4045-9a36-857dfc809637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:41.297109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19052814-54c1-4045-9a36-857dfc809637 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:41.354011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b2665-4636-42d3-a514-e6f1a29aae8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:41.358550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b2665-4636-42d3-a514-e6f1a29aae8b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:41.510003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:41.524742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 328/656] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:41.526705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19052814-54c1-4045-9a36-857dfc809637 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:41.537661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:41.594706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 329/657] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:28:41.596882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b2665-4636-42d3-a514-e6f1a29aae8b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:41.744941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19052814-54c1-4045-9a36-857dfc809637 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:41.792012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b2665-4636-42d3-a514-e6f1a29aae8b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:41.801259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdfe0f-955a-4f1d-9a14-af41298d2358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:41.801880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdfe0f-955a-4f1d-9a14-af41298d2358 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:41.802159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdfe0f-955a-4f1d-9a14-af41298d2358 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:41.802410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdfe0f-955a-4f1d-9a14-af41298d2358 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:41.803073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdfe0f-955a-4f1d-9a14-af41298d2358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:41.803368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdfe0f-955a-4f1d-9a14-af41298d2358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:41.805010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacdfe0f-955a-4f1d-9a14-af41298d2358 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:41.826877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 329/658] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:41.826877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdfe0f-955a-4f1d-9a14-af41298d2358 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:41.873371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85686305-2664-4b8b-9381-50248b979fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:41.874502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85686305-2664-4b8b-9381-50248b979fca None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:41.874984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85686305-2664-4b8b-9381-50248b979fca None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:41.875472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85686305-2664-4b8b-9381-50248b979fca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:41.894645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:41.896458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85686305-2664-4b8b-9381-50248b979fca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:41.899210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85686305-2664-4b8b-9381-50248b979fca None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-85686305-2664-4b8b-9381-50248b979fca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:41.927971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:41.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:41.930569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:41.930569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:41.930569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:41.937655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 330/659] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:41.939161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85686305-2664-4b8b-9381-50248b979fca None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:41.955582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacdfe0f-955a-4f1d-9a14-af41298d2358 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:41.989291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:42.022136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e55fb-2b34-4f1c-a35b-dad5e4b60644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:42.023097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e55fb-2b34-4f1c-a35b-dad5e4b60644 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:42.023748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e55fb-2b34-4f1c-a35b-dad5e4b60644 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:42.024119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e55fb-2b34-4f1c-a35b-dad5e4b60644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:42.039274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e55fb-2b34-4f1c-a35b-dad5e4b60644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:42.040983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e55fb-2b34-4f1c-a35b-dad5e4b60644 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-7a3e55fb-2b34-4f1c-a35b-dad5e4b60644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:42.060752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:42.062624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:42.064346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:42.064346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:42.064346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:42.064346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 330/660] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:42.064853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2177-b9d3-4105-a140-bdf2a2ed851e None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:42.065732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2177-b9d3-4105-a140-bdf2a2ed851e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:42.065732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e2177-b9d3-4105-a140-bdf2a2ed851e None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:42.067781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 331/661] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:42.074947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e2177-b9d3-4105-a140-bdf2a2ed851e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:42.129228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85686305-2664-4b8b-9381-50248b979fca None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:42.189953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916e6cf-42a5-4912-b5ae-8c6c0dd36d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:42.191027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916e6cf-42a5-4912-b5ae-8c6c0dd36d21 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:42.191570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916e6cf-42a5-4912-b5ae-8c6c0dd36d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:42.191938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2916e6cf-42a5-4912-b5ae-8c6c0dd36d21 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:42.205171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916e6cf-42a5-4912-b5ae-8c6c0dd36d21 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:42.207712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2916e6cf-42a5-4912-b5ae-8c6c0dd36d21 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:42.226210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e2177-b9d3-4105-a140-bdf2a2ed851e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2916e6cf-42a5-4912-b5ae-8c6c0dd36d21 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:42.230619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:42.231622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:42.233311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 331/662] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:42.234537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916e6cf-42a5-4912-b5ae-8c6c0dd36d21 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:42.243987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:42.272904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf1922-3c8c-49bc-b343-6bb92e45440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:42.274105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1922-3c8c-49bc-b343-6bb92e45440f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:42.274526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1922-3c8c-49bc-b343-6bb92e45440f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:42.274937 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1922-3c8c-49bc-b343-6bb92e45440f None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:42.276102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf1922-3c8c-49bc-b343-6bb92e45440f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:42.276570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf1922-3c8c-49bc-b343-6bb92e45440f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:42.278603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf1922-3c8c-49bc-b343-6bb92e45440f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:42.302429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 332/663] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:42.302429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b4dcc-4554-48ae-aba3-ec095902fb0a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:42.302429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b4dcc-4554-48ae-aba3-ec095902fb0a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:42.302429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b4dcc-4554-48ae-aba3-ec095902fb0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:42.323434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-ae3b4dcc-4554-48ae-aba3-ec095902fb0a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:42.325065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ae3b4dcc-4554-48ae-aba3-ec095902fb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:42.390754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:42.422381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2916e6cf-42a5-4912-b5ae-8c6c0dd36d21 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:42.461954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 333/664] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:42.463637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b4dcc-4554-48ae-aba3-ec095902fb0a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:42.498683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57faa-23eb-425a-ae72-b5ab4313c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:42.500072 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57faa-23eb-425a-ae72-b5ab4313c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:42.501185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57faa-23eb-425a-ae72-b5ab4313c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:42.502209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce57faa-23eb-425a-ae72-b5ab4313c2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:42.503712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce57faa-23eb-425a-ae72-b5ab4313c2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:42.504541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce57faa-23eb-425a-ae72-b5ab4313c2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:42.507857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce57faa-23eb-425a-ae72-b5ab4313c2e6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:42.534335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 332/665] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:42.536697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57faa-23eb-425a-ae72-b5ab4313c2e6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:42.677314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:42.681119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b4dcc-4554-48ae-aba3-ec095902fb0a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:42.721683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b7d2f-5dd2-4e91-b84a-81c05a96893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:42.722292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b7d2f-5dd2-4e91-b84a-81c05a96893a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:42.722569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b7d2f-5dd2-4e91-b84a-81c05a96893a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:42.722839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b7d2f-5dd2-4e91-b84a-81c05a96893a None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:42.723575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b7d2f-5dd2-4e91-b84a-81c05a96893a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:42.723883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b7d2f-5dd2-4e91-b84a-81c05a96893a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:42.725328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b7d2f-5dd2-4e91-b84a-81c05a96893a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:42.752517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 334/666] 10.222.0.83 () {56 vars in 1139 bytes} [Mon Aug 29 21:28:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:42.752517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b7d2f-5dd2-4e91-b84a-81c05a96893a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:42.767172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce57faa-23eb-425a-ae72-b5ab4313c2e6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:42.829826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d72e1-08d9-4068-a43b-894cd0eaaa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:42.830763 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d72e1-08d9-4068-a43b-894cd0eaaa56 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:42.831189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d72e1-08d9-4068-a43b-894cd0eaaa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:42.831601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d72e1-08d9-4068-a43b-894cd0eaaa56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:42.840045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d72e1-08d9-4068-a43b-894cd0eaaa56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:42.842018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d72e1-08d9-4068-a43b-894cd0eaaa56 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-517d72e1-08d9-4068-a43b-894cd0eaaa56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:42.854915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:42.855958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:42.856901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:42.856901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:42.856901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:42.856901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:42.856901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:42.856901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:42.856901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:42.856901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:42.859328 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 333/667] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:42.860564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d72e1-08d9-4068-a43b-894cd0eaaa56 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:42.870913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:42.923745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b7d2f-5dd2-4e91-b84a-81c05a96893a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:42.978229 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d72e1-08d9-4068-a43b-894cd0eaaa56 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:43.000249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471521f-0cff-4597-8b49-069a45d33abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:43.001465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471521f-0cff-4597-8b49-069a45d33abf None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:43.002296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471521f-0cff-4597-8b49-069a45d33abf None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:43.002870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471521f-0cff-4597-8b49-069a45d33abf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:43.023540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471521f-0cff-4597-8b49-069a45d33abf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:43.026965 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f471521f-0cff-4597-8b49-069a45d33abf None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:43.030020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4494e2-e166-464d-92b7-707572e89cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:43.030672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4494e2-e166-464d-92b7-707572e89cef None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:43.031000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4494e2-e166-464d-92b7-707572e89cef None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:43.031246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4494e2-e166-464d-92b7-707572e89cef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-f471521f-0cff-4597-8b49-069a45d33abf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:43.048294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:43.050088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:43.051846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:43.051846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:43.051846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:43.051846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:43.051846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:43.051846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:43.051846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:43.051846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:43.051846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 335/668] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:43.052847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471521f-0cff-4597-8b49-069a45d33abf None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:43.093474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:43.159078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4494e2-e166-464d-92b7-707572e89cef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:43.160885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4494e2-e166-464d-92b7-707572e89cef None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:43.170397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:43.231983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471521f-0cff-4597-8b49-069a45d33abf None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:43.287986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1566466-0b23-4717-ac9d-66b54c86e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:43.289279 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1566466-0b23-4717-ac9d-66b54c86e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:43.289615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1566466-0b23-4717-ac9d-66b54c86e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:43.290085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1566466-0b23-4717-ac9d-66b54c86e7a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:43.291082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1566466-0b23-4717-ac9d-66b54c86e7a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:43.291415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1566466-0b23-4717-ac9d-66b54c86e7a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:43.293080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1566466-0b23-4717-ac9d-66b54c86e7a9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:43.299609 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 334/669] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:43.300345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4494e2-e166-464d-92b7-707572e89cef None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:43.315250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 336/670] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:43.316114 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1566466-0b23-4717-ac9d-66b54c86e7a9 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:43.428444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:43.446906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4494e2-e166-464d-92b7-707572e89cef None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:43.455112 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1566466-0b23-4717-ac9d-66b54c86e7a9 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:43.462464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:43.499205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71934bc-c0d2-4e67-a148-9eed5b1e6bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:43.500037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71934bc-c0d2-4e67-a148-9eed5b1e6bcd None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:43.500323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71934bc-c0d2-4e67-a148-9eed5b1e6bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:43.500633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71934bc-c0d2-4e67-a148-9eed5b1e6bcd None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:43.501407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71934bc-c0d2-4e67-a148-9eed5b1e6bcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:43.502037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71934bc-c0d2-4e67-a148-9eed5b1e6bcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:43.503475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71934bc-c0d2-4e67-a148-9eed5b1e6bcd None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:43.516459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5849ab7-08fc-4da6-82f0-70555cfc92c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:43.517555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5849ab7-08fc-4da6-82f0-70555cfc92c3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:43.518029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5849ab7-08fc-4da6-82f0-70555cfc92c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:43.518546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5849ab7-08fc-4da6-82f0-70555cfc92c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:43.519292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 337/671] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:43.519966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71934bc-c0d2-4e67-a148-9eed5b1e6bcd None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:43.539268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5849ab7-08fc-4da6-82f0-70555cfc92c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a5849ab7-08fc-4da6-82f0-70555cfc92c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:43.548401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:43.550281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 335/672] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:43.552052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5849ab7-08fc-4da6-82f0-70555cfc92c3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:43.722981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71934bc-c0d2-4e67-a148-9eed5b1e6bcd None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:43.735863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5849ab7-08fc-4da6-82f0-70555cfc92c3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:43.781201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752dcf2-b0f8-4952-994f-df2e6ae59617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:43.782142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752dcf2-b0f8-4952-994f-df2e6ae59617 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:43.782499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752dcf2-b0f8-4952-994f-df2e6ae59617 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:43.782842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752dcf2-b0f8-4952-994f-df2e6ae59617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:43.791614 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:43.793733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dca375-4fbd-47d8-b731-090148aee07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:43.794736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dca375-4fbd-47d8-b731-090148aee07d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:43.795168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dca375-4fbd-47d8-b731-090148aee07d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:43.795632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dca375-4fbd-47d8-b731-090148aee07d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:43.796942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752dcf2-b0f8-4952-994f-df2e6ae59617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:43.797257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dca375-4fbd-47d8-b731-090148aee07d None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=07be3fbf45dc407ba3b6ad4d1e6ea042) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:43.797804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dca375-4fbd-47d8-b731-090148aee07d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:43.798421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752dcf2-b0f8-4952-994f-df2e6ae59617 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:43.800330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dca375-4fbd-47d8-b731-090148aee07d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:43.808922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 336/673] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:43 2022] GET /identity/v3/role_assignments?user.id=07be3fbf45dc407ba3b6ad4d1e6ea042&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:43.809933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dca375-4fbd-47d8-b731-090148aee07d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-3752dcf2-b0f8-4952-994f-df2e6ae59617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:43.818986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:43.820476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:43.823500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:43.823500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:43.823500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:43.823500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 338/674] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:43.823500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752dcf2-b0f8-4952-994f-df2e6ae59617 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:43.866743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:43.986904 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dca375-4fbd-47d8-b731-090148aee07d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:44.024092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752dcf2-b0f8-4952-994f-df2e6ae59617 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:44.037824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30664f5-4feb-42a4-82de-7ee2f81b0a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:44.038349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30664f5-4feb-42a4-82de-7ee2f81b0a75 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:44.038632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30664f5-4feb-42a4-82de-7ee2f81b0a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:44.038908 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30664f5-4feb-42a4-82de-7ee2f81b0a75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:44.040340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30664f5-4feb-42a4-82de-7ee2f81b0a75 None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=edf63df08ae14d09b5cbdb102d6609ec) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:44.040710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30664f5-4feb-42a4-82de-7ee2f81b0a75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:44.042283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30664f5-4feb-42a4-82de-7ee2f81b0a75 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:44.054244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 337/675] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:43 2022] GET /identity/v3/role_assignments?user.id=edf63df08ae14d09b5cbdb102d6609ec&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:44.056442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8e5cb-d73c-4dc4-987b-b34ca9660b94 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:44.057518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8e5cb-d73c-4dc4-987b-b34ca9660b94 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:44.057998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8e5cb-d73c-4dc4-987b-b34ca9660b94 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:44.060823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 338/676] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:44.062146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8e5cb-d73c-4dc4-987b-b34ca9660b94 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:44.099989 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6d55-277f-47fa-a0d7-fe2479b9c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:44.100954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6d55-277f-47fa-a0d7-fe2479b9c09c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:44.101396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6d55-277f-47fa-a0d7-fe2479b9c09c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:44.102269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6d55-277f-47fa-a0d7-fe2479b9c09c None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:44.103189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6d55-277f-47fa-a0d7-fe2479b9c09c None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:44.104198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6d55-277f-47fa-a0d7-fe2479b9c09c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:44.105840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6d55-277f-47fa-a0d7-fe2479b9c09c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:44.123284 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 339/677] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:44.125749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344afb1-bd18-462c-a202-dd1a60529b53 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:44.126218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344afb1-bd18-462c-a202-dd1a60529b53 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:44.126705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344afb1-bd18-462c-a202-dd1a60529b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:44.161875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5344afb1-bd18-462c-a202-dd1a60529b53 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:44.164105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5344afb1-bd18-462c-a202-dd1a60529b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:44.245954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:44.259117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:44.269371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8e5cb-d73c-4dc4-987b-b34ca9660b94 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:44.279847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 340/678] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:44.280654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344afb1-bd18-462c-a202-dd1a60529b53 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:44.334508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589fd61-447b-4f37-a3a7-7e88e0947c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:44.335316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589fd61-447b-4f37-a3a7-7e88e0947c61 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:44.335531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589fd61-447b-4f37-a3a7-7e88e0947c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:44.336018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589fd61-447b-4f37-a3a7-7e88e0947c61 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:44.337149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589fd61-447b-4f37-a3a7-7e88e0947c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:44.337673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589fd61-447b-4f37-a3a7-7e88e0947c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:44.342091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589fd61-447b-4f37-a3a7-7e88e0947c61 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:44.365379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 339/679] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:44.374144 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589fd61-447b-4f37-a3a7-7e88e0947c61 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:44.513370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344afb1-bd18-462c-a202-dd1a60529b53 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:44.581659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589fd61-447b-4f37-a3a7-7e88e0947c61 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:44.602994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836c12b-4268-4c18-a892-d29b9f1e2df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:44.603596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836c12b-4268-4c18-a892-d29b9f1e2df9 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:44.603867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836c12b-4268-4c18-a892-d29b9f1e2df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:44.604236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836c12b-4268-4c18-a892-d29b9f1e2df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:44.633376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836c12b-4268-4c18-a892-d29b9f1e2df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:44.635735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836c12b-4268-4c18-a892-d29b9f1e2df9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:44.654736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e448958-3e4c-4a5d-ab54-23864bf26f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:44.655546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e448958-3e4c-4a5d-ab54-23864bf26f16 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:44.655844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e448958-3e4c-4a5d-ab54-23864bf26f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:44.656190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e448958-3e4c-4a5d-ab54-23864bf26f16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-3836c12b-4268-4c18-a892-d29b9f1e2df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:44.667609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:44.669508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:44.671286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:44.671286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:44.671286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:44.671604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e448958-3e4c-4a5d-ab54-23864bf26f16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:44.672519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e448958-3e4c-4a5d-ab54-23864bf26f16 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:44.672742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 341/680] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:44.685725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836c12b-4268-4c18-a892-d29b9f1e2df9 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-4e448958-3e4c-4a5d-ab54-23864bf26f16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:44.712458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:44.715930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:44.717257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:44.717257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:44.717257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:44.717257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:44.717257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:44.717257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:44.717257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:44.717257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:44.719459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 340/681] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:44.726478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e448958-3e4c-4a5d-ab54-23864bf26f16 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:44.765714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:44.798423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:44.872338 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e448958-3e4c-4a5d-ab54-23864bf26f16 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:44.915689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18b719-5c41-4225-8d62-6ef2d49cf58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:44.916361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18b719-5c41-4225-8d62-6ef2d49cf58b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:44.916685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18b719-5c41-4225-8d62-6ef2d49cf58b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:44.916956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18b719-5c41-4225-8d62-6ef2d49cf58b None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:44.917655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18b719-5c41-4225-8d62-6ef2d49cf58b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:44.917954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18b719-5c41-4225-8d62-6ef2d49cf58b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:44.919411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18b719-5c41-4225-8d62-6ef2d49cf58b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:44.934437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 341/682] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:44.935333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18b719-5c41-4225-8d62-6ef2d49cf58b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:44.963807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836c12b-4268-4c18-a892-d29b9f1e2df9 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:45.042771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519a33-5782-460c-bd8e-5fed709762ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:45.043732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519a33-5782-460c-bd8e-5fed709762ad None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:45.044206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519a33-5782-460c-bd8e-5fed709762ad None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:45.044704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6519a33-5782-460c-bd8e-5fed709762ad None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:45.045844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6519a33-5782-460c-bd8e-5fed709762ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:45.046365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6519a33-5782-460c-bd8e-5fed709762ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:45.048870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6519a33-5782-460c-bd8e-5fed709762ad None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:45.072179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 342/683] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:45.073933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519a33-5782-460c-bd8e-5fed709762ad None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:45.113471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:45.171158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18b719-5c41-4225-8d62-6ef2d49cf58b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:45.248387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc3a3-387b-40d9-95a1-adf0d64c6d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:45.249686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:45.249870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc3a3-387b-40d9-95a1-adf0d64c6d36 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:45.250291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc3a3-387b-40d9-95a1-adf0d64c6d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:45.251269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc3a3-387b-40d9-95a1-adf0d64c6d36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:45.263414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6519a33-5782-460c-bd8e-5fed709762ad None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:45.273894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffc3a3-387b-40d9-95a1-adf0d64c6d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a8ffc3a3-387b-40d9-95a1-adf0d64c6d36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:45.285687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:45.289422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 342/684] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:45.290838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc3a3-387b-40d9-95a1-adf0d64c6d36 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:45.333857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda2691-27f4-49a6-98ca-6a539ebc40cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:45.334477 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2691-27f4-49a6-98ca-6a539ebc40cb None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:45.334766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2691-27f4-49a6-98ca-6a539ebc40cb None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:45.335014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda2691-27f4-49a6-98ca-6a539ebc40cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:45.335883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda2691-27f4-49a6-98ca-6a539ebc40cb None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=2adcc3ba3bdf4b92bd719f60e0b263ed) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:45.336194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda2691-27f4-49a6-98ca-6a539ebc40cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:45.337734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda2691-27f4-49a6-98ca-6a539ebc40cb None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:45.345486 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 343/685] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:45 2022] GET /identity/v3/role_assignments?user.id=2adcc3ba3bdf4b92bd719f60e0b263ed&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:45.346406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda2691-27f4-49a6-98ca-6a539ebc40cb None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:45.474379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda2691-27f4-49a6-98ca-6a539ebc40cb None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:45.487522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc3a3-387b-40d9-95a1-adf0d64c6d36 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:45.518569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5397a-1819-4c1d-87fd-3609caacc607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:45.519188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5397a-1819-4c1d-87fd-3609caacc607 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:45.519460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5397a-1819-4c1d-87fd-3609caacc607 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:45.519820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f5397a-1819-4c1d-87fd-3609caacc607 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:45.520691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5397a-1819-4c1d-87fd-3609caacc607 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:45.520992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5397a-1819-4c1d-87fd-3609caacc607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:45.522540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f5397a-1819-4c1d-87fd-3609caacc607 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:45.533680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 344/686] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:45.539621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5397a-1819-4c1d-87fd-3609caacc607 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:45.553445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dc94a-a179-4d5f-92f9-b1c263424635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:45.554537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dc94a-a179-4d5f-92f9-b1c263424635 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:45.555103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dc94a-a179-4d5f-92f9-b1c263424635 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:45.555569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dc94a-a179-4d5f-92f9-b1c263424635 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:45.567191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:45.568428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:45.583870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dc94a-a179-4d5f-92f9-b1c263424635 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:45.591813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dc94a-a179-4d5f-92f9-b1c263424635 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-310dc94a-a179-4d5f-92f9-b1c263424635 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:45.642069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:45.643936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:45.645270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 343/687] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:28:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:45.653917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dc94a-a179-4d5f-92f9-b1c263424635 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:45.714335 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f5397a-1819-4c1d-87fd-3609caacc607 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:45.803040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f1667-ba9f-4451-a1eb-9e8888d155d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:45.805599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f1667-ba9f-4451-a1eb-9e8888d155d3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:45.806349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f1667-ba9f-4451-a1eb-9e8888d155d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:45.807070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f1667-ba9f-4451-a1eb-9e8888d155d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:45.830013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f1667-ba9f-4451-a1eb-9e8888d155d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:45.833500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f1667-ba9f-4451-a1eb-9e8888d155d3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-2c7f1667-ba9f-4451-a1eb-9e8888d155d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:45.859465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:45.861105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:45.862493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:45.862493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:45.862493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:45.865524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 345/688] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:45.871128 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f1667-ba9f-4451-a1eb-9e8888d155d3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:45.893416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dc94a-a179-4d5f-92f9-b1c263424635 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:45.934356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a220e2-26ea-4f27-8f42-c133b74bb18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:45.934953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a220e2-26ea-4f27-8f42-c133b74bb18e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:45.935229 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a220e2-26ea-4f27-8f42-c133b74bb18e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:45.935518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a220e2-26ea-4f27-8f42-c133b74bb18e None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:45.936234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a220e2-26ea-4f27-8f42-c133b74bb18e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:45.936562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a220e2-26ea-4f27-8f42-c133b74bb18e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:45.938042 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a220e2-26ea-4f27-8f42-c133b74bb18e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:45.980836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 344/689] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 21:28:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:45.982547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a220e2-26ea-4f27-8f42-c133b74bb18e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:46.045134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:46.097424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a220e2-26ea-4f27-8f42-c133b74bb18e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:46.118133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:46.138271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384897d6-7f91-44e0-99c5-eed0eda364e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:46.142105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384897d6-7f91-44e0-99c5-eed0eda364e1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:46.142105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384897d6-7f91-44e0-99c5-eed0eda364e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:46.142105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384897d6-7f91-44e0-99c5-eed0eda364e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:46.220830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384897d6-7f91-44e0-99c5-eed0eda364e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:46.222310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384897d6-7f91-44e0-99c5-eed0eda364e1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:46.232668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f1667-ba9f-4451-a1eb-9e8888d155d3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:46.285107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:46.354501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 345/690] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 21:28:46.360802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384897d6-7f91-44e0-99c5-eed0eda364e1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:46.372005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02164a-b578-47e2-9efe-9715fe33e9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:46.373074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02164a-b578-47e2-9efe-9715fe33e9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:46.373533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02164a-b578-47e2-9efe-9715fe33e9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:46.373985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02164a-b578-47e2-9efe-9715fe33e9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:46.375131 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02164a-b578-47e2-9efe-9715fe33e9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:46.375635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02164a-b578-47e2-9efe-9715fe33e9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:46.378474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02164a-b578-47e2-9efe-9715fe33e9c3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:46.424443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 346/691] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 554 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:46.430146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02164a-b578-47e2-9efe-9715fe33e9c3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:46.555096 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384897d6-7f91-44e0-99c5-eed0eda364e1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:46.608086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc48ea3-ab79-4c12-8273-858e39a87f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:46.609145 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc48ea3-ab79-4c12-8273-858e39a87f3f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:46.609661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc48ea3-ab79-4c12-8273-858e39a87f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:46.610141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc48ea3-ab79-4c12-8273-858e39a87f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:46.648371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc48ea3-ab79-4c12-8273-858e39a87f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:46.651563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc48ea3-ab79-4c12-8273-858e39a87f3f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-adc48ea3-ab79-4c12-8273-858e39a87f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:46.688008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:46.689818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:46.691377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:46.691377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:46.691377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:46.691377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 346/692] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:46.699310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc48ea3-ab79-4c12-8273-858e39a87f3f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:46.700261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02164a-b578-47e2-9efe-9715fe33e9c3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:46.710620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:46.794107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:46.800563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180323b-f633-4629-877d-e9ee23aaf3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:46.801531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180323b-f633-4629-877d-e9ee23aaf3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:46.802002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180323b-f633-4629-877d-e9ee23aaf3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:46.802555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180323b-f633-4629-877d-e9ee23aaf3f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:46.813268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180323b-f633-4629-877d-e9ee23aaf3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:46.815520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180323b-f633-4629-877d-e9ee23aaf3f4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-c180323b-f633-4629-877d-e9ee23aaf3f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:46.831997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:46.833313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:46.834460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:46.834460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:46.834460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:46.834460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:46.834460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:46.834460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:46.834460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:46.834460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:46.834460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:28:46.834460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:46.840938 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 347/693] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 21:28:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:46.842662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb846f-7bbc-4ad0-8ad6-94209f0edc23 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:46.843125 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb846f-7bbc-4ad0-8ad6-94209f0edc23 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:46.843577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb846f-7bbc-4ad0-8ad6-94209f0edc23 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:46.845448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 348/694] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:46.852157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb846f-7bbc-4ad0-8ad6-94209f0edc23 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:46.933576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc48ea3-ab79-4c12-8273-858e39a87f3f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:46.976797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb846f-7bbc-4ad0-8ad6-94209f0edc23 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:46.992469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47d88e-7ca6-4744-92e1-8a46c83f46eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:46.993114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47d88e-7ca6-4744-92e1-8a46c83f46eb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:46.993387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47d88e-7ca6-4744-92e1-8a46c83f46eb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:46.993652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47d88e-7ca6-4744-92e1-8a46c83f46eb None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:46.994906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47d88e-7ca6-4744-92e1-8a46c83f46eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:46.995206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47d88e-7ca6-4744-92e1-8a46c83f46eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:46.996660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47d88e-7ca6-4744-92e1-8a46c83f46eb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:47.015751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 347/695] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:47.017013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411958-2071-4fd6-a294-5c48a7ca3e21 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:47.017296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411958-2071-4fd6-a294-5c48a7ca3e21 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:47.017568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f411958-2071-4fd6-a294-5c48a7ca3e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:47.035657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85a026-8652-42d7-8310-27719289e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:47.036291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0f411958-2071-4fd6-a294-5c48a7ca3e21 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:47.036759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a026-8652-42d7-8310-27719289e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:47.037216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a026-8652-42d7-8310-27719289e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:47.037528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0f411958-2071-4fd6-a294-5c48a7ca3e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:47.037692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85a026-8652-42d7-8310-27719289e6f4 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:47.039001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85a026-8652-42d7-8310-27719289e6f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:47.039629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85a026-8652-42d7-8310-27719289e6f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:47.042334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85a026-8652-42d7-8310-27719289e6f4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:47.077748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 349/696] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 21:28:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:47.079997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea05f5-c6bd-479c-8a37-a79cfe7579fd None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:47.080472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea05f5-c6bd-479c-8a37-a79cfe7579fd None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:47.080977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea05f5-c6bd-479c-8a37-a79cfe7579fd None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:47.083557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 350/697] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:47.084927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea05f5-c6bd-479c-8a37-a79cfe7579fd None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:47.119697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:47.129172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 348/698] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:47.132458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f411958-2071-4fd6-a294-5c48a7ca3e21 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:47.183486 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:47.273128 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea05f5-c6bd-479c-8a37-a79cfe7579fd None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:47.305163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f411958-2071-4fd6-a294-5c48a7ca3e21 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:47.320926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a8a1c-fb50-488b-8d01-96437012ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:47.321921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a8a1c-fb50-488b-8d01-96437012ce72 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:47.322295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a8a1c-fb50-488b-8d01-96437012ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:47.323203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a8a1c-fb50-488b-8d01-96437012ce72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:47.332217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a8a1c-fb50-488b-8d01-96437012ce72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:47.333890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a8a1c-fb50-488b-8d01-96437012ce72 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-e49a8a1c-fb50-488b-8d01-96437012ce72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:47.347490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:47.349082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:47.350624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:47.350624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:47.350624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:47.350624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:47.350624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:47.350624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:47.350624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:47.350624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:47.350624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 351/699] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:47.350624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d40d7-5ff4-4a95-a157-994e55624c9b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:47.351546 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d40d7-5ff4-4a95-a157-994e55624c9b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:47.351546 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d40d7-5ff4-4a95-a157-994e55624c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:47.374407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-565d40d7-5ff4-4a95-a157-994e55624c9b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:47.375842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-565d40d7-5ff4-4a95-a157-994e55624c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:47.401976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22739c8-22fb-41de-a6b7-e1d9fbfed24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:47.404234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22739c8-22fb-41de-a6b7-e1d9fbfed24c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:47.404783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22739c8-22fb-41de-a6b7-e1d9fbfed24c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:47.405258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22739c8-22fb-41de-a6b7-e1d9fbfed24c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:47.477449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 352/700] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:47.479953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d40d7-5ff4-4a95-a157-994e55624c9b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:47.506059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:47.517472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22739c8-22fb-41de-a6b7-e1d9fbfed24c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:47.518983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22739c8-22fb-41de-a6b7-e1d9fbfed24c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:47.561991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:47.660569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 349/701] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:47.661587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22739c8-22fb-41de-a6b7-e1d9fbfed24c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:47.674260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d40d7-5ff4-4a95-a157-994e55624c9b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:47.742488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d639451-c11a-4ae4-ba34-1eec06791179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:47.744005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d639451-c11a-4ae4-ba34-1eec06791179 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:47.746987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d639451-c11a-4ae4-ba34-1eec06791179 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:47.747722 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d639451-c11a-4ae4-ba34-1eec06791179 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:47.749528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d639451-c11a-4ae4-ba34-1eec06791179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:47.750386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d639451-c11a-4ae4-ba34-1eec06791179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:47.753767 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d639451-c11a-4ae4-ba34-1eec06791179 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:47.775296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 353/702] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:47.777775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d639451-c11a-4ae4-ba34-1eec06791179 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:47.787919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:47.796104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22739c8-22fb-41de-a6b7-e1d9fbfed24c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:47.860613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a91a12-1fba-4abc-bfef-311e4b07966f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:47.861728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a91a12-1fba-4abc-bfef-311e4b07966f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:47.862245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a91a12-1fba-4abc-bfef-311e4b07966f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:47.862729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a91a12-1fba-4abc-bfef-311e4b07966f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:47.882867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a91a12-1fba-4abc-bfef-311e4b07966f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:47.885665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a91a12-1fba-4abc-bfef-311e4b07966f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b9a91a12-1fba-4abc-bfef-311e4b07966f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:47.915379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:47.917032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:47.918147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:47.918147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:47.918147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:47.918434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 350/703] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:47.919877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a91a12-1fba-4abc-bfef-311e4b07966f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:47.935601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:47.942707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d639451-c11a-4ae4-ba34-1eec06791179 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:48.017801 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2d94b-3f75-4c55-98cd-1e56aecd5967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:48.018822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2d94b-3f75-4c55-98cd-1e56aecd5967 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:48.019291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2d94b-3f75-4c55-98cd-1e56aecd5967 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:48.019820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2d94b-3f75-4c55-98cd-1e56aecd5967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:48.041925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2d94b-3f75-4c55-98cd-1e56aecd5967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:48.044638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2d94b-3f75-4c55-98cd-1e56aecd5967 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-1df2d94b-3f75-4c55-98cd-1e56aecd5967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:48.073261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:48.075132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:48.077602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:48.077602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:48.077602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:48.081813 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 354/704] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:48.083839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2d94b-3f75-4c55-98cd-1e56aecd5967 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:48.125834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a91a12-1fba-4abc-bfef-311e4b07966f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:48.192745 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28deb7-b2dc-4f06-9fe9-539efbd64735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:48.193798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28deb7-b2dc-4f06-9fe9-539efbd64735 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:48.195104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28deb7-b2dc-4f06-9fe9-539efbd64735 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:48.195569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28deb7-b2dc-4f06-9fe9-539efbd64735 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:48.196873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28deb7-b2dc-4f06-9fe9-539efbd64735 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:48.200344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28deb7-b2dc-4f06-9fe9-539efbd64735 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-cc28deb7-b2dc-4f06-9fe9-539efbd64735 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:48.223337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:48.225551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:48.235803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 351/705] 10.222.0.83 () {56 vars in 1129 bytes} [Mon Aug 29 21:28:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:48.237500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28deb7-b2dc-4f06-9fe9-539efbd64735 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:48.252916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:48.299866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2d94b-3f75-4c55-98cd-1e56aecd5967 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:48.365407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fda4-f8b7-432f-9fd7-0fd093c6bde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:48.367073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fda4-f8b7-432f-9fd7-0fd093c6bde5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:48.367575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fda4-f8b7-432f-9fd7-0fd093c6bde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:48.367983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73fda4-f8b7-432f-9fd7-0fd093c6bde5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:48.369352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73fda4-f8b7-432f-9fd7-0fd093c6bde5 None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=87128016ec014aa8b8f2fcc8ecf1037d) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:48.369862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73fda4-f8b7-432f-9fd7-0fd093c6bde5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:48.372646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73fda4-f8b7-432f-9fd7-0fd093c6bde5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:48.384726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 355/706] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:48 2022] GET /identity/v3/role_assignments?user.id=87128016ec014aa8b8f2fcc8ecf1037d&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:48.386618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fda4-f8b7-432f-9fd7-0fd093c6bde5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:48.429438 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:48.455176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28deb7-b2dc-4f06-9fe9-539efbd64735 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:48.534238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cea12-b10a-43f1-b789-012efaa82c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:48.535202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cea12-b10a-43f1-b789-012efaa82c0e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:48.535688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cea12-b10a-43f1-b789-012efaa82c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:48.536161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cea12-b10a-43f1-b789-012efaa82c0e None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:48.537434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cea12-b10a-43f1-b789-012efaa82c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:48.537967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cea12-b10a-43f1-b789-012efaa82c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:48.540789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cea12-b10a-43f1-b789-012efaa82c0e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:48.572988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 352/707] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:48.572988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cea12-b10a-43f1-b789-012efaa82c0e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:48.640093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73fda4-f8b7-432f-9fd7-0fd093c6bde5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:48.704075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21798-5678-4da1-bba6-4d4a5e3ff838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:48.704904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21798-5678-4da1-bba6-4d4a5e3ff838 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:48.705287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21798-5678-4da1-bba6-4d4a5e3ff838 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:48.705592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed21798-5678-4da1-bba6-4d4a5e3ff838 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:48.706254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21798-5678-4da1-bba6-4d4a5e3ff838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:48.706553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21798-5678-4da1-bba6-4d4a5e3ff838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:48.707961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed21798-5678-4da1-bba6-4d4a5e3ff838 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:48.718987 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:48.731613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 356/708] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:48.739042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21798-5678-4da1-bba6-4d4a5e3ff838 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:48.783719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cea12-b10a-43f1-b789-012efaa82c0e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:48.843383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:48.857343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeec89-38d4-430e-9271-aa100e777902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:48.858578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeec89-38d4-430e-9271-aa100e777902 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:48.859219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeec89-38d4-430e-9271-aa100e777902 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:48.859661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeec89-38d4-430e-9271-aa100e777902 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:48.860859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeec89-38d4-430e-9271-aa100e777902 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:48.861360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeec89-38d4-430e-9271-aa100e777902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:48.864096 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbeec89-38d4-430e-9271-aa100e777902 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:48.873163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 353/709] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 21:28:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:48.875507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117839-5fb0-4eb0-b444-9b6350165379 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:48.875992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117839-5fb0-4eb0-b444-9b6350165379 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:48.876471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117839-5fb0-4eb0-b444-9b6350165379 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:48.879732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 354/710] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:48.881002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117839-5fb0-4eb0-b444-9b6350165379 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:48.889104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed21798-5678-4da1-bba6-4d4a5e3ff838 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:48.948017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ab1dd-df70-4e1f-8cba-db30b4458424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:48.949014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ab1dd-df70-4e1f-8cba-db30b4458424 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:48.949142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ab1dd-df70-4e1f-8cba-db30b4458424 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:48.949535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ab1dd-df70-4e1f-8cba-db30b4458424 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:48.950634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ab1dd-df70-4e1f-8cba-db30b4458424 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:48.953611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ab1dd-df70-4e1f-8cba-db30b4458424 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:49.053038 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117839-5fb0-4eb0-b444-9b6350165379 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:49.056442 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 357/711] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:28:48 2022] POST /identity/v3/users => generated 254 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:28:49.058386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ab1dd-df70-4e1f-8cba-db30b4458424 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:49.126009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507e1ac-ef3b-4b39-bfaa-777a329e1024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:49.127050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507e1ac-ef3b-4b39-bfaa-777a329e1024 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:49.127817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507e1ac-ef3b-4b39-bfaa-777a329e1024 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:49.128235 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507e1ac-ef3b-4b39-bfaa-777a329e1024 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:49.131074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:49.137501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507e1ac-ef3b-4b39-bfaa-777a329e1024 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:49.139457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507e1ac-ef3b-4b39-bfaa-777a329e1024 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-2507e1ac-ef3b-4b39-bfaa-777a329e1024 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:49.153491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:49.154522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:49.155462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:49.155462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:49.155462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:49.155462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:49.155462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:49.155462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:49.155462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:49.155462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:49.158104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 355/712] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:49.159714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660400f-0224-4ac3-bda9-2e058b0097be None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:49.159995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660400f-0224-4ac3-bda9-2e058b0097be None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:49.160277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660400f-0224-4ac3-bda9-2e058b0097be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:49.184346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c660400f-0224-4ac3-bda9-2e058b0097be None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:49.185787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c660400f-0224-4ac3-bda9-2e058b0097be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:49.283658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ab1dd-df70-4e1f-8cba-db30b4458424 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:49.332666 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 356/713] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:49.334614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660400f-0224-4ac3-bda9-2e058b0097be None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:49.343952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:49.353443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9fb32-4e67-46ad-b96d-5877e4919056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:49.355123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9fb32-4e67-46ad-b96d-5877e4919056 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:49.355123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9fb32-4e67-46ad-b96d-5877e4919056 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:49.358575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9fb32-4e67-46ad-b96d-5877e4919056 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:49.358575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9fb32-4e67-46ad-b96d-5877e4919056 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:49.358575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9fb32-4e67-46ad-b96d-5877e4919056 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:49.358575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9fb32-4e67-46ad-b96d-5877e4919056 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:49.366499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 358/714] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 21:28:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:49.553845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660400f-0224-4ac3-bda9-2e058b0097be None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:49.604630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:49.625711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef9a0b-f436-48e3-a870-49b183c265c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:49.626782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef9a0b-f436-48e3-a870-49b183c265c5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:49.627463 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef9a0b-f436-48e3-a870-49b183c265c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:49.627966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef9a0b-f436-48e3-a870-49b183c265c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:49.629417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef9a0b-f436-48e3-a870-49b183c265c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:49.629990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef9a0b-f436-48e3-a870-49b183c265c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:49.632424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ef9a0b-f436-48e3-a870-49b183c265c5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:49.665114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 357/715] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:49.669837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9fb32-4e67-46ad-b96d-5877e4919056 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:49.910913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9fb32-4e67-46ad-b96d-5877e4919056 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:49.970758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef9a0b-f436-48e3-a870-49b183c265c5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:49.983747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0874b-f05b-481e-ac18-396d52b8282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:49.987504 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0874b-f05b-481e-ac18-396d52b8282e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:49.988573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0874b-f05b-481e-ac18-396d52b8282e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:49.989319 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0874b-f05b-481e-ac18-396d52b8282e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:49.991092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0874b-f05b-481e-ac18-396d52b8282e None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=8434659c6b164b97b5ac27fb7e4d6a26) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:49.991738 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0874b-f05b-481e-ac18-396d52b8282e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:49.995363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0874b-f05b-481e-ac18-396d52b8282e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:50.007110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 359/716] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:49 2022] GET /identity/v3/role_assignments?user.id=8434659c6b164b97b5ac27fb7e4d6a26&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=c0316e22a13a4034846c451753b4c14e => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:50.217369 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef9a0b-f436-48e3-a870-49b183c265c5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:50.279548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb23128-cb10-4875-aed5-d9efc82ea325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:50.280668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb23128-cb10-4875-aed5-d9efc82ea325 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:50.281145 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb23128-cb10-4875-aed5-d9efc82ea325 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:50.281628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb23128-cb10-4875-aed5-d9efc82ea325 None admin] PATH_INFO: `/v3/services/network` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:50.282692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb23128-cb10-4875-aed5-d9efc82ea325 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:50.285339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb23128-cb10-4875-aed5-d9efc82ea325 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-ccb23128-cb10-4875-aed5-d9efc82ea325 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:50.303400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:50.305194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:50.306684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 358/717] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:49 2022] GET /identity/v3/services/network => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:50.318698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0874b-f05b-481e-ac18-396d52b8282e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:50.426984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:50.517417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0874b-f05b-481e-ac18-396d52b8282e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:50.591314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0246f-cfe4-49bf-bb06-f50a4c13392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:50.592476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0246f-cfe4-49bf-bb06-f50a4c13392b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:50.593001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0246f-cfe4-49bf-bb06-f50a4c13392b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:50.593493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0246f-cfe4-49bf-bb06-f50a4c13392b None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:50.594679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0246f-cfe4-49bf-bb06-f50a4c13392b None admin] RBAC: Adding query filter params (name=network) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:50.595181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0246f-cfe4-49bf-bb06-f50a4c13392b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:50.597842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0246f-cfe4-49bf-bb06-f50a4c13392b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:50.607427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 360/718] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:28:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:50.614466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb23128-cb10-4875-aed5-d9efc82ea325 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:50.735989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:50.872100 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb23128-cb10-4875-aed5-d9efc82ea325 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:50.961898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21c2d3-90a0-4d59-a73f-fb537fb78f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:50.962972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21c2d3-90a0-4d59-a73f-fb537fb78f30 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:50.964002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21c2d3-90a0-4d59-a73f-fb537fb78f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:50.964518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21c2d3-90a0-4d59-a73f-fb537fb78f30 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:50.965780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21c2d3-90a0-4d59-a73f-fb537fb78f30 None admin] RBAC: Adding query filter params (type=network) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:50.966336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21c2d3-90a0-4d59-a73f-fb537fb78f30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:50.969167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21c2d3-90a0-4d59-a73f-fb537fb78f30 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:50.980467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 359/719] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:28:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:51.444116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab30b59-91e8-4b44-b23b-2bca222854a7 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:51.444910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab30b59-91e8-4b44-b23b-2bca222854a7 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:51.445305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab30b59-91e8-4b44-b23b-2bca222854a7 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:51.447806 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 361/720] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:51.456867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490acb5c-05e3-4d40-835c-90793e69ce5b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:51.457356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490acb5c-05e3-4d40-835c-90793e69ce5b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:51.457842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490acb5c-05e3-4d40-835c-90793e69ce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:51.490320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-490acb5c-05e3-4d40-835c-90793e69ce5b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:51.492450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-490acb5c-05e3-4d40-835c-90793e69ce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:51.632350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 360/721] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:52.226181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab30b59-91e8-4b44-b23b-2bca222854a7 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:52.370848 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab30b59-91e8-4b44-b23b-2bca222854a7 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:52.419611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:52.426383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62714505-7b5b-4be9-8928-3f264ee119da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:52.433132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714505-7b5b-4be9-8928-3f264ee119da None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:52.433132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714505-7b5b-4be9-8928-3f264ee119da None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:52.433132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62714505-7b5b-4be9-8928-3f264ee119da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:52.441626 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62714505-7b5b-4be9-8928-3f264ee119da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-62714505-7b5b-4be9-8928-3f264ee119da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:52.446635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:52.448234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:52.449141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 362/722] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:52.458182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490acb5c-05e3-4d40-835c-90793e69ce5b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:52.582016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:52.721457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490acb5c-05e3-4d40-835c-90793e69ce5b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:52.788853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a43d0-2434-4685-b304-9aa66caa5762 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:52.789309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a43d0-2434-4685-b304-9aa66caa5762 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:52.789762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a43d0-2434-4685-b304-9aa66caa5762 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:52.793925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 363/723] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:52.804156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2414-c22d-4ebf-afe1-33f56374a2c1 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:52.804692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2414-c22d-4ebf-afe1-33f56374a2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:52.805094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2414-c22d-4ebf-afe1-33f56374a2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:52.817972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b86b4-9426-48f9-9fcb-00917c7e302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:52.818979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b86b4-9426-48f9-9fcb-00917c7e302e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:52.819451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b86b4-9426-48f9-9fcb-00917c7e302e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:52.819920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b86b4-9426-48f9-9fcb-00917c7e302e None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:52.822774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b86b4-9426-48f9-9fcb-00917c7e302e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:52.827459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b86b4-9426-48f9-9fcb-00917c7e302e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:52.830104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b86b4-9426-48f9-9fcb-00917c7e302e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:52.857630 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c2ea2414-c22d-4ebf-afe1-33f56374a2c1 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:52.859699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c2ea2414-c22d-4ebf-afe1-33f56374a2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:52.867236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 361/724] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:52.877659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b86b4-9426-48f9-9fcb-00917c7e302e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:53.083446 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 364/725] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:53.175862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b86b4-9426-48f9-9fcb-00917c7e302e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:53.180942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:53.264002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0660c33-96a5-426a-9a70-70914649a7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:53.265273 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0660c33-96a5-426a-9a70-70914649a7ef None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:53.265771 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0660c33-96a5-426a-9a70-70914649a7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:53.266258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0660c33-96a5-426a-9a70-70914649a7ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:53.290240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0660c33-96a5-426a-9a70-70914649a7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:53.293021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0660c33-96a5-426a-9a70-70914649a7ef None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:53.311030 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a262c8-d1aa-4bc1-8648-b47895179bd6 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:53.311533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a262c8-d1aa-4bc1-8648-b47895179bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:53.312021 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a262c8-d1aa-4bc1-8648-b47895179bd6 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:53.314768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 365/726] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:53.325492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33276-5cce-43de-b12a-d67b94dca27a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:53.325770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33276-5cce-43de-b12a-d67b94dca27a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:53.326438 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc33276-5cce-43de-b12a-d67b94dca27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b0660c33-96a5-426a-9a70-70914649a7ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:53.336512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:53.337551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:53.338544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:53.338544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:53.338544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:53.340681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 362/727] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 458 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:53.345259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0660c33-96a5-426a-9a70-70914649a7ef None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:53.382981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-6fc33276-5cce-43de-b12a-d67b94dca27a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:53.390186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6fc33276-5cce-43de-b12a-d67b94dca27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:53.523813 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 366/728] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:53.524838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc33276-5cce-43de-b12a-d67b94dca27a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:53.603071 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:53.610161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0660c33-96a5-426a-9a70-70914649a7ef None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:53.684369 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca45c41-a441-4ad3-bc17-573fc2091759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:53.685441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45c41-a441-4ad3-bc17-573fc2091759 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:53.685981 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45c41-a441-4ad3-bc17-573fc2091759 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:53.686574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca45c41-a441-4ad3-bc17-573fc2091759 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:53.687459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca45c41-a441-4ad3-bc17-573fc2091759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:53.687969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca45c41-a441-4ad3-bc17-573fc2091759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:53.690004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca45c41-a441-4ad3-bc17-573fc2091759 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:53.718132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 363/729] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:53.727293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca45c41-a441-4ad3-bc17-573fc2091759 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:53.751317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc33276-5cce-43de-b12a-d67b94dca27a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:53.770129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:53.871482 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2a3aa-160b-4b1a-bc75-4428a478a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:53.872424 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2a3aa-160b-4b1a-bc75-4428a478a9c2 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:53.872951 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2a3aa-160b-4b1a-bc75-4428a478a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:53.873583 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2a3aa-160b-4b1a-bc75-4428a478a9c2 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:53.874982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2a3aa-160b-4b1a-bc75-4428a478a9c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:53.877902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca45c41-a441-4ad3-bc17-573fc2091759 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:53.878134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2a3aa-160b-4b1a-bc75-4428a478a9c2 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:53.918707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a27e49-768f-4354-814d-0c4c1454a606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:53.919363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a27e49-768f-4354-814d-0c4c1454a606 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:53.919657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a27e49-768f-4354-814d-0c4c1454a606 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:53.920084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a27e49-768f-4354-814d-0c4c1454a606 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:53.928864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a27e49-768f-4354-814d-0c4c1454a606 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:53.930329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a27e49-768f-4354-814d-0c4c1454a606 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-69a27e49-768f-4354-814d-0c4c1454a606 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:53.944077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:53.945965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:53.947860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 364/730] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:28:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:53.958674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a27e49-768f-4354-814d-0c4c1454a606 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:54.051577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 367/731] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:28:53 2022] POST /identity/v3/services => generated 251 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:28:54.052952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2a3aa-160b-4b1a-bc75-4428a478a9c2 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:54.086100 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:54.120381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a27e49-768f-4354-814d-0c4c1454a606 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:54.177030 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b7aa0-0c5e-406e-aff7-f20014243487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:54.177030 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7aa0-0c5e-406e-aff7-f20014243487 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:54.177402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7aa0-0c5e-406e-aff7-f20014243487 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:54.177762 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b7aa0-0c5e-406e-aff7-f20014243487 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:54.178407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b7aa0-0c5e-406e-aff7-f20014243487 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:54.178699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b7aa0-0c5e-406e-aff7-f20014243487 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:54.180303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b7aa0-0c5e-406e-aff7-f20014243487 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:54.229004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 365/732] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 21:28:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:28:54.232973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292ef6e-c9b0-422b-9b0b-b97d8cfeafd4 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:54.234016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292ef6e-c9b0-422b-9b0b-b97d8cfeafd4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:54.234877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292ef6e-c9b0-422b-9b0b-b97d8cfeafd4 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:54.239790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 366/733] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:54.243715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292ef6e-c9b0-422b-9b0b-b97d8cfeafd4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:54.273336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2a3aa-160b-4b1a-bc75-4428a478a9c2 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:54.279083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:54.333581 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801736b-4dd5-4c79-920b-b2d1ee129a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:54.334615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801736b-4dd5-4c79-920b-b2d1ee129a3d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:54.335060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801736b-4dd5-4c79-920b-b2d1ee129a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:54.335480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801736b-4dd5-4c79-920b-b2d1ee129a3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:54.361295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801736b-4dd5-4c79-920b-b2d1ee129a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-d801736b-4dd5-4c79-920b-b2d1ee129a3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:54.369600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:54.371545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:54.374397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 368/734] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:28:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:54.383006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93815-95fb-4b9e-be5d-a8eb37489175 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:54.383006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93815-95fb-4b9e-be5d-a8eb37489175 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:54.383006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93815-95fb-4b9e-be5d-a8eb37489175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:54.412150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-d6d93815-95fb-4b9e-be5d-a8eb37489175 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:54.415207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d6d93815-95fb-4b9e-be5d-a8eb37489175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:54.490910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292ef6e-c9b0-422b-9b0b-b97d8cfeafd4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:54.562891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:54.563790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 369/735] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:54.565720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93815-95fb-4b9e-be5d-a8eb37489175 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:54.574021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da6cf0-c3f0-4f66-9fdc-0b3b99f8df25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:54.575197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da6cf0-c3f0-4f66-9fdc-0b3b99f8df25 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:54.575912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da6cf0-c3f0-4f66-9fdc-0b3b99f8df25 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:54.576652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da6cf0-c3f0-4f66-9fdc-0b3b99f8df25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:54.719673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:54.728166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93815-95fb-4b9e-be5d-a8eb37489175 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:54.731718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da6cf0-c3f0-4f66-9fdc-0b3b99f8df25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:54.735417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da6cf0-c3f0-4f66-9fdc-0b3b99f8df25 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:54.776371 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fca9d3-03cb-4b7f-90f8-009b5358e0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:54.777025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fca9d3-03cb-4b7f-90f8-009b5358e0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:54.777298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fca9d3-03cb-4b7f-90f8-009b5358e0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:54.777567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fca9d3-03cb-4b7f-90f8-009b5358e0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:54.778243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fca9d3-03cb-4b7f-90f8-009b5358e0e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:54.778544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fca9d3-03cb-4b7f-90f8-009b5358e0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:54.780032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fca9d3-03cb-4b7f-90f8-009b5358e0e1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:54.789896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 370/736] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:28:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:54.791481 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc62f5c-d2d8-4c3e-92cd-67f97ab25dd3 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:54.791661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc62f5c-d2d8-4c3e-92cd-67f97ab25dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:54.791929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc62f5c-d2d8-4c3e-92cd-67f97ab25dd3 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:54.793810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 371/737] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:54.797902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc62f5c-d2d8-4c3e-92cd-67f97ab25dd3 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:54.951939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 367/738] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:54 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 21:28:54.953737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55c17e-141a-4318-8fa0-9f73d44746b3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:54.954021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55c17e-141a-4318-8fa0-9f73d44746b3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:54.954542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55c17e-141a-4318-8fa0-9f73d44746b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:54.997692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ae55c17e-141a-4318-8fa0-9f73d44746b3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:55.000148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ae55c17e-141a-4318-8fa0-9f73d44746b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:55.009357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc62f5c-d2d8-4c3e-92cd-67f97ab25dd3 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:55.055646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:55.082761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dc499-1724-4490-8705-67d9e71a0904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:55.083758 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc499-1724-4490-8705-67d9e71a0904 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:55.084218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc499-1724-4490-8705-67d9e71a0904 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:55.084695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc499-1724-4490-8705-67d9e71a0904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:55.104664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dc499-1724-4490-8705-67d9e71a0904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:55.107284 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dc499-1724-4490-8705-67d9e71a0904 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-9b4dc499-1724-4490-8705-67d9e71a0904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:55.136822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:55.138644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:55.139997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:55.139997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:55.139997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:55.139997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 372/739] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:55.141111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dc499-1724-4490-8705-67d9e71a0904 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:55.146938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 368/740] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 21:28:55.148942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55c17e-141a-4318-8fa0-9f73d44746b3 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:55.161706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:55.283063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dc499-1724-4490-8705-67d9e71a0904 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:55.311798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55c17e-141a-4318-8fa0-9f73d44746b3 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:55.353400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f89054-6175-4209-80fd-55f942f30b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:55.355282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89054-6175-4209-80fd-55f942f30b22 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:55.355874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89054-6175-4209-80fd-55f942f30b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:55.356471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f89054-6175-4209-80fd-55f942f30b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:55.377846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f89054-6175-4209-80fd-55f942f30b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:55.378585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3ca42-4fe1-48b9-a9e0-31574b109f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:55.379737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3ca42-4fe1-48b9-a9e0-31574b109f94 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:55.380330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3ca42-4fe1-48b9-a9e0-31574b109f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:55.380954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3ca42-4fe1-48b9-a9e0-31574b109f94 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:55.381489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f89054-6175-4209-80fd-55f942f30b22 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:55.382502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3ca42-4fe1-48b9-a9e0-31574b109f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:55.383179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3ca42-4fe1-48b9-a9e0-31574b109f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:55.385974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3ca42-4fe1-48b9-a9e0-31574b109f94 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:55.409181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 369/741] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:55.411008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3ca42-4fe1-48b9-a9e0-31574b109f94 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-93f89054-6175-4209-80fd-55f942f30b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:55.411830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:55.413718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:55.415742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:55.415742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:55.415742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:55.424100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 373/742] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:55.425952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f89054-6175-4209-80fd-55f942f30b22 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:55.476749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:55.544686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:55.603770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3ca42-4fe1-48b9-a9e0-31574b109f94 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:55.624788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f89054-6175-4209-80fd-55f942f30b22 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:55.669069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5c951-e974-45c6-bfa1-5d5c01a7d995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:55.673216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5c951-e974-45c6-bfa1-5d5c01a7d995 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:55.673216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5c951-e974-45c6-bfa1-5d5c01a7d995 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:55.673216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5c951-e974-45c6-bfa1-5d5c01a7d995 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:55.688918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5c951-e974-45c6-bfa1-5d5c01a7d995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:28:55.689268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a3bc-fa0f-4fac-9ba8-b0e41e760c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:55.690503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a3bc-fa0f-4fac-9ba8-b0e41e760c9c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:55.691048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a3bc-fa0f-4fac-9ba8-b0e41e760c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:55.691601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a3bc-fa0f-4fac-9ba8-b0e41e760c9c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-c9c5c951-e974-45c6-bfa1-5d5c01a7d995 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:28:55.695462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:55.698111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 370/743] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:55.701251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5c951-e974-45c6-bfa1-5d5c01a7d995 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:55.709094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6a3bc-fa0f-4fac-9ba8-b0e41e760c9c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:55.711908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6a3bc-fa0f-4fac-9ba8-b0e41e760c9c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-2de6a3bc-fa0f-4fac-9ba8-b0e41e760c9c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:55.730850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:55.732747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 374/744] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 21:28:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:55.734596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a3bc-fa0f-4fac-9ba8-b0e41e760c9c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:55.888937 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:55.928963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5c951-e974-45c6-bfa1-5d5c01a7d995 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:55.936601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a3bc-fa0f-4fac-9ba8-b0e41e760c9c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:55.978569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:55.997514 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75d248-ccb1-4b14-bb2a-e0bb5b5128f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:55.998488 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75d248-ccb1-4b14-bb2a-e0bb5b5128f9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:55.999056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75d248-ccb1-4b14-bb2a-e0bb5b5128f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:55.999411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75d248-ccb1-4b14-bb2a-e0bb5b5128f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:56.000387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75d248-ccb1-4b14-bb2a-e0bb5b5128f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:56.000863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75d248-ccb1-4b14-bb2a-e0bb5b5128f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:56.002826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75d248-ccb1-4b14-bb2a-e0bb5b5128f9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:56.011098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3141a-1864-4caa-882b-c7d694739569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:56.012677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3141a-1864-4caa-882b-c7d694739569 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:56.013421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3141a-1864-4caa-882b-c7d694739569 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:56.014434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3141a-1864-4caa-882b-c7d694739569 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:56.015843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3141a-1864-4caa-882b-c7d694739569 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:56.020023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3141a-1864-4caa-882b-c7d694739569 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:56.027038 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 371/745] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:56.028592 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75d248-ccb1-4b14-bb2a-e0bb5b5128f9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:56.108591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 375/746] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:28:55 2022] POST /identity/v3/services => generated 240 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:28:56.110230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3141a-1864-4caa-882b-c7d694739569 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:56.202810 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75d248-ccb1-4b14-bb2a-e0bb5b5128f9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:56.281441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e27d4-def8-454f-abeb-59084079acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:56.282506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e27d4-def8-454f-abeb-59084079acd5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:56.282998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e27d4-def8-454f-abeb-59084079acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:56.283503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e27d4-def8-454f-abeb-59084079acd5 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:56.284416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e27d4-def8-454f-abeb-59084079acd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:56.285053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e27d4-def8-454f-abeb-59084079acd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:56.286885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e27d4-def8-454f-abeb-59084079acd5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:56.290317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:56.304048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 372/747] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:28:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:56.305470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e27d4-def8-454f-abeb-59084079acd5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:56.314413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3141a-1864-4caa-882b-c7d694739569 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:56.384206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fe768-c378-4475-a5e4-8e524d6714fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:56.385898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe768-c378-4475-a5e4-8e524d6714fc None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:56.386400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe768-c378-4475-a5e4-8e524d6714fc None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:56.386876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fe768-c378-4475-a5e4-8e524d6714fc None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:56.388188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fe768-c378-4475-a5e4-8e524d6714fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:56.388763 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fe768-c378-4475-a5e4-8e524d6714fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:56.391536 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fe768-c378-4475-a5e4-8e524d6714fc None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:56.421853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 376/748] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 21:28:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:56.423085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fe768-c378-4475-a5e4-8e524d6714fc None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:56.491486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e27d4-def8-454f-abeb-59084079acd5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:56.502932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:56.572127 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab038c09-b2c0-4b1f-986c-3d58c243cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:56.573831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab038c09-b2c0-4b1f-986c-3d58c243cddb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:56.574318 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab038c09-b2c0-4b1f-986c-3d58c243cddb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:56.574799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab038c09-b2c0-4b1f-986c-3d58c243cddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:56.591853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab038c09-b2c0-4b1f-986c-3d58c243cddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:56.594987 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab038c09-b2c0-4b1f-986c-3d58c243cddb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-ab038c09-b2c0-4b1f-986c-3d58c243cddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:56.619658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:56.620684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:56.621597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:56.621597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:56.621597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:56.621597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:56.621597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:56.621597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:56.621597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:56.621597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:56.628518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 373/749] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:56.628518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab038c09-b2c0-4b1f-986c-3d58c243cddb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:56.654668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fe768-c378-4475-a5e4-8e524d6714fc None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:56.737807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312884ed-3025-40cf-9a84-2f046d115590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:56.738904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312884ed-3025-40cf-9a84-2f046d115590 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:56.739373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312884ed-3025-40cf-9a84-2f046d115590 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:56.739837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312884ed-3025-40cf-9a84-2f046d115590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:56.755312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:56.766619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312884ed-3025-40cf-9a84-2f046d115590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:56.769863 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312884ed-3025-40cf-9a84-2f046d115590 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-312884ed-3025-40cf-9a84-2f046d115590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:56.789769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:56.790818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:56.791816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:56.791816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:56.791816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:56.798859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 377/750] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:56.800188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312884ed-3025-40cf-9a84-2f046d115590 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:56.847389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab038c09-b2c0-4b1f-986c-3d58c243cddb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:56.911032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:56.918345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711a0e-d151-4be9-90bf-714f6b29a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:56.924208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711a0e-d151-4be9-90bf-714f6b29a4bd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:56.924208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711a0e-d151-4be9-90bf-714f6b29a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:56.924422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312884ed-3025-40cf-9a84-2f046d115590 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:56.924675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac711a0e-d151-4be9-90bf-714f6b29a4bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:56.970450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e90df-566e-4125-b37f-5fc820279b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:56.971464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e90df-566e-4125-b37f-5fc820279b38 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:56.971953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e90df-566e-4125-b37f-5fc820279b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:56.972447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e90df-566e-4125-b37f-5fc820279b38 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:56.973409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e90df-566e-4125-b37f-5fc820279b38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:56.973956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e90df-566e-4125-b37f-5fc820279b38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:56.975645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e90df-566e-4125-b37f-5fc820279b38 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:56.992521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 378/751] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:56.995073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e90df-566e-4125-b37f-5fc820279b38 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:57.077372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac711a0e-d151-4be9-90bf-714f6b29a4bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:57.079448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac711a0e-d151-4be9-90bf-714f6b29a4bd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:57.173422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:57.203685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e90df-566e-4125-b37f-5fc820279b38 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:57.257177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb3a35-46a9-484a-95ec-d41d8c113d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:57.258171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb3a35-46a9-484a-95ec-d41d8c113d6a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:57.258715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 374/752] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:28:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:28:57.259040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb3a35-46a9-484a-95ec-d41d8c113d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:57.259789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb3a35-46a9-484a-95ec-d41d8c113d6a None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:57.260252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711a0e-d151-4be9-90bf-714f6b29a4bd None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:57.261681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb3a35-46a9-484a-95ec-d41d8c113d6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:57.262542 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb3a35-46a9-484a-95ec-d41d8c113d6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:57.265736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb3a35-46a9-484a-95ec-d41d8c113d6a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:57.283189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 379/753] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:57.284498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f813f7-5d37-487e-90e2-79c632150f58 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:57.284872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f813f7-5d37-487e-90e2-79c632150f58 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:57.285062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f813f7-5d37-487e-90e2-79c632150f58 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:57.288529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 380/754] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:57.288529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f813f7-5d37-487e-90e2-79c632150f58 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:57.303221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:57.430726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac711a0e-d151-4be9-90bf-714f6b29a4bd None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:57.485643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f813f7-5d37-487e-90e2-79c632150f58 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:57.504776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402961dc-c0bc-4344-bd8a-de2427e7d818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:57.505891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402961dc-c0bc-4344-bd8a-de2427e7d818 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:57.506585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402961dc-c0bc-4344-bd8a-de2427e7d818 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:57.507100 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402961dc-c0bc-4344-bd8a-de2427e7d818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:57.508656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402961dc-c0bc-4344-bd8a-de2427e7d818 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=87128016ec014aa8b8f2fcc8ecf1037d) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:57.509155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402961dc-c0bc-4344-bd8a-de2427e7d818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:57.512090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402961dc-c0bc-4344-bd8a-de2427e7d818 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:57.535186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 375/755] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:57 2022] GET /identity/v3/role_assignments?user.id=87128016ec014aa8b8f2fcc8ecf1037d&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=c0316e22a13a4034846c451753b4c14e => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:57.535186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402961dc-c0bc-4344-bd8a-de2427e7d818 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:57.564342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08079dc9-b850-47ae-8062-0f3895f9d04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:57.566777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08079dc9-b850-47ae-8062-0f3895f9d04a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:57.567901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08079dc9-b850-47ae-8062-0f3895f9d04a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:57.568606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08079dc9-b850-47ae-8062-0f3895f9d04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:57.596586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:57.598612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08079dc9-b850-47ae-8062-0f3895f9d04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:57.602049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08079dc9-b850-47ae-8062-0f3895f9d04a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-08079dc9-b850-47ae-8062-0f3895f9d04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:57.632874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:57.634593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:57.636278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:57.636278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:57.636278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:57.643622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 381/756] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:57.646277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf9aec-5097-4e0c-a80e-0470f3de31db None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:57.646870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf9aec-5097-4e0c-a80e-0470f3de31db None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:57.647437 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf9aec-5097-4e0c-a80e-0470f3de31db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:57.682699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b8cf9aec-5097-4e0c-a80e-0470f3de31db None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:57.685010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b8cf9aec-5097-4e0c-a80e-0470f3de31db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:57.786632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402961dc-c0bc-4344-bd8a-de2427e7d818 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:57.805413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:57.828850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 382/757] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:28:57.830635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf9aec-5097-4e0c-a80e-0470f3de31db None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:57.859845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d90a3-0da5-410c-8e88-540dd7edaadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:57.861677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d90a3-0da5-410c-8e88-540dd7edaadc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:57.862564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d90a3-0da5-410c-8e88-540dd7edaadc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:57.863293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d90a3-0da5-410c-8e88-540dd7edaadc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:57.878483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d90a3-0da5-410c-8e88-540dd7edaadc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:57.882067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d90a3-0da5-410c-8e88-540dd7edaadc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-c54d90a3-0da5-410c-8e88-540dd7edaadc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:28:57.907928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:57.909699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:57.911662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:57.911662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:57.911662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:28:57.911662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:28:57.911662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:28:57.911662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:28:57.911662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:28:57.911662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:28:57.911662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:28:57.911662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:57.917013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 376/758] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 21:28:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:57.926861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d90a3-0da5-410c-8e88-540dd7edaadc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:58.156832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:58.163977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf9aec-5097-4e0c-a80e-0470f3de31db None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:58.180561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d90a3-0da5-410c-8e88-540dd7edaadc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:58.227396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6adcd-6653-4eaf-a550-5499736d1a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:58.228031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6adcd-6653-4eaf-a550-5499736d1a6f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:58.228313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6adcd-6653-4eaf-a550-5499736d1a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:58.228614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6adcd-6653-4eaf-a550-5499736d1a6f None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:58.230115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6adcd-6653-4eaf-a550-5499736d1a6f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:58.230427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6adcd-6653-4eaf-a550-5499736d1a6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:58.235236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6adcd-6653-4eaf-a550-5499736d1a6f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:58.276618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8233d-0a0b-4644-a761-1b80c59d34ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:58.278030 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8233d-0a0b-4644-a761-1b80c59d34ea None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:58.284833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8233d-0a0b-4644-a761-1b80c59d34ea None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:58.285765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8233d-0a0b-4644-a761-1b80c59d34ea None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:58.287208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8233d-0a0b-4644-a761-1b80c59d34ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:58.288036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8233d-0a0b-4644-a761-1b80c59d34ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:58.290879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8233d-0a0b-4644-a761-1b80c59d34ea None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:58.303247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 377/759] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 21:28:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:58.325088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6adcd-6653-4eaf-a550-5499736d1a6f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:58.345693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 383/760] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 516 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:58.354935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8233d-0a0b-4644-a761-1b80c59d34ea None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:58.473412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:58.522026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6adcd-6653-4eaf-a550-5499736d1a6f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:58.584525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8233d-0a0b-4644-a761-1b80c59d34ea None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:58.595475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10e44a-1643-480a-a5a2-e806b603ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:58.596609 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10e44a-1643-480a-a5a2-e806b603ae67 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:58.597079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10e44a-1643-480a-a5a2-e806b603ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:58.597537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10e44a-1643-480a-a5a2-e806b603ae67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:58.613805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:58.619237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10e44a-1643-480a-a5a2-e806b603ae67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:58.622078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10e44a-1643-480a-a5a2-e806b603ae67 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:58.644724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da8655-4401-4e89-b1af-d1d8fe52997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:58.645368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8655-4401-4e89-b1af-d1d8fe52997c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:58.645647 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8655-4401-4e89-b1af-d1d8fe52997c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:58.645915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da8655-4401-4e89-b1af-d1d8fe52997c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-9b10e44a-1643-480a-a5a2-e806b603ae67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:28:58.653360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:58.655089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:28:58.657627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:28:58.657627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:28:58.657627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:58.657627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 378/761] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:58.657627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10e44a-1643-480a-a5a2-e806b603ae67 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:58.662010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da8655-4401-4e89-b1af-d1d8fe52997c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:58.663544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da8655-4401-4e89-b1af-d1d8fe52997c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-e3da8655-4401-4e89-b1af-d1d8fe52997c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:58.676348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:58.678127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:58.680401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:58.680401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:58.680401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:58.680401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:58.680401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:58.680401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:58.680401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:58.680401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:28:58.682908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 384/762] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:28:58.684381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94441819-9168-40a4-8264-5882d589543b None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:58.684674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94441819-9168-40a4-8264-5882d589543b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:58.685136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94441819-9168-40a4-8264-5882d589543b None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:58.688696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 385/763] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:28:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:28:58.691506 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94441819-9168-40a4-8264-5882d589543b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:58.837468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10e44a-1643-480a-a5a2-e806b603ae67 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:58.883285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c31f3a-5373-4e75-935c-bcbb3923a56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:58.883936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c31f3a-5373-4e75-935c-bcbb3923a56b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:58.884209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c31f3a-5373-4e75-935c-bcbb3923a56b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:58.884500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c31f3a-5373-4e75-935c-bcbb3923a56b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:58.886027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c31f3a-5373-4e75-935c-bcbb3923a56b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:58.886197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94441819-9168-40a4-8264-5882d589543b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:58.888312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c31f3a-5373-4e75-935c-bcbb3923a56b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:58.903539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a5c31f3a-5373-4e75-935c-bcbb3923a56b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:58.905007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:58.906020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:28:58.906873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:58.907619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 379/764] 10.222.0.83 () {56 vars in 1129 bytes} [Mon Aug 29 21:28:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:58.908221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c31f3a-5373-4e75-935c-bcbb3923a56b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:58.939241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac047bb8-aa11-4095-a454-7a7db14eb11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:58.939975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac047bb8-aa11-4095-a454-7a7db14eb11e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:58.940351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac047bb8-aa11-4095-a454-7a7db14eb11e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:58.940670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac047bb8-aa11-4095-a454-7a7db14eb11e None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:58.941561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac047bb8-aa11-4095-a454-7a7db14eb11e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:58.941723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac047bb8-aa11-4095-a454-7a7db14eb11e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:58.943122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac047bb8-aa11-4095-a454-7a7db14eb11e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:58.968553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 386/765] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:58.968553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1941866-5292-4a64-965b-d813760ba775 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:58.968553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1941866-5292-4a64-965b-d813760ba775 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:58.968553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1941866-5292-4a64-965b-d813760ba775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:58.998323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-f1941866-5292-4a64-965b-d813760ba775 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:28:59.000468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f1941866-5292-4a64-965b-d813760ba775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:28:59.034993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:59.124961 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c31f3a-5373-4e75-935c-bcbb3923a56b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:59.152559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 387/766] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:28:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:28:59.152559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1941866-5292-4a64-965b-d813760ba775 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:59.200962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ff3ff-7fd8-4fed-ab73-8c65c2d566e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:59.202104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ff3ff-7fd8-4fed-ab73-8c65c2d566e1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:59.202602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ff3ff-7fd8-4fed-ab73-8c65c2d566e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:59.203196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ff3ff-7fd8-4fed-ab73-8c65c2d566e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:59.204653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ff3ff-7fd8-4fed-ab73-8c65c2d566e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:59.205167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ff3ff-7fd8-4fed-ab73-8c65c2d566e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:59.207830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ff3ff-7fd8-4fed-ab73-8c65c2d566e1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:59.233634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 380/767] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:59.234830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ff3ff-7fd8-4fed-ab73-8c65c2d566e1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:59.379123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1941866-5292-4a64-965b-d813760ba775 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:59.383432 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:59.445248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541c583-d4cc-45d2-85ee-dba6e0ffa0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:59.446046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ff3ff-7fd8-4fed-ab73-8c65c2d566e1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:59.446295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541c583-d4cc-45d2-85ee-dba6e0ffa0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:59.446757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541c583-d4cc-45d2-85ee-dba6e0ffa0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:59.447216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541c583-d4cc-45d2-85ee-dba6e0ffa0f0 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:59.448913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541c583-d4cc-45d2-85ee-dba6e0ffa0f0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:59.449431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541c583-d4cc-45d2-85ee-dba6e0ffa0f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:59.452095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541c583-d4cc-45d2-85ee-dba6e0ffa0f0 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:59.466572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 388/768] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 21:28:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:59.466572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541c583-d4cc-45d2-85ee-dba6e0ffa0f0 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:59.492374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:59.535843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c90e-3225-4065-8685-eb46d8071ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:59.537424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c90e-3225-4065-8685-eb46d8071ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:59.538194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c90e-3225-4065-8685-eb46d8071ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:59.539005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c90e-3225-4065-8685-eb46d8071ed3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:59.556754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38c90e-3225-4065-8685-eb46d8071ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:59.561266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38c90e-3225-4065-8685-eb46d8071ed3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-bf38c90e-3225-4065-8685-eb46d8071ed3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:28:59.592950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:28:59.594761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:28:59.596642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:28:59.596642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:28:59.596642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:28:59.596642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:28:59.596642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:28:59.596642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:28:59.596642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:28:59.596642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:28:59.604501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 381/769] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:28:59.605797 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c90e-3225-4065-8685-eb46d8071ed3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:59.652839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541c583-d4cc-45d2-85ee-dba6e0ffa0f0 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:59.710623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797fa1-ba93-49ae-8c6f-0da5ab779a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:59.711732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797fa1-ba93-49ae-8c6f-0da5ab779a23 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:59.711732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797fa1-ba93-49ae-8c6f-0da5ab779a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:59.711732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e797fa1-ba93-49ae-8c6f-0da5ab779a23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:59.712436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e797fa1-ba93-49ae-8c6f-0da5ab779a23 None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=8ba9ea33e0f444b88acdc9560856dae5) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:59.712636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e797fa1-ba93-49ae-8c6f-0da5ab779a23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:59.714622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e797fa1-ba93-49ae-8c6f-0da5ab779a23 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:59.726136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 389/770] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:28:59 2022] GET /identity/v3/role_assignments?user.id=8ba9ea33e0f444b88acdc9560856dae5&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:59.729297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797fa1-ba93-49ae-8c6f-0da5ab779a23 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:59.769781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c90e-3225-4065-8685-eb46d8071ed3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:59.806107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:28:59.845834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995fa0-4fe7-46ff-ab18-0d4d190db59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:28:59.847688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995fa0-4fe7-46ff-ab18-0d4d190db59f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:28:59.849310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995fa0-4fe7-46ff-ab18-0d4d190db59f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:28:59.850080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995fa0-4fe7-46ff-ab18-0d4d190db59f None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:28:59.852041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2995fa0-4fe7-46ff-ab18-0d4d190db59f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:28:59.852992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2995fa0-4fe7-46ff-ab18-0d4d190db59f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:28:59.856944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2995fa0-4fe7-46ff-ab18-0d4d190db59f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:28:59.879114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 382/771] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 21:28:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:28:59.879114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995fa0-4fe7-46ff-ab18-0d4d190db59f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:28:59.965352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e797fa1-ba93-49ae-8c6f-0da5ab779a23 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:28:59.970500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:00.046733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89c7ef-7aaf-4b62-93f2-e936fefdf86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:00.048784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89c7ef-7aaf-4b62-93f2-e936fefdf86c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:00.049459 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89c7ef-7aaf-4b62-93f2-e936fefdf86c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:00.050759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89c7ef-7aaf-4b62-93f2-e936fefdf86c None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:00.052771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89c7ef-7aaf-4b62-93f2-e936fefdf86c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:00.053836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89c7ef-7aaf-4b62-93f2-e936fefdf86c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:00.057619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89c7ef-7aaf-4b62-93f2-e936fefdf86c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:00.072760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 390/772] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:28:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:00.074251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89c7ef-7aaf-4b62-93f2-e936fefdf86c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:00.101480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995fa0-4fe7-46ff-ab18-0d4d190db59f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:00.154781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18593b67-d685-441d-9502-46e5c97aa9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:00.155491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593b67-d685-441d-9502-46e5c97aa9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:00.155828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593b67-d685-441d-9502-46e5c97aa9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:00.156109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18593b67-d685-441d-9502-46e5c97aa9a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:00.156717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18593b67-d685-441d-9502-46e5c97aa9a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:00.158142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18593b67-d685-441d-9502-46e5c97aa9a8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-18593b67-d685-441d-9502-46e5c97aa9a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:00.169183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:00.171027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:00.172421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 383/773] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:28:59 2022] GET /identity/v3/services/network => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:00.175455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18593b67-d685-441d-9502-46e5c97aa9a8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:00.267710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:00.285299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89c7ef-7aaf-4b62-93f2-e936fefdf86c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:00.351925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709afa51-97c2-41af-bf14-3d2d9c6b652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:00.353009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709afa51-97c2-41af-bf14-3d2d9c6b652b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:00.353485 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709afa51-97c2-41af-bf14-3d2d9c6b652b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:00.353874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709afa51-97c2-41af-bf14-3d2d9c6b652b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:00.354141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18593b67-d685-441d-9502-46e5c97aa9a8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:00.354957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709afa51-97c2-41af-bf14-3d2d9c6b652b None admin] RBAC: Adding query filter params (interface=public, service_id=9859b3bfcd924e0b9d23f6d397602509, region_id=RegionOne) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:00.355438 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709afa51-97c2-41af-bf14-3d2d9c6b652b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:00.357617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709afa51-97c2-41af-bf14-3d2d9c6b652b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:00.360365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:00.380533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 391/774] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 21:29:00 2022] GET /identity/v3/endpoints?service_id=9859b3bfcd924e0b9d23f6d397602509&interface=public®ion_id=RegionOne => generated 194 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:00.380533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14164753-0db0-4005-bab1-836d171d57c9 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:00.380533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14164753-0db0-4005-bab1-836d171d57c9 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:00.380533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14164753-0db0-4005-bab1-836d171d57c9 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:00.380533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 392/775] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:00.382229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14164753-0db0-4005-bab1-836d171d57c9 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:00.435477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40de57-8cc2-4a62-aa05-ced79ad29902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:00.436710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40de57-8cc2-4a62-aa05-ced79ad29902 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:00.437181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40de57-8cc2-4a62-aa05-ced79ad29902 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:00.437717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b40de57-8cc2-4a62-aa05-ced79ad29902 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/8434659c6b164b97b5ac27fb7e4d6a26/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:00.441411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40de57-8cc2-4a62-aa05-ced79ad29902 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=8434659c6b164b97b5ac27fb7e4d6a26, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:00.444003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b40de57-8cc2-4a62-aa05-ced79ad29902 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:00.529476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 384/776] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:29:00 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/8434659c6b164b97b5ac27fb7e4d6a26/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:29:00.530900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40de57-8cc2-4a62-aa05-ced79ad29902 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:00.612129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14164753-0db0-4005-bab1-836d171d57c9 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:00.692444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18ef8d-faa6-4449-a889-1232f2b81504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:00.693359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18ef8d-faa6-4449-a889-1232f2b81504 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:00.693836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18ef8d-faa6-4449-a889-1232f2b81504 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:00.694276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18ef8d-faa6-4449-a889-1232f2b81504 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:00.695298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18ef8d-faa6-4449-a889-1232f2b81504 None admin] RBAC: Adding query filter params (name=network) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:00.695753 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18ef8d-faa6-4449-a889-1232f2b81504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:00.698741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18ef8d-faa6-4449-a889-1232f2b81504 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:00.715460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 393/777] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:00.715460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b8199-ed1e-442b-a394-e3e0d8327fa0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:00.720210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b8199-ed1e-442b-a394-e3e0d8327fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:00.720210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b8199-ed1e-442b-a394-e3e0d8327fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:00.752191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-188b8199-ed1e-442b-a394-e3e0d8327fa0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:00.754944 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-188b8199-ed1e-442b-a394-e3e0d8327fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:00.774604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b40de57-8cc2-4a62-aa05-ced79ad29902 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:00.786708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:00.864294 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a06d4-5182-40a9-a6a6-b3b478f56278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:00.865147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a06d4-5182-40a9-a6a6-b3b478f56278 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:00.865491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a06d4-5182-40a9-a6a6-b3b478f56278 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:00.865837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a06d4-5182-40a9-a6a6-b3b478f56278 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:00.866588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a06d4-5182-40a9-a6a6-b3b478f56278 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:00.868363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a06d4-5182-40a9-a6a6-b3b478f56278 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:00.875965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 385/778] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 21:29:00 2022] GET /identity/v3/services => generated 772 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:00.877345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 394/779] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:00.881115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a06d4-5182-40a9-a6a6-b3b478f56278 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:00.948328 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:01.138006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a06d4-5182-40a9-a6a6-b3b478f56278 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:01.182324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b8199-ed1e-442b-a394-e3e0d8327fa0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:01.229086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3ea45-0520-4b68-a991-dfb1a146d980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:01.230046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3ea45-0520-4b68-a991-dfb1a146d980 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:01.230418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3ea45-0520-4b68-a991-dfb1a146d980 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:01.230691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3ea45-0520-4b68-a991-dfb1a146d980 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:01.231456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3ea45-0520-4b68-a991-dfb1a146d980 None admin] RBAC: Adding query filter params (type=network) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:01.231960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3ea45-0520-4b68-a991-dfb1a146d980 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:01.233920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3ea45-0520-4b68-a991-dfb1a146d980 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:01.246909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 386/780] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:00 2022] GET /identity/v3/services?type=network => generated 350 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:01.256395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3ea45-0520-4b68-a991-dfb1a146d980 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:01.427310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:01.444061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3ea45-0520-4b68-a991-dfb1a146d980 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:01.447375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b8199-ed1e-442b-a394-e3e0d8327fa0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:01.512332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a705493-4ede-4ff9-a6ae-ef9f6d8a436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:01.513466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a705493-4ede-4ff9-a6ae-ef9f6d8a436d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:01.514046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a705493-4ede-4ff9-a6ae-ef9f6d8a436d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:01.514327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a705493-4ede-4ff9-a6ae-ef9f6d8a436d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:01.515331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a705493-4ede-4ff9-a6ae-ef9f6d8a436d None admin] RBAC: Adding query filter params (interface=public, service_id=d24af1103a764799a010aa95b372acd2, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:01.515655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a705493-4ede-4ff9-a6ae-ef9f6d8a436d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:01.517092 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a705493-4ede-4ff9-a6ae-ef9f6d8a436d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:01.525898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2401a-3f2e-4212-82cb-4c646630b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:01.526554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2401a-3f2e-4212-82cb-4c646630b549 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:01.526827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2401a-3f2e-4212-82cb-4c646630b549 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:01.527095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2401a-3f2e-4212-82cb-4c646630b549 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:01.535340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 387/781] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 21:29:01 2022] GET /identity/v3/endpoints?service_id=d24af1103a764799a010aa95b372acd2&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:01.537446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a705493-4ede-4ff9-a6ae-ef9f6d8a436d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:01.565681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2401a-3f2e-4212-82cb-4c646630b549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-b8f2401a-3f2e-4212-82cb-4c646630b549 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:01.582847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:01.584713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:01.586354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:01.599476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 395/782] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:29:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:01.621702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2401a-3f2e-4212-82cb-4c646630b549 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:01.644917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:01.823887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a705493-4ede-4ff9-a6ae-ef9f6d8a436d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:01.926115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10b36-54c5-4785-a875-1d64aef0a9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:01.926913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10b36-54c5-4785-a875-1d64aef0a9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:01.927295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10b36-54c5-4785-a875-1d64aef0a9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:01.927664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10b36-54c5-4785-a875-1d64aef0a9c3 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:01.928385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d10b36-54c5-4785-a875-1d64aef0a9c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:01.929697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2401a-3f2e-4212-82cb-4c646630b549 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:01.930187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d10b36-54c5-4785-a875-1d64aef0a9c3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:01.955329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 388/783] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 21:29:01 2022] GET /identity/v3/services => generated 772 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:01.972430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2656ba-6567-42bb-b7c3-656f2c555eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:01.973339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2656ba-6567-42bb-b7c3-656f2c555eba None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:01.973790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2656ba-6567-42bb-b7c3-656f2c555eba None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:01.974282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2656ba-6567-42bb-b7c3-656f2c555eba None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:01.975126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2656ba-6567-42bb-b7c3-656f2c555eba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:01.975572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2656ba-6567-42bb-b7c3-656f2c555eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:01.977159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2656ba-6567-42bb-b7c3-656f2c555eba None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:01.989737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 396/784] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:29:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:01.999310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10b36-54c5-4785-a875-1d64aef0a9c3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:02.064140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:02.184530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10b36-54c5-4785-a875-1d64aef0a9c3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:02.229619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3bb93-66d2-4253-9239-c611ef2fef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:02.230599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3bb93-66d2-4253-9239-c611ef2fef62 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:02.231088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3bb93-66d2-4253-9239-c611ef2fef62 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:02.231502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3bb93-66d2-4253-9239-c611ef2fef62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:02.244210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3bb93-66d2-4253-9239-c611ef2fef62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:02.246086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3bb93-66d2-4253-9239-c611ef2fef62 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d6f3bb93-66d2-4253-9239-c611ef2fef62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:02.263986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:02.265304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:02.266397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:02.266397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:02.266397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:02.268213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 389/785] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:02.278149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2656ba-6567-42bb-b7c3-656f2c555eba None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:02.386508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:02.428208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2656ba-6567-42bb-b7c3-656f2c555eba None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:02.470440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d4ced2-e115-4369-8853-6abbfad6561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:02.471405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4ced2-e115-4369-8853-6abbfad6561a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:02.471883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4ced2-e115-4369-8853-6abbfad6561a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:02.472351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4ced2-e115-4369-8853-6abbfad6561a None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:02.473605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4ced2-e115-4369-8853-6abbfad6561a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:02.474124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4ced2-e115-4369-8853-6abbfad6561a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:02.475806 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d4ced2-e115-4369-8853-6abbfad6561a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:02.490642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 397/786] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:02.499602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3bb93-66d2-4253-9239-c611ef2fef62 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:02.673388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:02.681266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e204-b463-4bbd-9ce8-aa9b4b3e537f None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:02.681598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e204-b463-4bbd-9ce8-aa9b4b3e537f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:02.681824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62e204-b463-4bbd-9ce8-aa9b4b3e537f None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:02.688106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 398/787] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:02.690837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c121449-2889-480f-9024-7f2c39705c48 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:02.691329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c121449-2889-480f-9024-7f2c39705c48 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:02.691835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c121449-2889-480f-9024-7f2c39705c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:02.746244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-8c121449-2889-480f-9024-7f2c39705c48 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:02.747861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8c121449-2889-480f-9024-7f2c39705c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:02.887910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 399/788] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:02.914562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3bb93-66d2-4253-9239-c611ef2fef62 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:02.983252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fedcbf-8a03-4b13-8200-e2860ea233f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:02.984363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedcbf-8a03-4b13-8200-e2860ea233f1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:02.985051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedcbf-8a03-4b13-8200-e2860ea233f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:02.985522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedcbf-8a03-4b13-8200-e2860ea233f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:03.000437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fedcbf-8a03-4b13-8200-e2860ea233f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:03.003740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fedcbf-8a03-4b13-8200-e2860ea233f1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-49fedcbf-8a03-4b13-8200-e2860ea233f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:03.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:03.045050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:03.046923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:03.046923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:03.046923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:03.046923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:03.046923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:03.046923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:03.046923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:03.046923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:03.046923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:29:03.046923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:03.050950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 390/789] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:29:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 552 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:03.061669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c121449-2889-480f-9024-7f2c39705c48 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:03.154691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:03.201992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c121449-2889-480f-9024-7f2c39705c48 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:03.237642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118c230-cc7e-428e-b049-4efd2838cdf1 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:03.238574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118c230-cc7e-428e-b049-4efd2838cdf1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:03.238574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118c230-cc7e-428e-b049-4efd2838cdf1 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:03.239830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 391/790] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:03.242094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfde2a-b891-4934-98b8-6a745eb5d236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:03.242717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfde2a-b891-4934-98b8-6a745eb5d236 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:03.243005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfde2a-b891-4934-98b8-6a745eb5d236 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:03.243254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfde2a-b891-4934-98b8-6a745eb5d236 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:03.244091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfde2a-b891-4934-98b8-6a745eb5d236 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:03.244396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfde2a-b891-4934-98b8-6a745eb5d236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:03.245943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30e0a1-af81-46fa-98b5-04754151740d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:03.246238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30e0a1-af81-46fa-98b5-04754151740d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:03.246490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfde2a-b891-4934-98b8-6a745eb5d236 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:03.246646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30e0a1-af81-46fa-98b5-04754151740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:03.268067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5e30e0a1-af81-46fa-98b5-04754151740d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:03.268622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 400/791] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 21:29:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:03.269244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5e30e0a1-af81-46fa-98b5-04754151740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:03.279184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfde2a-b891-4934-98b8-6a745eb5d236 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:03.412577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 392/792] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:03.493323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30e0a1-af81-46fa-98b5-04754151740d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:03.549085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfde2a-b891-4934-98b8-6a745eb5d236 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:03.613056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:03.680173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95adbd-9af7-4b4b-9ec8-910c53aafc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:03.681212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95adbd-9af7-4b4b-9ec8-910c53aafc3c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:03.681663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95adbd-9af7-4b4b-9ec8-910c53aafc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:03.682161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95adbd-9af7-4b4b-9ec8-910c53aafc3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:03.704172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95adbd-9af7-4b4b-9ec8-910c53aafc3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:03.707439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95adbd-9af7-4b4b-9ec8-910c53aafc3c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:03.728276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-ea95adbd-9af7-4b4b-9ec8-910c53aafc3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:03.767251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:03.769139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:03.771350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:03.771350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:03.771350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:03.771350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 401/793] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 491 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:03.784566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95adbd-9af7-4b4b-9ec8-910c53aafc3c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:03.866799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30e0a1-af81-46fa-98b5-04754151740d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:03.957001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dbb5c-2b52-43db-ba64-78332bc73c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:03.957658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dbb5c-2b52-43db-ba64-78332bc73c8d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:03.957926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dbb5c-2b52-43db-ba64-78332bc73c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:03.958194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dbb5c-2b52-43db-ba64-78332bc73c8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:03.971219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10dbb5c-2b52-43db-ba64-78332bc73c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b10dbb5c-2b52-43db-ba64-78332bc73c8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:03.976120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:03.978285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 393/794] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:29:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 486 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:03.979929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7013-6bab-4b83-a5cb-1d231271c789 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:03.981429 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7013-6bab-4b83-a5cb-1d231271c789 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:03.981429 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a7013-6bab-4b83-a5cb-1d231271c789 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:03.983642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 394/795] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:03.985502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a7013-6bab-4b83-a5cb-1d231271c789 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:04.030821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95adbd-9af7-4b4b-9ec8-910c53aafc3c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.076239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe7640-a2e6-4659-aadb-a2bf770498d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:04.076945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe7640-a2e6-4659-aadb-a2bf770498d1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.077157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe7640-a2e6-4659-aadb-a2bf770498d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.077428 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe7640-a2e6-4659-aadb-a2bf770498d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.078159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe7640-a2e6-4659-aadb-a2bf770498d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:04.078533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe7640-a2e6-4659-aadb-a2bf770498d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:04.079932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe7640-a2e6-4659-aadb-a2bf770498d1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:04.096464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 402/796] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:04.102247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec88c0-59fa-43b8-bfe7-71ff143f17e1 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.102600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec88c0-59fa-43b8-bfe7-71ff143f17e1 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.102902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec88c0-59fa-43b8-bfe7-71ff143f17e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.132589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-f4ec88c0-59fa-43b8-bfe7-71ff143f17e1 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:04.134116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f4ec88c0-59fa-43b8-bfe7-71ff143f17e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:04.149321 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a7013-6bab-4b83-a5cb-1d231271c789 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.179313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:04.195682 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:04.218179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cc926-ba19-423f-a775-989850402c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:04.219267 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc926-ba19-423f-a775-989850402c99 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.219762 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc926-ba19-423f-a775-989850402c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.220240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347cc926-ba19-423f-a775-989850402c99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.240943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347cc926-ba19-423f-a775-989850402c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-347cc926-ba19-423f-a775-989850402c99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:04.253969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:04.255098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:04.256049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:04.256767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 395/797] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:29:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:04.257627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cc926-ba19-423f-a775-989850402c99 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:04.261855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 403/798] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:04.262908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec88c0-59fa-43b8-bfe7-71ff143f17e1 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:04.423627 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec88c0-59fa-43b8-bfe7-71ff143f17e1 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.451802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347cc926-ba19-423f-a775-989850402c99 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.467585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e336f8-2f36-4ecb-88a2-8f7d29d4e01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:04.468908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e336f8-2f36-4ecb-88a2-8f7d29d4e01d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.469539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e336f8-2f36-4ecb-88a2-8f7d29d4e01d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.470137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e336f8-2f36-4ecb-88a2-8f7d29d4e01d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.481158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e336f8-2f36-4ecb-88a2-8f7d29d4e01d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:04.482913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e336f8-2f36-4ecb-88a2-8f7d29d4e01d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-86e336f8-2f36-4ecb-88a2-8f7d29d4e01d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:04.497288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:04.498466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:04.499824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:04.499824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:04.499824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:04.499824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:04.499824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:04.499824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:04.499824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:04.499824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:04.501683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 404/799] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:04.502709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e336f8-2f36-4ecb-88a2-8f7d29d4e01d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:04.519326 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a72e8-66bd-4b18-b59f-f4e3e9e44c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:04.520442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a72e8-66bd-4b18-b59f-f4e3e9e44c65 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.520990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a72e8-66bd-4b18-b59f-f4e3e9e44c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.521475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a72e8-66bd-4b18-b59f-f4e3e9e44c65 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.522630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a72e8-66bd-4b18-b59f-f4e3e9e44c65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:04.523120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a72e8-66bd-4b18-b59f-f4e3e9e44c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:04.525270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a72e8-66bd-4b18-b59f-f4e3e9e44c65 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:04.532333 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:04.539304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 396/800] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:29:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:04.540450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a72e8-66bd-4b18-b59f-f4e3e9e44c65 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:04.610463 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:04.637096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e336f8-2f36-4ecb-88a2-8f7d29d4e01d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.680563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f0d2-9bae-4624-8a52-327efaadb3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:04.681261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f0d2-9bae-4624-8a52-327efaadb3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.681645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f0d2-9bae-4624-8a52-327efaadb3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.682018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34f0d2-9bae-4624-8a52-327efaadb3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.683391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f0d2-9bae-4624-8a52-327efaadb3c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:04.683798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f0d2-9bae-4624-8a52-327efaadb3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:04.685574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34f0d2-9bae-4624-8a52-327efaadb3c8 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:04.701011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 405/801] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:04.702289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f0d2-9bae-4624-8a52-327efaadb3c8 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:04.706142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a72e8-66bd-4b18-b59f-f4e3e9e44c65 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.767828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec2441-3fa7-44a5-b28b-6d7d8c8ccb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:04.768505 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec2441-3fa7-44a5-b28b-6d7d8c8ccb60 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.768886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec2441-3fa7-44a5-b28b-6d7d8c8ccb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.769367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec2441-3fa7-44a5-b28b-6d7d8c8ccb60 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.770651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec2441-3fa7-44a5-b28b-6d7d8c8ccb60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:04.771176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec2441-3fa7-44a5-b28b-6d7d8c8ccb60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:04.773894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec2441-3fa7-44a5-b28b-6d7d8c8ccb60 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:04.795103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 397/802] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:04.796653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec2441-3fa7-44a5-b28b-6d7d8c8ccb60 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:04.826943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:04.851344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34f0d2-9bae-4624-8a52-327efaadb3c8 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.917034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ef265-749d-49e0-b52a-b31b1992513f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:04.918180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ef265-749d-49e0-b52a-b31b1992513f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:04.918687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ef265-749d-49e0-b52a-b31b1992513f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:04.919409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ef265-749d-49e0-b52a-b31b1992513f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:04.941571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ef265-749d-49e0-b52a-b31b1992513f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:04.944299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ef265-749d-49e0-b52a-b31b1992513f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:04.961980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec2441-3fa7-44a5-b28b-6d7d8c8ccb60 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:04.965112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-cc2ef265-749d-49e0-b52a-b31b1992513f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:04.969419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:04.974196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:04.976474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:04.976474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:04.976474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:04.976474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 406/803] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:04.976474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ef265-749d-49e0-b52a-b31b1992513f None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:05.027040 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df9fe0-2ce4-46d7-9f06-5499695c108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:05.027848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df9fe0-2ce4-46d7-9f06-5499695c108c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:05.028192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df9fe0-2ce4-46d7-9f06-5499695c108c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:05.028560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df9fe0-2ce4-46d7-9f06-5499695c108c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:05.047827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df9fe0-2ce4-46d7-9f06-5499695c108c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:05.051590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df9fe0-2ce4-46d7-9f06-5499695c108c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-19df9fe0-2ce4-46d7-9f06-5499695c108c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:05.078906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:05.080312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:05.082177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:05.082177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:05.082177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:05.082177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 398/804] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:05.082177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df9fe0-2ce4-46d7-9f06-5499695c108c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:05.161883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ef265-749d-49e0-b52a-b31b1992513f None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:05.228077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c59c6-713e-42fe-80f5-1f5789ddeabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:05.229190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c59c6-713e-42fe-80f5-1f5789ddeabf None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:05.230162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c59c6-713e-42fe-80f5-1f5789ddeabf None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:05.230646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c59c6-713e-42fe-80f5-1f5789ddeabf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:05.231687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c59c6-713e-42fe-80f5-1f5789ddeabf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:05.234128 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c59c6-713e-42fe-80f5-1f5789ddeabf None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:05.237433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-be6c59c6-713e-42fe-80f5-1f5789ddeabf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:05.255103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:05.256349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:05.257285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 407/805] 10.222.0.83 () {56 vars in 1129 bytes} [Mon Aug 29 21:29:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:05.258611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c59c6-713e-42fe-80f5-1f5789ddeabf None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:05.259368 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df9fe0-2ce4-46d7-9f06-5499695c108c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:05.310822 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5964b63-2e7c-4674-b6ff-fd30fe58b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:05.311633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5964b63-2e7c-4674-b6ff-fd30fe58b2f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:05.311997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5964b63-2e7c-4674-b6ff-fd30fe58b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:05.312356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5964b63-2e7c-4674-b6ff-fd30fe58b2f4 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/87128016ec014aa8b8f2fcc8ecf1037d/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:05.314784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5964b63-2e7c-4674-b6ff-fd30fe58b2f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=87128016ec014aa8b8f2fcc8ecf1037d, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:05.316703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5964b63-2e7c-4674-b6ff-fd30fe58b2f4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:05.412086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 399/806] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:29:05 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/87128016ec014aa8b8f2fcc8ecf1037d/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:29:05.413628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5964b63-2e7c-4674-b6ff-fd30fe58b2f4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:05.444207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c59c6-713e-42fe-80f5-1f5789ddeabf None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:05.451862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:05.519444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef998271-eeac-405c-9184-561c1965cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:05.524423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef998271-eeac-405c-9184-561c1965cf00 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:05.524423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef998271-eeac-405c-9184-561c1965cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:05.524423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef998271-eeac-405c-9184-561c1965cf00 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:05.524423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef998271-eeac-405c-9184-561c1965cf00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:05.524423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef998271-eeac-405c-9184-561c1965cf00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:05.526530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef998271-eeac-405c-9184-561c1965cf00 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:05.550963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 408/807] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:05.553200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c69a8-5196-4300-a74d-8600e596f0ba None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:05.553805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c69a8-5196-4300-a74d-8600e596f0ba None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:05.554219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c69a8-5196-4300-a74d-8600e596f0ba None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:05.561022 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 409/808] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:05.562289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c69a8-5196-4300-a74d-8600e596f0ba None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:05.625964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5964b63-2e7c-4674-b6ff-fd30fe58b2f4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:05.686821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:05.691978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26931b-ca5f-4a62-af43-144eeca71d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:05.693120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26931b-ca5f-4a62-af43-144eeca71d06 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:05.693586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26931b-ca5f-4a62-af43-144eeca71d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:05.694388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26931b-ca5f-4a62-af43-144eeca71d06 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:05.695265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26931b-ca5f-4a62-af43-144eeca71d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:05.695848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26931b-ca5f-4a62-af43-144eeca71d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:05.699035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26931b-ca5f-4a62-af43-144eeca71d06 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:05.724308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 400/809] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:05.725836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26931b-ca5f-4a62-af43-144eeca71d06 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:05.775151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c69a8-5196-4300-a74d-8600e596f0ba None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:05.833135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727de714-0dc9-43c0-9055-5558aa2f10f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:05.834493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de714-0dc9-43c0-9055-5558aa2f10f9 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:05.834758 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de714-0dc9-43c0-9055-5558aa2f10f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:05.835165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de714-0dc9-43c0-9055-5558aa2f10f9 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:05.836048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727de714-0dc9-43c0-9055-5558aa2f10f9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:05.836786 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727de714-0dc9-43c0-9055-5558aa2f10f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:05.838481 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727de714-0dc9-43c0-9055-5558aa2f10f9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:05.852894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 410/810] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 21:29:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:05.852894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf509-784a-4de7-a0d9-c337d1031508 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:05.852894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf509-784a-4de7-a0d9-c337d1031508 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:05.852894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baaf509-784a-4de7-a0d9-c337d1031508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:05.859082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:05.876104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5baaf509-784a-4de7-a0d9-c337d1031508 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:05.877372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5baaf509-784a-4de7-a0d9-c337d1031508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:05.903814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26931b-ca5f-4a62-af43-144eeca71d06 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:05.968597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc881b-de1b-4d89-a013-8033e7d409d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:05.969648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc881b-de1b-4d89-a013-8033e7d409d2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:05.970110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc881b-de1b-4d89-a013-8033e7d409d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:05.970562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc881b-de1b-4d89-a013-8033e7d409d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:05.984529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 411/811] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:05.984529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf509-784a-4de7-a0d9-c337d1031508 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:05.994110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc881b-de1b-4d89-a013-8033e7d409d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:05.997750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc881b-de1b-4d89-a013-8033e7d409d2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-cddc881b-de1b-4d89-a013-8033e7d409d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:06.026149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:06.027805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 401/812] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 21:29:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:06.030557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc881b-de1b-4d89-a013-8033e7d409d2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:06.118445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:06.187532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baaf509-784a-4de7-a0d9-c337d1031508 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:06.238324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f0152-2d44-4b38-a1bd-0c00cc925ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:06.239042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f0152-2d44-4b38-a1bd-0c00cc925ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:06.239324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f0152-2d44-4b38-a1bd-0c00cc925ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:06.239593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f0152-2d44-4b38-a1bd-0c00cc925ab0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:06.250668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f0152-2d44-4b38-a1bd-0c00cc925ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:06.252618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5f0152-2d44-4b38-a1bd-0c00cc925ab0 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-2f5f0152-2d44-4b38-a1bd-0c00cc925ab0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:06.270670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:06.273015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 412/813] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 21:29:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:06.275270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f0152-2d44-4b38-a1bd-0c00cc925ab0 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:06.283948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc881b-de1b-4d89-a013-8033e7d409d2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:06.330542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be1358-13f8-4544-bf62-62b8b8ca134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:06.331178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be1358-13f8-4544-bf62-62b8b8ca134f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:06.331456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be1358-13f8-4544-bf62-62b8b8ca134f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:06.331728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be1358-13f8-4544-bf62-62b8b8ca134f None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:06.332375 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be1358-13f8-4544-bf62-62b8b8ca134f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:06.332703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be1358-13f8-4544-bf62-62b8b8ca134f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:06.334265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be1358-13f8-4544-bf62-62b8b8ca134f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:06.337149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:06.347195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 402/814] 10.222.0.83 () {56 vars in 1124 bytes} [Mon Aug 29 21:29:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:06.348234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be1358-13f8-4544-bf62-62b8b8ca134f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:06.463774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f0152-2d44-4b38-a1bd-0c00cc925ab0 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:06.481471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:06.489229 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be1358-13f8-4544-bf62-62b8b8ca134f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:06.509439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e7fe3-7c01-4402-8ddb-866cf8b2b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:06.510161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7fe3-7c01-4402-8ddb-866cf8b2b433 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:06.510445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7fe3-7c01-4402-8ddb-866cf8b2b433 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:06.510759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e7fe3-7c01-4402-8ddb-866cf8b2b433 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:06.511533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e7fe3-7c01-4402-8ddb-866cf8b2b433 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:06.511835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e7fe3-7c01-4402-8ddb-866cf8b2b433 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:06.513489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e7fe3-7c01-4402-8ddb-866cf8b2b433 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:06.548732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 413/815] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 21:29:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:06.550108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061380d-7241-4a95-9b97-a14888bc14d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:06.550357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e7fe3-7c01-4402-8ddb-866cf8b2b433 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:06.550996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061380d-7241-4a95-9b97-a14888bc14d7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:06.551246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061380d-7241-4a95-9b97-a14888bc14d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:06.551484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061380d-7241-4a95-9b97-a14888bc14d7 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:06.552196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061380d-7241-4a95-9b97-a14888bc14d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:06.552600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061380d-7241-4a95-9b97-a14888bc14d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:06.554108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061380d-7241-4a95-9b97-a14888bc14d7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:06.577203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 403/816] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 21:29:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:06.578282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061380d-7241-4a95-9b97-a14888bc14d7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:06.669960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:06.710368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e7fe3-7c01-4402-8ddb-866cf8b2b433 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:06.749796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061380d-7241-4a95-9b97-a14888bc14d7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:06.775519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94fb07-626b-4422-a8e8-2fd45b3e0a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:06.776966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94fb07-626b-4422-a8e8-2fd45b3e0a29 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:06.777435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94fb07-626b-4422-a8e8-2fd45b3e0a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:06.777922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94fb07-626b-4422-a8e8-2fd45b3e0a29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:06.779057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94fb07-626b-4422-a8e8-2fd45b3e0a29 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:06.781271 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94fb07-626b-4422-a8e8-2fd45b3e0a29 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:06.816913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a6fc7-9335-4fc0-a193-b00a562e6214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:06.816913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a6fc7-9335-4fc0-a193-b00a562e6214 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:06.816913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a6fc7-9335-4fc0-a193-b00a562e6214 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:06.816913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a6fc7-9335-4fc0-a193-b00a562e6214 None admin] PATH_INFO: `/v3/services/network` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:06.817615 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a6fc7-9335-4fc0-a193-b00a562e6214 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:06.817615 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a6fc7-9335-4fc0-a193-b00a562e6214 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b86a6fc7-9335-4fc0-a193-b00a562e6214 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:06.824284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:06.826387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:06.828150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 404/817] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:06 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:06.830879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a6fc7-9335-4fc0-a193-b00a562e6214 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:06.923038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 414/818] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:06.924097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94fb07-626b-4422-a8e8-2fd45b3e0a29 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:06.980960 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:07.051819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a6fc7-9335-4fc0-a193-b00a562e6214 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:07.096011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:07.119627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de31d44-02b9-4919-934d-6c025a8dea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:07.120748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de31d44-02b9-4919-934d-6c025a8dea3a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:07.121652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de31d44-02b9-4919-934d-6c025a8dea3a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:07.122095 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de31d44-02b9-4919-934d-6c025a8dea3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:07.140552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de31d44-02b9-4919-934d-6c025a8dea3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:07.142753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de31d44-02b9-4919-934d-6c025a8dea3a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:07.157974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94fb07-626b-4422-a8e8-2fd45b3e0a29 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-6de31d44-02b9-4919-934d-6c025a8dea3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:07.163683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:07.165037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:07.166028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:07.166028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:07.166028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:07.167557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 405/819] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:07.168583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de31d44-02b9-4919-934d-6c025a8dea3a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:07.227741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e908e5-5c22-4af5-8f19-1982a87c275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:07.229161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e908e5-5c22-4af5-8f19-1982a87c275d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:07.229161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e908e5-5c22-4af5-8f19-1982a87c275d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:07.232051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e908e5-5c22-4af5-8f19-1982a87c275d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:07.357024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de31d44-02b9-4919-934d-6c025a8dea3a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:07.384314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e908e5-5c22-4af5-8f19-1982a87c275d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:07.388615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e908e5-5c22-4af5-8f19-1982a87c275d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:07.427144 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba3203-8523-4a8e-8727-b0aa0916f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:07.428858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba3203-8523-4a8e-8727-b0aa0916f122 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:07.429451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba3203-8523-4a8e-8727-b0aa0916f122 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:07.430097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba3203-8523-4a8e-8727-b0aa0916f122 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:07.431516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba3203-8523-4a8e-8727-b0aa0916f122 None admin] RBAC: Adding query filter params (name=network) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:07.432834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba3203-8523-4a8e-8727-b0aa0916f122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:07.436574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba3203-8523-4a8e-8727-b0aa0916f122 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:07.446624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:07.453048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 406/820] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:07.456303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba3203-8523-4a8e-8727-b0aa0916f122 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:07.539716 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:07.616627 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 415/821] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:29:07.616627 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e908e5-5c22-4af5-8f19-1982a87c275d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:07.710894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba3203-8523-4a8e-8727-b0aa0916f122 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:07.789847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9fef1-395b-4bb4-89d7-f380c424926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:07.791103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9fef1-395b-4bb4-89d7-f380c424926a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:07.792239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9fef1-395b-4bb4-89d7-f380c424926a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:07.793113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9fef1-395b-4bb4-89d7-f380c424926a None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:07.794576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9fef1-395b-4bb4-89d7-f380c424926a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:07.795670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9fef1-395b-4bb4-89d7-f380c424926a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:07.798240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9fef1-395b-4bb4-89d7-f380c424926a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:07.820683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 407/822] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:07.822296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9fef1-395b-4bb4-89d7-f380c424926a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:07.835576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e908e5-5c22-4af5-8f19-1982a87c275d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:07.891244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:07.908733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77948a7-d022-4c85-a6e3-16c86d9c38de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:07.909980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77948a7-d022-4c85-a6e3-16c86d9c38de None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:07.910590 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77948a7-d022-4c85-a6e3-16c86d9c38de None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:07.911586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77948a7-d022-4c85-a6e3-16c86d9c38de None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:07.912508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77948a7-d022-4c85-a6e3-16c86d9c38de None admin] RBAC: Adding query filter params (type=network) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:07.913176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77948a7-d022-4c85-a6e3-16c86d9c38de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:07.915891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77948a7-d022-4c85-a6e3-16c86d9c38de None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:07.928534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 416/823] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:07.929115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77948a7-d022-4c85-a6e3-16c86d9c38de None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:08.014252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:08.025357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9fef1-395b-4bb4-89d7-f380c424926a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:08.085357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b09bd-e62c-43b2-8371-2f500209600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:08.086312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b09bd-e62c-43b2-8371-2f500209600c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.086738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b09bd-e62c-43b2-8371-2f500209600c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.087191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b09bd-e62c-43b2-8371-2f500209600c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.103018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b09bd-e62c-43b2-8371-2f500209600c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:08.106373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b09bd-e62c-43b2-8371-2f500209600c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-157b09bd-e62c-43b2-8371-2f500209600c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:08.132719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:08.133942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:08.135964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:08.135964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:08.135964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:08.143556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 408/824] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:08.144839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b09bd-e62c-43b2-8371-2f500209600c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:08.156031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77948a7-d022-4c85-a6e3-16c86d9c38de None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:08.230313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714fca4-fcb3-4ece-b2b8-b8d6c353628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:08.231720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714fca4-fcb3-4ece-b2b8-b8d6c353628e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.232234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714fca4-fcb3-4ece-b2b8-b8d6c353628e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.232822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714fca4-fcb3-4ece-b2b8-b8d6c353628e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.247979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714fca4-fcb3-4ece-b2b8-b8d6c353628e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:08.250840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714fca4-fcb3-4ece-b2b8-b8d6c353628e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-1714fca4-fcb3-4ece-b2b8-b8d6c353628e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:08.276711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:08.278685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:08.280531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:08.280531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:08.280531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:08.280531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:08.280531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:08.280531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:08.280531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:08.280531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:08.280531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 417/825] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:08.281491 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714fca4-fcb3-4ece-b2b8-b8d6c353628e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:08.353106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b09bd-e62c-43b2-8371-2f500209600c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:08.363722 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:08.412098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cf965-2385-498d-9fda-6d9e51e88002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:08.413035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cf965-2385-498d-9fda-6d9e51e88002 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.413510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cf965-2385-498d-9fda-6d9e51e88002 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.413931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cf965-2385-498d-9fda-6d9e51e88002 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.414986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cf965-2385-498d-9fda-6d9e51e88002 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:08.418228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cf965-2385-498d-9fda-6d9e51e88002 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:08.442058 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714fca4-fcb3-4ece-b2b8-b8d6c353628e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:08.508608 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dd820-d515-460e-b2b7-182f1f9b83c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:08.509256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd820-d515-460e-b2b7-182f1f9b83c5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.509538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd820-d515-460e-b2b7-182f1f9b83c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.509814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd820-d515-460e-b2b7-182f1f9b83c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.510751 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dd820-d515-460e-b2b7-182f1f9b83c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:08.511148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dd820-d515-460e-b2b7-182f1f9b83c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:08.512669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dd820-d515-460e-b2b7-182f1f9b83c5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:08.529561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 418/826] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:08.530633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dd820-d515-460e-b2b7-182f1f9b83c5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:08.576588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 409/827] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:08 2022] POST /identity/v3/endpoints => generated 337 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:08.576588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299411f-346f-43b5-98a1-3abad0fb7ee8 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.576588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299411f-346f-43b5-98a1-3abad0fb7ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.576588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299411f-346f-43b5-98a1-3abad0fb7ee8 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.576588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 410/828] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:08.576588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299411f-346f-43b5-98a1-3abad0fb7ee8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:08.585424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:08.746222 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dd820-d515-460e-b2b7-182f1f9b83c5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:08.748510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299411f-346f-43b5-98a1-3abad0fb7ee8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:08.772238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:08.798551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ec2fb-0b66-408f-8577-5452279c627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:08.799165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ec2fb-0b66-408f-8577-5452279c627d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.799442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ec2fb-0b66-408f-8577-5452279c627d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.799708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ec2fb-0b66-408f-8577-5452279c627d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.808357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ec2fb-0b66-408f-8577-5452279c627d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:08.811309 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ec2fb-0b66-408f-8577-5452279c627d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:08.821318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dd7e9-ead8-440d-8076-b4c81b1f4a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:08.823523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dd7e9-ead8-440d-8076-b4c81b1f4a52 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.824016 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dd7e9-ead8-440d-8076-b4c81b1f4a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.824519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dd7e9-ead8-440d-8076-b4c81b1f4a52 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-5e7ec2fb-0b66-408f-8577-5452279c627d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:08.824944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:08.825849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:08.826990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:08.826990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:08.826990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:08.826990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:08.826990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:08.826990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:08.826990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:08.826990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:08.827795 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dd7e9-ead8-440d-8076-b4c81b1f4a52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:08.827795 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dd7e9-ead8-440d-8076-b4c81b1f4a52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:08.827930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 411/829] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:08.827930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a2a4-1a0b-463b-9bbc-ab99a506e430 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:08.828747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a2a4-1a0b-463b-9bbc-ab99a506e430 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:08.829128 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dd7e9-ead8-440d-8076-b4c81b1f4a52 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:08.834448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62a2a4-1a0b-463b-9bbc-ab99a506e430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:08.855380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 419/830] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:08.856741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dd7e9-ead8-440d-8076-b4c81b1f4a52 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:08.858354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7a62a2a4-1a0b-463b-9bbc-ab99a506e430 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:08.860544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7a62a2a4-1a0b-463b-9bbc-ab99a506e430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:08.955645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:08.976263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 412/831] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:08.977217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a2a4-1a0b-463b-9bbc-ab99a506e430 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:09.088547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dd7e9-ead8-440d-8076-b4c81b1f4a52 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:09.124160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62a2a4-1a0b-463b-9bbc-ab99a506e430 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:09.164624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165032-2206-423f-8e07-3670b06fd14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:09.166457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165032-2206-423f-8e07-3670b06fd14d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.167927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165032-2206-423f-8e07-3670b06fd14d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.168736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165032-2206-423f-8e07-3670b06fd14d None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.170780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94165032-2206-423f-8e07-3670b06fd14d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:09.171772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94165032-2206-423f-8e07-3670b06fd14d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:09.175327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94165032-2206-423f-8e07-3670b06fd14d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:09.175959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95d1e5-e805-446d-a311-c8b48e195bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:09.176681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95d1e5-e805-446d-a311-c8b48e195bbf None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.176948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95d1e5-e805-446d-a311-c8b48e195bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.177219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95d1e5-e805-446d-a311-c8b48e195bbf None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/8ba9ea33e0f444b88acdc9560856dae5/roles/987f120590e04a9aa6b494c08604a0cd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.198912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95d1e5-e805-446d-a311-c8b48e195bbf None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=8ba9ea33e0f444b88acdc9560856dae5, role_id=987f120590e04a9aa6b494c08604a0cd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:09.200459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95d1e5-e805-446d-a311-c8b48e195bbf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:09.201894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 420/832] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:09.208345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165032-2206-423f-8e07-3670b06fd14d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:09.267070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:09.344657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 413/833] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:29:08 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/8ba9ea33e0f444b88acdc9560856dae5/roles/987f120590e04a9aa6b494c08604a0cd => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:29:09.381399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95d1e5-e805-446d-a311-c8b48e195bbf None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:09.421961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165032-2206-423f-8e07-3670b06fd14d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:09.456193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:09.489734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99176479-fb01-49ca-a1a4-91c24dd8f4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:09.490497 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99176479-fb01-49ca-a1a4-91c24dd8f4bf None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.490952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99176479-fb01-49ca-a1a4-91c24dd8f4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.491396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99176479-fb01-49ca-a1a4-91c24dd8f4bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.492472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99176479-fb01-49ca-a1a4-91c24dd8f4bf None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=8434659c6b164b97b5ac27fb7e4d6a26) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:09.493012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99176479-fb01-49ca-a1a4-91c24dd8f4bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:09.495583 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99176479-fb01-49ca-a1a4-91c24dd8f4bf None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:09.515227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 421/834] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:09 2022] GET /identity/v3/role_assignments?user.id=8434659c6b164b97b5ac27fb7e4d6a26&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=c0316e22a13a4034846c451753b4c14e => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:09.515227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775332d9-e5a4-4e30-b578-37b9370efb2f None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.515227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775332d9-e5a4-4e30-b578-37b9370efb2f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.515227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775332d9-e5a4-4e30-b578-37b9370efb2f None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.515227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 422/835] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:09.518365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdb4d1-e956-402c-a11e-b5256ae26fc0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.518818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdb4d1-e956-402c-a11e-b5256ae26fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.519366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdb4d1-e956-402c-a11e-b5256ae26fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.550044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-f9bdb4d1-e956-402c-a11e-b5256ae26fc0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:09.551967 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f9bdb4d1-e956-402c-a11e-b5256ae26fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:09.598235 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95d1e5-e805-446d-a311-c8b48e195bbf None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:09.657468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67d191-ca3e-4c64-8484-391c37db4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:09.658914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67d191-ca3e-4c64-8484-391c37db4804 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.659424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67d191-ca3e-4c64-8484-391c37db4804 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.659915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67d191-ca3e-4c64-8484-391c37db4804 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.684667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 423/836] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:09.685341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67d191-ca3e-4c64-8484-391c37db4804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-8c67d191-ca3e-4c64-8484-391c37db4804 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:09.696474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:09.699151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:09.701078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 414/837] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:09.712261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdb4d1-e956-402c-a11e-b5256ae26fc0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:09.766974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:09.865095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdb4d1-e956-402c-a11e-b5256ae26fc0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:09.911111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ddecb-32bb-4195-919f-5b5186000a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:09.911768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ddecb-32bb-4195-919f-5b5186000a77 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:09.912096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ddecb-32bb-4195-919f-5b5186000a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:09.912379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ddecb-32bb-4195-919f-5b5186000a77 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:09.913179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ddecb-32bb-4195-919f-5b5186000a77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:09.913537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ddecb-32bb-4195-919f-5b5186000a77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:09.915005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ddecb-32bb-4195-919f-5b5186000a77 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:09.927530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 424/838] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:09.937253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67d191-ca3e-4c64-8484-391c37db4804 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:10.025847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ddecb-32bb-4195-919f-5b5186000a77 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:10.133109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:10.140793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67d191-ca3e-4c64-8484-391c37db4804 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:10.156681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:10.175522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ddecb-32bb-4195-919f-5b5186000a77 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:10.216001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbfb89-3998-4503-b785-ac547d1e8fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:10.216700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbfb89-3998-4503-b785-ac547d1e8fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:10.216980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbfb89-3998-4503-b785-ac547d1e8fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:10.217249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbfb89-3998-4503-b785-ac547d1e8fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:10.217460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b35637-8b66-4f27-976b-c58907d765d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:10.218283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35637-8b66-4f27-976b-c58907d765d7 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:10.218866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35637-8b66-4f27-976b-c58907d765d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:10.219395 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b35637-8b66-4f27-976b-c58907d765d7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:10.220200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b35637-8b66-4f27-976b-c58907d765d7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:10.221843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b35637-8b66-4f27-976b-c58907d765d7 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:10.230232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbfb89-3998-4503-b785-ac547d1e8fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:10.231709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbfb89-3998-4503-b785-ac547d1e8fd7 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-71b35637-8b66-4f27-976b-c58907d765d7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:10.233343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:10.234628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:29:10.235874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:10.238754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 425/839] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:29:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:10.248598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b35637-8b66-4f27-976b-c58907d765d7 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-a3fbfb89-3998-4503-b785-ac547d1e8fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:10.249722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:10.250882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:10.251941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:10.251941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:10.251941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:10.251941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 415/840] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:10.262108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbfb89-3998-4503-b785-ac547d1e8fd7 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:10.409454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbfb89-3998-4503-b785-ac547d1e8fd7 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:10.446123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b35637-8b66-4f27-976b-c58907d765d7 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:10.475993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d991bbb-e5e1-4c34-8440-74621ff634d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:10.478367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991bbb-e5e1-4c34-8440-74621ff634d0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:10.479249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991bbb-e5e1-4c34-8440-74621ff634d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:10.480648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991bbb-e5e1-4c34-8440-74621ff634d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:10.482419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d991bbb-e5e1-4c34-8440-74621ff634d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:10.483343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d991bbb-e5e1-4c34-8440-74621ff634d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:10.486477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d991bbb-e5e1-4c34-8440-74621ff634d0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:10.513135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 416/841] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:10.521932 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d991bbb-e5e1-4c34-8440-74621ff634d0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:10.525690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021f82-e6a1-4a5e-8c09-395943472e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:10.527223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021f82-e6a1-4a5e-8c09-395943472e73 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:10.527684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021f82-e6a1-4a5e-8c09-395943472e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:10.528143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8021f82-e6a1-4a5e-8c09-395943472e73 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:10.529462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8021f82-e6a1-4a5e-8c09-395943472e73 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:10.529988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8021f82-e6a1-4a5e-8c09-395943472e73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:10.532660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8021f82-e6a1-4a5e-8c09-395943472e73 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:10.542853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 426/842] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:29:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:10.549590 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021f82-e6a1-4a5e-8c09-395943472e73 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:10.552751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:10.584622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:10.703996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d991bbb-e5e1-4c34-8440-74621ff634d0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:10.758606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d24125-204e-4e9e-8bb5-95465f69a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:10.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d24125-204e-4e9e-8bb5-95465f69a06e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:10.760157 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d24125-204e-4e9e-8bb5-95465f69a06e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:10.760702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d24125-204e-4e9e-8bb5-95465f69a06e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:10.761527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8021f82-e6a1-4a5e-8c09-395943472e73 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:10.771787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d24125-204e-4e9e-8bb5-95465f69a06e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:10.773843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d24125-204e-4e9e-8bb5-95465f69a06e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-93d24125-204e-4e9e-8bb5-95465f69a06e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:10.791313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:10.792946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:10.794069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:10.794069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:10.794069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:10.794069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:10.794069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:10.794069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:10.794069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:10.794069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:10.794069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 21:29:10.794069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:10.796944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 417/843] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:29:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:10.805935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d24125-204e-4e9e-8bb5-95465f69a06e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:10.839262 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7ca1a-dd12-4ea0-9f5b-7ebde6240ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:10.840323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7ca1a-dd12-4ea0-9f5b-7ebde6240ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:10.840854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7ca1a-dd12-4ea0-9f5b-7ebde6240ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:10.841447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7ca1a-dd12-4ea0-9f5b-7ebde6240ed6 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:10.842566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7ca1a-dd12-4ea0-9f5b-7ebde6240ed6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:10.843171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7ca1a-dd12-4ea0-9f5b-7ebde6240ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:10.845791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7ca1a-dd12-4ea0-9f5b-7ebde6240ed6 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:10.855229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 427/844] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:29:10 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:10.904693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:10.946131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d24125-204e-4e9e-8bb5-95465f69a06e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:10.990257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9df69-64cf-47f2-a8df-2a6989f6df82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:10.991165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9df69-64cf-47f2-a8df-2a6989f6df82 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:10.991620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9df69-64cf-47f2-a8df-2a6989f6df82 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:10.992047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9df69-64cf-47f2-a8df-2a6989f6df82 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:10.993057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9df69-64cf-47f2-a8df-2a6989f6df82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:10.993528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9df69-64cf-47f2-a8df-2a6989f6df82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:10.995781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9df69-64cf-47f2-a8df-2a6989f6df82 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:11.017846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 418/845] 10.222.0.83 () {56 vars in 1135 bytes} [Mon Aug 29 21:29:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:11.027655 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7ca1a-dd12-4ea0-9f5b-7ebde6240ed6 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:11.132418 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:11.159930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7ca1a-dd12-4ea0-9f5b-7ebde6240ed6 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:11.211579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44f49f-cd63-4f89-8730-d10e201d5f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:11.213088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44f49f-cd63-4f89-8730-d10e201d5f20 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:11.214414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44f49f-cd63-4f89-8730-d10e201d5f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:11.215165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44f49f-cd63-4f89-8730-d10e201d5f20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:11.322797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44f49f-cd63-4f89-8730-d10e201d5f20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:11.325451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f44f49f-cd63-4f89-8730-d10e201d5f20 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:11.452889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:11.494477 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 428/846] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:11 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:29:11.500895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9df69-64cf-47f2-a8df-2a6989f6df82 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:11.625002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9df69-64cf-47f2-a8df-2a6989f6df82 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:11.657873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:11.666130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c2e1-c128-4d9a-b40a-6ad07d4c39f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:11.667318 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c2e1-c128-4d9a-b40a-6ad07d4c39f5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:11.667598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c2e1-c128-4d9a-b40a-6ad07d4c39f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:11.667862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8c2e1-c128-4d9a-b40a-6ad07d4c39f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:11.680984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8c2e1-c128-4d9a-b40a-6ad07d4c39f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:11.682531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8c2e1-c128-4d9a-b40a-6ad07d4c39f5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-c1a8c2e1-c128-4d9a-b40a-6ad07d4c39f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:11.700231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:11.701330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:11.703399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:11.703399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:11.703399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:11.703399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 419/847] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:11.708826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44f49f-cd63-4f89-8730-d10e201d5f20 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:11.878283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44f49f-cd63-4f89-8730-d10e201d5f20 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:11.941116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52615f9c-19a9-47ad-953a-a1cc626a4752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:11.942382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52615f9c-19a9-47ad-953a-a1cc626a4752 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:11.942912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52615f9c-19a9-47ad-953a-a1cc626a4752 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:11.943402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52615f9c-19a9-47ad-953a-a1cc626a4752 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:11.944346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52615f9c-19a9-47ad-953a-a1cc626a4752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:11.944931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52615f9c-19a9-47ad-953a-a1cc626a4752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:11.946593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52615f9c-19a9-47ad-953a-a1cc626a4752 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:11.961780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 429/848] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:11.971187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c2e1-c128-4d9a-b40a-6ad07d4c39f5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:11.977725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44550187-1784-4b46-b22f-26d3ebddfa1a None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:11.978064 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44550187-1784-4b46-b22f-26d3ebddfa1a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:11.978273 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44550187-1784-4b46-b22f-26d3ebddfa1a None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:11.981061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 430/849] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:11.987351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac3b60-9280-438a-892d-337c69834999 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:11.987631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac3b60-9280-438a-892d-337c69834999 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:11.987905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac3b60-9280-438a-892d-337c69834999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.014419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-3bac3b60-9280-438a-892d-337c69834999 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:12.016124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3bac3b60-9280-438a-892d-337c69834999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:12.074924 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:12.148789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 431/850] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:12.158774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8c2e1-c128-4d9a-b40a-6ad07d4c39f5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:12.208890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02515049-c2fa-42e2-a7cf-e22775faa1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:12.209550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02515049-c2fa-42e2-a7cf-e22775faa1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:12.209828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02515049-c2fa-42e2-a7cf-e22775faa1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:12.210097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02515049-c2fa-42e2-a7cf-e22775faa1e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.218782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02515049-c2fa-42e2-a7cf-e22775faa1e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:12.220363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02515049-c2fa-42e2-a7cf-e22775faa1e8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-02515049-c2fa-42e2-a7cf-e22775faa1e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:12.233457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:12.234583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:12.235599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:12.235599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:12.235599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:12.235599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:12.235599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:12.235599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:12.235599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:12.235599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:12.235599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 420/851] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:12.242691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac3b60-9280-438a-892d-337c69834999 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:12.440793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac3b60-9280-438a-892d-337c69834999 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:12.487399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8611db2-1a8a-4d16-b255-27884578cef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:12.488068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611db2-1a8a-4d16-b255-27884578cef3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:12.488306 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611db2-1a8a-4d16-b255-27884578cef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:12.488585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611db2-1a8a-4d16-b255-27884578cef3 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.489313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8611db2-1a8a-4d16-b255-27884578cef3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:12.489616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8611db2-1a8a-4d16-b255-27884578cef3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:12.491082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8611db2-1a8a-4d16-b255-27884578cef3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:12.506859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 432/852] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:12.513381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02515049-c2fa-42e2-a7cf-e22775faa1e8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:12.581155 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ac94f-d3ef-49c8-b32a-2866913592f6 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:12.581510 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ac94f-d3ef-49c8-b32a-2866913592f6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:12.581691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ac94f-d3ef-49c8-b32a-2866913592f6 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.583430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 433/853] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:12.589832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c52a8-7a41-4e69-928a-99cab4fbaeb2 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:12.590140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c52a8-7a41-4e69-928a-99cab4fbaeb2 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:12.590382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c52a8-7a41-4e69-928a-99cab4fbaeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.593871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:12.622008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-974c52a8-7a41-4e69-928a-99cab4fbaeb2 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:12.624598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-974c52a8-7a41-4e69-928a-99cab4fbaeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:12.673823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:12.678742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02515049-c2fa-42e2-a7cf-e22775faa1e8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:12.727679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00d463-8593-452a-a47d-3c57fbf42b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:12.728635 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00d463-8593-452a-a47d-3c57fbf42b63 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:12.728922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00d463-8593-452a-a47d-3c57fbf42b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:12.729178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00d463-8593-452a-a47d-3c57fbf42b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.730907 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00d463-8593-452a-a47d-3c57fbf42b63 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=87128016ec014aa8b8f2fcc8ecf1037d) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:12.730907 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00d463-8593-452a-a47d-3c57fbf42b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:12.732232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00d463-8593-452a-a47d-3c57fbf42b63 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:12.740846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 421/854] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:12 2022] GET /identity/v3/role_assignments?user.id=87128016ec014aa8b8f2fcc8ecf1037d&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=c0316e22a13a4034846c451753b4c14e => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:12.741479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00d463-8593-452a-a47d-3c57fbf42b63 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:12.779204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 434/855] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:12.883117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00d463-8593-452a-a47d-3c57fbf42b63 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:12.886848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:12.928216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc38a2-63ea-434a-9548-acd61b40685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:12.928914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc38a2-63ea-434a-9548-acd61b40685d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:12.929201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc38a2-63ea-434a-9548-acd61b40685d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:12.929492 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc38a2-63ea-434a-9548-acd61b40685d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:12.930063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc38a2-63ea-434a-9548-acd61b40685d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:12.931510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc38a2-63ea-434a-9548-acd61b40685d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-45dc38a2-63ea-434a-9548-acd61b40685d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:12.942254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:12.944202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:12.946125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 422/856] 10.222.0.83 () {56 vars in 1132 bytes} [Mon Aug 29 21:29:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:12.959492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c52a8-7a41-4e69-928a-99cab4fbaeb2 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.150860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc38a2-63ea-434a-9548-acd61b40685d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.182943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c52a8-7a41-4e69-928a-99cab4fbaeb2 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:13.238198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1828a9-0a61-428f-943b-7e1cef2ca3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:13.238904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1828a9-0a61-428f-943b-7e1cef2ca3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.239177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1828a9-0a61-428f-943b-7e1cef2ca3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.239447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1828a9-0a61-428f-943b-7e1cef2ca3e5 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.240156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1828a9-0a61-428f-943b-7e1cef2ca3e5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:13.240456 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1828a9-0a61-428f-943b-7e1cef2ca3e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:13.242159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1828a9-0a61-428f-943b-7e1cef2ca3e5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:13.249787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 435/857] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:13.251141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ababf2-48bc-4d7d-b20f-d75f57d2308d None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.251439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ababf2-48bc-4d7d-b20f-d75f57d2308d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.251729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ababf2-48bc-4d7d-b20f-d75f57d2308d None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.253483 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 436/858] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:13.259493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2240b4-67e4-49dd-a5dd-38b18d0434cb None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.259743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2240b4-67e4-49dd-a5dd-38b18d0434cb None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.260023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2240b4-67e4-49dd-a5dd-38b18d0434cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.282136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-2b2240b4-67e4-49dd-a5dd-38b18d0434cb None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:13.283682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2b2240b4-67e4-49dd-a5dd-38b18d0434cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:13.304609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:13.317416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc38a2-63ea-434a-9548-acd61b40685d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:13.370844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 437/859] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:13.372196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2240b4-67e4-49dd-a5dd-38b18d0434cb None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.393723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeef247-68a3-4b24-941a-aa14821a1998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:13.394874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeef247-68a3-4b24-941a-aa14821a1998 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.395346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeef247-68a3-4b24-941a-aa14821a1998 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.395813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeef247-68a3-4b24-941a-aa14821a1998 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.418590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeef247-68a3-4b24-941a-aa14821a1998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-7aeef247-68a3-4b24-941a-aa14821a1998 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:13.431785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:13.433409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:29:13.434270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:13.441218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 423/860] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:29:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:13.443731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeef247-68a3-4b24-941a-aa14821a1998 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.515263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:13.516239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2240b4-67e4-49dd-a5dd-38b18d0434cb None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:13.589140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076df1c-184b-4f25-b3dc-c9d936f5640b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:13.590677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076df1c-184b-4f25-b3dc-c9d936f5640b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.591428 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076df1c-184b-4f25-b3dc-c9d936f5640b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.592285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076df1c-184b-4f25-b3dc-c9d936f5640b None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.594025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076df1c-184b-4f25-b3dc-c9d936f5640b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:13.595018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076df1c-184b-4f25-b3dc-c9d936f5640b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:13.597997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076df1c-184b-4f25-b3dc-c9d936f5640b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:13.613152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 438/861] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:13.665126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076df1c-184b-4f25-b3dc-c9d936f5640b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.665621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeef247-68a3-4b24-941a-aa14821a1998 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:13.714028 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:13.755482 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a090cd4-6f59-4f7b-a73e-64ec07773b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:13.756672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a090cd4-6f59-4f7b-a73e-64ec07773b43 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:13.757173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a090cd4-6f59-4f7b-a73e-64ec07773b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:13.757652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a090cd4-6f59-4f7b-a73e-64ec07773b43 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:13.759471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a090cd4-6f59-4f7b-a73e-64ec07773b43 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:13.760016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a090cd4-6f59-4f7b-a73e-64ec07773b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:13.764212 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a090cd4-6f59-4f7b-a73e-64ec07773b43 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:13.787132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 424/862] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:29:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:13.788570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a090cd4-6f59-4f7b-a73e-64ec07773b43 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:13.925309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076df1c-184b-4f25-b3dc-c9d936f5640b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:13.973300 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:13.989948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a090cd4-6f59-4f7b-a73e-64ec07773b43 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:14.009895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6fa94-ed29-47a2-aaf3-38688d74eae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:14.011887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6fa94-ed29-47a2-aaf3-38688d74eae4 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:14.012730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6fa94-ed29-47a2-aaf3-38688d74eae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:14.013500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6fa94-ed29-47a2-aaf3-38688d74eae4 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:14.015244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6fa94-ed29-47a2-aaf3-38688d74eae4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:14.019990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6fa94-ed29-47a2-aaf3-38688d74eae4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:14.056172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740106e-a6f7-45ba-8660-8326f6bb90aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:14.057257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740106e-a6f7-45ba-8660-8326f6bb90aa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:14.057807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740106e-a6f7-45ba-8660-8326f6bb90aa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:14.058305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740106e-a6f7-45ba-8660-8326f6bb90aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:14.082146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740106e-a6f7-45ba-8660-8326f6bb90aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:14.086647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740106e-a6f7-45ba-8660-8326f6bb90aa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-8740106e-a6f7-45ba-8660-8326f6bb90aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:14.124104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:14.125333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:14.126407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:14.126407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:14.126407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:14.128928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 425/863] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:14.136450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740106e-a6f7-45ba-8660-8326f6bb90aa None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:14.176965 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 439/864] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:29:13 2022] POST /identity/v3/services => generated 251 bytes in 513 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:14.333472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740106e-a6f7-45ba-8660-8326f6bb90aa None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:14.409746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf936b-04e2-4fad-9368-1cddce8431bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:14.412359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf936b-04e2-4fad-9368-1cddce8431bd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:14.412359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf936b-04e2-4fad-9368-1cddce8431bd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:14.412359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf936b-04e2-4fad-9368-1cddce8431bd None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:14.412785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf936b-04e2-4fad-9368-1cddce8431bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:14.416546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf936b-04e2-4fad-9368-1cddce8431bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:14.416546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf936b-04e2-4fad-9368-1cddce8431bd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:14.431040 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:14.437392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 426/865] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:14.445547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6fa94-ed29-47a2-aaf3-38688d74eae4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:14.602668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:14.650477 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6fa94-ed29-47a2-aaf3-38688d74eae4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:14.715912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b458-e06c-4657-980f-537565c449d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:14.717409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b458-e06c-4657-980f-537565c449d5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:14.718143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b458-e06c-4657-980f-537565c449d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:14.718853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802b458-e06c-4657-980f-537565c449d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:14.734555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802b458-e06c-4657-980f-537565c449d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:14.737726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802b458-e06c-4657-980f-537565c449d5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-5802b458-e06c-4657-980f-537565c449d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:14.761295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:14.763079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:14.764917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:14.764917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:14.764917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:14.764917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:14.764917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:14.764917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:14.764917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:14.764917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:14.764917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:29:14.764917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:14.769336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 440/866] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 21:29:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:14.778842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf936b-04e2-4fad-9368-1cddce8431bd None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:14.984844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf936b-04e2-4fad-9368-1cddce8431bd None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:15.054095 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f49a3e-435d-4356-9c22-ece5dd49d423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:15.055123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49a3e-435d-4356-9c22-ece5dd49d423 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:15.055584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49a3e-435d-4356-9c22-ece5dd49d423 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:15.056055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49a3e-435d-4356-9c22-ece5dd49d423 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:15.057545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f49a3e-435d-4356-9c22-ece5dd49d423 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:15.058087 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f49a3e-435d-4356-9c22-ece5dd49d423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:15.060874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f49a3e-435d-4356-9c22-ece5dd49d423 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:15.096999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 427/867] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 21:29:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:15.106853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b458-e06c-4657-980f-537565c449d5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:15.307053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802b458-e06c-4657-980f-537565c449d5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:15.377825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae2976-553b-44f3-89e5-c114fc297e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:15.379636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae2976-553b-44f3-89e5-c114fc297e63 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:15.379636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae2976-553b-44f3-89e5-c114fc297e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:15.379952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae2976-553b-44f3-89e5-c114fc297e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:15.387398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:15.518717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae2976-553b-44f3-89e5-c114fc297e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:15.521468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae2976-553b-44f3-89e5-c114fc297e63 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:15.669753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29096-4ed1-4246-b502-ea201732e8b9 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:15.670160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29096-4ed1-4246-b502-ea201732e8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:15.670628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29096-4ed1-4246-b502-ea201732e8b9 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:15.673686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 428/868] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:15.682546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75318309-5514-46a1-9f58-b71d344f41d8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:15.683286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75318309-5514-46a1-9f58-b71d344f41d8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:15.683730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75318309-5514-46a1-9f58-b71d344f41d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:15.719518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-75318309-5514-46a1-9f58-b71d344f41d8 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:15.720519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 441/869] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:15 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:29:15.721629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-75318309-5514-46a1-9f58-b71d344f41d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:15.729427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae2976-553b-44f3-89e5-c114fc297e63 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:15.810027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:15.823796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:15.844093 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 429/870] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:15.898383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae2976-553b-44f3-89e5-c114fc297e63 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:15.945709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b496884-5a6d-4537-9340-80efd1bc5ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:15.946293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b496884-5a6d-4537-9340-80efd1bc5ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:15.946576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b496884-5a6d-4537-9340-80efd1bc5ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:15.946889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b496884-5a6d-4537-9340-80efd1bc5ac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:15.960558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b496884-5a6d-4537-9340-80efd1bc5ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:15.962377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b496884-5a6d-4537-9340-80efd1bc5ac8 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-5b496884-5a6d-4537-9340-80efd1bc5ac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:15.980676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:15.981737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:15.982654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:15.982654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:15.982654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:15.982654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 442/871] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:15.989840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75318309-5514-46a1-9f58-b71d344f41d8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:16.127006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75318309-5514-46a1-9f58-b71d344f41d8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:16.145957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b496884-5a6d-4537-9340-80efd1bc5ac8 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:16.171356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3155bd-2adb-42fd-932d-4f2eb80eca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:16.171873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3155bd-2adb-42fd-932d-4f2eb80eca40 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.172150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3155bd-2adb-42fd-932d-4f2eb80eca40 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.172418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3155bd-2adb-42fd-932d-4f2eb80eca40 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.173126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3155bd-2adb-42fd-932d-4f2eb80eca40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:16.173428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3155bd-2adb-42fd-932d-4f2eb80eca40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:16.175939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3155bd-2adb-42fd-932d-4f2eb80eca40 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:16.196774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 430/872] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:16.200392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3155bd-2adb-42fd-932d-4f2eb80eca40 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:16.278218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:16.302124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:16.318529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b496884-5a6d-4537-9340-80efd1bc5ac8 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:16.348446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3155bd-2adb-42fd-932d-4f2eb80eca40 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:16.367046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da74a20-723a-4d03-9a70-6104f013f0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:16.367732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74a20-723a-4d03-9a70-6104f013f0fc None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.368056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74a20-723a-4d03-9a70-6104f013f0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.368378 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da74a20-723a-4d03-9a70-6104f013f0fc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.369033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da74a20-723a-4d03-9a70-6104f013f0fc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:16.370501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da74a20-723a-4d03-9a70-6104f013f0fc None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-0da74a20-723a-4d03-9a70-6104f013f0fc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:16.382218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:16.383315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:16.384263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 443/873] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:16.385167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee184f-a491-4217-baef-1141eae20f2e None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.385167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee184f-a491-4217-baef-1141eae20f2e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.385305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee184f-a491-4217-baef-1141eae20f2e None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.391165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 444/874] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:16.392256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee184f-a491-4217-baef-1141eae20f2e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:16.404082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f637-684c-4fd0-8d49-a5229dc7baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:16.405217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f637-684c-4fd0-8d49-a5229dc7baaa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.405700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f637-684c-4fd0-8d49-a5229dc7baaa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.406182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f637-684c-4fd0-8d49-a5229dc7baaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.418596 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0f637-684c-4fd0-8d49-a5229dc7baaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:16.421195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c0f637-684c-4fd0-8d49-a5229dc7baaa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-74c0f637-684c-4fd0-8d49-a5229dc7baaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:16.435503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:16.437151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:16.438668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:16.438668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:16.438668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:16.438668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:16.438668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:16.438668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:16.438668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:16.438668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:16.438668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 431/875] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:16.438668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8055-b4c6-4ec8-918f-2fb187420542 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.439607 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8055-b4c6-4ec8-918f-2fb187420542 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.439607 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8055-b4c6-4ec8-918f-2fb187420542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.460051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-541b8055-b4c6-4ec8-918f-2fb187420542 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:16.461237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-541b8055-b4c6-4ec8-918f-2fb187420542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:16.528902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee184f-a491-4217-baef-1141eae20f2e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:16.577928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 432/876] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:16.578393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4211a7-e52a-4e3a-8436-eb753e7bc904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:16.579232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b8055-b4c6-4ec8-918f-2fb187420542 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:16.579509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4211a7-e52a-4e3a-8436-eb753e7bc904 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.580040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4211a7-e52a-4e3a-8436-eb753e7bc904 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.580709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4211a7-e52a-4e3a-8436-eb753e7bc904 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.581599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4211a7-e52a-4e3a-8436-eb753e7bc904 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:16.582110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4211a7-e52a-4e3a-8436-eb753e7bc904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:16.583749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4211a7-e52a-4e3a-8436-eb753e7bc904 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:16.591613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 445/877] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 21:29:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:16.600457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4211a7-e52a-4e3a-8436-eb753e7bc904 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:16.625751 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:16.657270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:16.777641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b8055-b4c6-4ec8-918f-2fb187420542 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:16.783323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4211a7-e52a-4e3a-8436-eb753e7bc904 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:16.838706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad750908-8557-4589-825d-221e957dceb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:16.840641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad750908-8557-4589-825d-221e957dceb2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.841206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad750908-8557-4589-825d-221e957dceb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.841715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad750908-8557-4589-825d-221e957dceb2 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.842786 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad750908-8557-4589-825d-221e957dceb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:16.843315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad750908-8557-4589-825d-221e957dceb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:16.845247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad750908-8557-4589-825d-221e957dceb2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:16.855672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d7fd1-627c-493a-bec3-b0900f3759ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:16.856677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7fd1-627c-493a-bec3-b0900f3759ad None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:16.857088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7fd1-627c-493a-bec3-b0900f3759ad None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:16.858637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7fd1-627c-493a-bec3-b0900f3759ad None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:16.859598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d7fd1-627c-493a-bec3-b0900f3759ad None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:16.860037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d7fd1-627c-493a-bec3-b0900f3759ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:16.863033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d7fd1-627c-493a-bec3-b0900f3759ad None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:16.863923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 433/878] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:16.869810 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad750908-8557-4589-825d-221e957dceb2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:16.876618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 446/879] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 21:29:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:16.892842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d7fd1-627c-493a-bec3-b0900f3759ad None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:17.011727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:17.025212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:17.027293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad750908-8557-4589-825d-221e957dceb2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:17.052617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d7fd1-627c-493a-bec3-b0900f3759ad None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:17.099436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16582d-c8b2-435a-bbb3-f0b515b79648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:17.100675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16582d-c8b2-435a-bbb3-f0b515b79648 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:17.101245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16582d-c8b2-435a-bbb3-f0b515b79648 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:17.101816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16582d-c8b2-435a-bbb3-f0b515b79648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:17.103284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16582d-c8b2-435a-bbb3-f0b515b79648 None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=8ba9ea33e0f444b88acdc9560856dae5) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:17.103926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16582d-c8b2-435a-bbb3-f0b515b79648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:17.104077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e1c17-348e-49b7-89ac-302bc4c43d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:17.104769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e1c17-348e-49b7-89ac-302bc4c43d2f None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:17.105054 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e1c17-348e-49b7-89ac-302bc4c43d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:17.105328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e1c17-348e-49b7-89ac-302bc4c43d2f None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:17.106080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e1c17-348e-49b7-89ac-302bc4c43d2f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:17.107049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16582d-c8b2-435a-bbb3-f0b515b79648 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:17.107477 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e1c17-348e-49b7-89ac-302bc4c43d2f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:17.118647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 434/880] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:16 2022] GET /identity/v3/role_assignments?user.id=8ba9ea33e0f444b88acdc9560856dae5&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:17.243068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 447/881] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:29:16 2022] POST /identity/v3/services => generated 269 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:29:17.480092 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35277537-bf12-491a-96b5-322abf060586 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:17.480764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35277537-bf12-491a-96b5-322abf060586 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:17.481280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35277537-bf12-491a-96b5-322abf060586 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:17.483311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 435/882] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:17.490344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0828cc-7713-4f23-9f54-f41ef8a91b9e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:17.491248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0828cc-7713-4f23-9f54-f41ef8a91b9e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:17.491863 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0828cc-7713-4f23-9f54-f41ef8a91b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:17.514936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-fa0828cc-7713-4f23-9f54-f41ef8a91b9e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:17.516673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fa0828cc-7713-4f23-9f54-f41ef8a91b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:17.674915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 448/883] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:18.208179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35277537-bf12-491a-96b5-322abf060586 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:18.349249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35277537-bf12-491a-96b5-322abf060586 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:18.390172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c79c0-5734-4de7-aab0-314b87bba2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:18.390993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c79c0-5734-4de7-aab0-314b87bba2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:18.391441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c79c0-5734-4de7-aab0-314b87bba2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:18.391702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c79c0-5734-4de7-aab0-314b87bba2a1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:18.392269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c79c0-5734-4de7-aab0-314b87bba2a1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:18.393728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c79c0-5734-4de7-aab0-314b87bba2a1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-ed1c79c0-5734-4de7-aab0-314b87bba2a1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:18.404814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:18.406717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:18.408379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 436/884] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:29:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:18.421464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0828cc-7713-4f23-9f54-f41ef8a91b9e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:18.509222 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:18.577934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0828cc-7713-4f23-9f54-f41ef8a91b9e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:18.650027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f6af9-f036-4bab-93cd-0029cd1dd4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:18.651020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f6af9-f036-4bab-93cd-0029cd1dd4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:18.651572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f6af9-f036-4bab-93cd-0029cd1dd4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:18.652076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f6af9-f036-4bab-93cd-0029cd1dd4e8 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:18.653383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f6af9-f036-4bab-93cd-0029cd1dd4e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:18.653953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f6af9-f036-4bab-93cd-0029cd1dd4e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:18.656873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f6af9-f036-4bab-93cd-0029cd1dd4e8 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:18.667781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 449/885] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:29:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:18.677256 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c79c0-5734-4de7-aab0-314b87bba2a1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:18.727161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:18.880421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c79c0-5734-4de7-aab0-314b87bba2a1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:18.951265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2e2c8-6f0e-4db0-8663-d5b5b5702a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:18.952869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2e2c8-6f0e-4db0-8663-d5b5b5702a0a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:18.953664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2e2c8-6f0e-4db0-8663-d5b5b5702a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:18.954461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d2e2c8-6f0e-4db0-8663-d5b5b5702a0a None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:18.955964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2e2c8-6f0e-4db0-8663-d5b5b5702a0a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:18.956859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2e2c8-6f0e-4db0-8663-d5b5b5702a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:18.960049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d2e2c8-6f0e-4db0-8663-d5b5b5702a0a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:18.970937 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 437/886] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:29:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:18.981632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f6af9-f036-4bab-93cd-0029cd1dd4e8 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:19.204346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f6af9-f036-4bab-93cd-0029cd1dd4e8 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:19.265732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:19.275951 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19790788-43a3-4ea7-8c7e-a24b7f87da4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:19.277518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790788-43a3-4ea7-8c7e-a24b7f87da4b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:19.278010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790788-43a3-4ea7-8c7e-a24b7f87da4b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:19.278537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19790788-43a3-4ea7-8c7e-a24b7f87da4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:19.279961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790788-43a3-4ea7-8c7e-a24b7f87da4b None admin] RBAC: Adding query filter params (interface=public, service_id=f4e27f82b5a042a79ecd9c317131624e, region_id=RegionOne) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:19.280569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790788-43a3-4ea7-8c7e-a24b7f87da4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:19.283203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19790788-43a3-4ea7-8c7e-a24b7f87da4b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:19.294698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 450/887] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 21:29:18 2022] GET /identity/v3/endpoints?service_id=f4e27f82b5a042a79ecd9c317131624e&interface=public®ion_id=RegionOne => generated 194 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:19.303890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2e2c8-6f0e-4db0-8663-d5b5b5702a0a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:19.511365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d2e2c8-6f0e-4db0-8663-d5b5b5702a0a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:19.516915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:19.568010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2cea-328c-4ded-a6db-0ffc968e292e None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:19.568785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2cea-328c-4ded-a6db-0ffc968e292e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:19.568785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c2cea-328c-4ded-a6db-0ffc968e292e None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:19.570271 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 451/888] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:19.580011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d0a48-2ee7-44bf-9f8a-62fa9b1a2fe3 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:19.580613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d0a48-2ee7-44bf-9f8a-62fa9b1a2fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:19.581069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d0a48-2ee7-44bf-9f8a-62fa9b1a2fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:19.583424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe21c3-42eb-4766-bd56-0e14b4b84da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:19.584406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe21c3-42eb-4766-bd56-0e14b4b84da2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:19.584910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe21c3-42eb-4766-bd56-0e14b4b84da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:19.585352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe21c3-42eb-4766-bd56-0e14b4b84da2 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:19.586390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe21c3-42eb-4766-bd56-0e14b4b84da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:19.588309 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe21c3-42eb-4766-bd56-0e14b4b84da2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:19.596136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 438/889] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 21:29:19 2022] GET /identity/v3/services => generated 1268 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:19.606241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-090d0a48-2ee7-44bf-9f8a-62fa9b1a2fe3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:19.607578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-090d0a48-2ee7-44bf-9f8a-62fa9b1a2fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:19.624598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a784b2-4998-4f03-a3bc-26060ddd46cd None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:19.625011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a784b2-4998-4f03-a3bc-26060ddd46cd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:19.625275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a784b2-4998-4f03-a3bc-26060ddd46cd None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:19.627041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 439/890] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:19.634281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423dc14-4726-4e1e-9ea1-ca813bfe0b62 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:19.634617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423dc14-4726-4e1e-9ea1-ca813bfe0b62 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:19.634835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423dc14-4726-4e1e-9ea1-ca813bfe0b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:19.661817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a423dc14-4726-4e1e-9ea1-ca813bfe0b62 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:19.663244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a423dc14-4726-4e1e-9ea1-ca813bfe0b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:19.701345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 452/891] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:19.792144 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 440/892] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:19.988238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d0a48-2ee7-44bf-9f8a-62fa9b1a2fe3 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:20.136452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf7c5-5b90-4b2c-b723-a2434af7140c None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:20.136849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf7c5-5b90-4b2c-b723-a2434af7140c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:20.137126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf7c5-5b90-4b2c-b723-a2434af7140c None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:20.138707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 441/893] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:20.144454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6de5ce-aa02-483c-b34d-03bbe5a51fc6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:20.145192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6de5ce-aa02-483c-b34d-03bbe5a51fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:20.145736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6de5ce-aa02-483c-b34d-03bbe5a51fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:20.166106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9b6de5ce-aa02-483c-b34d-03bbe5a51fc6 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:20.167522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9b6de5ce-aa02-483c-b34d-03bbe5a51fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:20.177719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d0a48-2ee7-44bf-9f8a-62fa9b1a2fe3 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:20.212828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:20.230736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d15d1-2d3c-4812-b5af-31d11382ff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:20.234635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d15d1-2d3c-4812-b5af-31d11382ff06 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:20.234635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d15d1-2d3c-4812-b5af-31d11382ff06 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:20.234635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d15d1-2d3c-4812-b5af-31d11382ff06 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:20.234635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d15d1-2d3c-4812-b5af-31d11382ff06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:20.235160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d15d1-2d3c-4812-b5af-31d11382ff06 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:20.255941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 442/894] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:20.256976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6de5ce-aa02-483c-b34d-03bbe5a51fc6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:20.281616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:20.392833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 453/895] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:29:19 2022] POST /identity/v3/services => generated 241 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:20.454185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6de5ce-aa02-483c-b34d-03bbe5a51fc6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:20.541204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce497e-ce80-4e5b-894f-dc252db5fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:20.543001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce497e-ce80-4e5b-894f-dc252db5fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:20.543505 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce497e-ce80-4e5b-894f-dc252db5fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:20.544003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce497e-ce80-4e5b-894f-dc252db5fdd6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:20.566695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce497e-ce80-4e5b-894f-dc252db5fdd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-e7ce497e-ce80-4e5b-894f-dc252db5fdd6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:20.576245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:20.578181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:20.579915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:20.584761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 443/896] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 21:29:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:20.588390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d15d1-2d3c-4812-b5af-31d11382ff06 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:20.599225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce497e-ce80-4e5b-894f-dc252db5fdd6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:20.707905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:20.766107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce497e-ce80-4e5b-894f-dc252db5fdd6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:20.815679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d15d1-2d3c-4812-b5af-31d11382ff06 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:20.817295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dfc71-ce03-42d3-a5c1-a05e3bd9c305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:20.818192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dfc71-ce03-42d3-a5c1-a05e3bd9c305 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:20.819125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dfc71-ce03-42d3-a5c1-a05e3bd9c305 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:20.819689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dfc71-ce03-42d3-a5c1-a05e3bd9c305 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:20.821458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dfc71-ce03-42d3-a5c1-a05e3bd9c305 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:20.824223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dfc71-ce03-42d3-a5c1-a05e3bd9c305 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-715dfc71-ce03-42d3-a5c1-a05e3bd9c305 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:20.842568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:20.843630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:29:20.844554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:20.845308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 444/897] 10.222.0.83 () {56 vars in 1132 bytes} [Mon Aug 29 21:29:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:20.856013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dfc71-ce03-42d3-a5c1-a05e3bd9c305 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:20.870010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5819d-c99b-4338-8265-8ffb48ea95b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:20.870962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5819d-c99b-4338-8265-8ffb48ea95b5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:20.871387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5819d-c99b-4338-8265-8ffb48ea95b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:20.871801 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5819d-c99b-4338-8265-8ffb48ea95b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:20.872696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5819d-c99b-4338-8265-8ffb48ea95b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:20.873163 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5819d-c99b-4338-8265-8ffb48ea95b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:20.874803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5819d-c99b-4338-8265-8ffb48ea95b5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:20.887522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 454/898] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 21:29:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:20.897050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5819d-c99b-4338-8265-8ffb48ea95b5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:20.993589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:21.073696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dfc71-ce03-42d3-a5c1-a05e3bd9c305 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:21.121417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5819d-c99b-4338-8265-8ffb48ea95b5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:21.139507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:21.148616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595594b7-5e07-4c12-9ce9-e6d3923bfffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:21.150229 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595594b7-5e07-4c12-9ce9-e6d3923bfffb None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:21.151013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595594b7-5e07-4c12-9ce9-e6d3923bfffb None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:21.152330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595594b7-5e07-4c12-9ce9-e6d3923bfffb None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:21.153796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595594b7-5e07-4c12-9ce9-e6d3923bfffb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:21.154585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595594b7-5e07-4c12-9ce9-e6d3923bfffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:21.157495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595594b7-5e07-4c12-9ce9-e6d3923bfffb None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:21.168074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 445/899] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:21.182403 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595594b7-5e07-4c12-9ce9-e6d3923bfffb None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:21.202110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff508e-75a5-49b1-86c1-f6616a34069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:21.203252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff508e-75a5-49b1-86c1-f6616a34069b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:21.203745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff508e-75a5-49b1-86c1-f6616a34069b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:21.204462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff508e-75a5-49b1-86c1-f6616a34069b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:21.228129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff508e-75a5-49b1-86c1-f6616a34069b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:21.231317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff508e-75a5-49b1-86c1-f6616a34069b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-84ff508e-75a5-49b1-86c1-f6616a34069b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:21.262777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:21.264807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:21.266591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:21.266591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:21.266591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:21.268936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 455/900] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:21.277036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff508e-75a5-49b1-86c1-f6616a34069b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:21.393542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595594b7-5e07-4c12-9ce9-e6d3923bfffb None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:21.465484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e52c-9e9f-4c40-8e42-9c1caff945fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:21.467602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e52c-9e9f-4c40-8e42-9c1caff945fa None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:21.468282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e52c-9e9f-4c40-8e42-9c1caff945fa None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:21.468985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6e52c-9e9f-4c40-8e42-9c1caff945fa None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:21.470465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6e52c-9e9f-4c40-8e42-9c1caff945fa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:21.471085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6e52c-9e9f-4c40-8e42-9c1caff945fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:21.474215 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6e52c-9e9f-4c40-8e42-9c1caff945fa None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:21.484935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 446/901] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:21.487166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:21.493172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff508e-75a5-49b1-86c1-f6616a34069b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:21.498370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e52c-9e9f-4c40-8e42-9c1caff945fa None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:21.564777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2842b-5ca6-4d91-a171-17c6f259eed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:21.566236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2842b-5ca6-4d91-a171-17c6f259eed5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:21.566970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2842b-5ca6-4d91-a171-17c6f259eed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:21.567695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2842b-5ca6-4d91-a171-17c6f259eed5 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:21.569452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2842b-5ca6-4d91-a171-17c6f259eed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:21.570416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2842b-5ca6-4d91-a171-17c6f259eed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:21.573368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2842b-5ca6-4d91-a171-17c6f259eed5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:21.604812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 456/902] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:21.609703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2842b-5ca6-4d91-a171-17c6f259eed5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:21.622696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:21.706555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6e52c-9e9f-4c40-8e42-9c1caff945fa None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:21.770032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2842b-5ca6-4d91-a171-17c6f259eed5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:21.772464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdc1ab-d8da-4787-9c2b-e4302be9161a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:21.774164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdc1ab-d8da-4787-9c2b-e4302be9161a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:21.774164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdc1ab-d8da-4787-9c2b-e4302be9161a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:21.774627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdc1ab-d8da-4787-9c2b-e4302be9161a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:21.776235 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdc1ab-d8da-4787-9c2b-e4302be9161a None admin] RBAC: Adding query filter params (interface=public, service_id=cfd76e7c594149f1be053134908d26d8, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:21.776969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdc1ab-d8da-4787-9c2b-e4302be9161a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:21.779563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdc1ab-d8da-4787-9c2b-e4302be9161a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:21.796903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 447/903] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 21:29:21 2022] GET /identity/v3/endpoints?service_id=cfd76e7c594149f1be053134908d26d8&interface=public®ion_id=RegionOne => generated 194 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:21.799788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdc1ab-d8da-4787-9c2b-e4302be9161a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:21.815999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01d6e1-1c8d-406b-a10f-76e5fd7edca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:21.817014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01d6e1-1c8d-406b-a10f-76e5fd7edca6 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:21.817546 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01d6e1-1c8d-406b-a10f-76e5fd7edca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:21.817995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01d6e1-1c8d-406b-a10f-76e5fd7edca6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:21.828066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01d6e1-1c8d-406b-a10f-76e5fd7edca6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:21.829948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c01d6e1-1c8d-406b-a10f-76e5fd7edca6 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-1c01d6e1-1c8d-406b-a10f-76e5fd7edca6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:21.844184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:21.845340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:21.846294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:21.846294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:21.846294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:21.846294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:21.846294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:21.846294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:21.846294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:21.846294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:21.846294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:29:21.846294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:21.852721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 457/904] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 21:29:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:21.855927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01d6e1-1c8d-406b-a10f-76e5fd7edca6 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:21.880730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:21.996190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdc1ab-d8da-4787-9c2b-e4302be9161a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:22.023632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01d6e1-1c8d-406b-a10f-76e5fd7edca6 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:22.044689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:22.065601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d645f-dadb-49ac-822d-b8a44a2b605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:22.066865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d645f-dadb-49ac-822d-b8a44a2b605d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.067422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d645f-dadb-49ac-822d-b8a44a2b605d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.067985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d645f-dadb-49ac-822d-b8a44a2b605d None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.069333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d645f-dadb-49ac-822d-b8a44a2b605d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:22.071773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67b2c5-528c-4b5f-9c75-0cc4d8e06f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:22.072035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d645f-dadb-49ac-822d-b8a44a2b605d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:22.072960 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b2c5-528c-4b5f-9c75-0cc4d8e06f1a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.073503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b2c5-528c-4b5f-9c75-0cc4d8e06f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.074006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67b2c5-528c-4b5f-9c75-0cc4d8e06f1a None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.074968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67b2c5-528c-4b5f-9c75-0cc4d8e06f1a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:22.075475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67b2c5-528c-4b5f-9c75-0cc4d8e06f1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:22.077204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67b2c5-528c-4b5f-9c75-0cc4d8e06f1a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:22.093646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 448/905] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 21:29:21 2022] GET /identity/v3/services => generated 1497 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:22.114789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea1ee-7d80-4747-9665-47a02c4bfcd3 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.114789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea1ee-7d80-4747-9665-47a02c4bfcd3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.114789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aea1ee-7d80-4747-9665-47a02c4bfcd3 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.114789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 449/907] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:22.115495 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 458/907] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 21:29:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:22.118275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aea1ee-7d80-4747-9665-47a02c4bfcd3 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:22.124906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088cda9-427f-4271-97eb-636dcce0d459 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.125405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088cda9-427f-4271-97eb-636dcce0d459 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.125898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088cda9-427f-4271-97eb-636dcce0d459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.165451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9088cda9-427f-4271-97eb-636dcce0d459 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:22.168927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9088cda9-427f-4271-97eb-636dcce0d459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:22.306018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 459/908] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:22.310617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aea1ee-7d80-4747-9665-47a02c4bfcd3 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:22.375025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3558037-50e2-427b-9a42-573179a28f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:22.376007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558037-50e2-427b-9a42-573179a28f40 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.376540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558037-50e2-427b-9a42-573179a28f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.377110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3558037-50e2-427b-9a42-573179a28f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.499728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:22.525555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3558037-50e2-427b-9a42-573179a28f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:22.529027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3558037-50e2-427b-9a42-573179a28f40 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:22.598786 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088cda9-427f-4271-97eb-636dcce0d459 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:22.610176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:22.730833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 450/909] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:22 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:29:22.737439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3558037-50e2-427b-9a42-573179a28f40 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:22.748242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088cda9-427f-4271-97eb-636dcce0d459 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:22.806674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d814d1-c43f-4fbb-9e75-9074bd47db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:22.807350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d814d1-c43f-4fbb-9e75-9074bd47db98 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.807684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d814d1-c43f-4fbb-9e75-9074bd47db98 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.807966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d814d1-c43f-4fbb-9e75-9074bd47db98 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.808666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d814d1-c43f-4fbb-9e75-9074bd47db98 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:22.810508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d814d1-c43f-4fbb-9e75-9074bd47db98 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-50d814d1-c43f-4fbb-9e75-9074bd47db98 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:22.824148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:22.826065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 21:29:22.828104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:22.831117 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 460/910] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:29:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:22.832984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d814d1-c43f-4fbb-9e75-9074bd47db98 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:22.901146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:22.926953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3558037-50e2-427b-9a42-573179a28f40 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:22.980259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2805a0-68c1-4981-8448-301d14d76db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:22.981447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2805a0-68c1-4981-8448-301d14d76db8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:22.982236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2805a0-68c1-4981-8448-301d14d76db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:22.982712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2805a0-68c1-4981-8448-301d14d76db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:22.998696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2805a0-68c1-4981-8448-301d14d76db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.000740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2805a0-68c1-4981-8448-301d14d76db8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:23.015385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-bf2805a0-68c1-4981-8448-301d14d76db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:23.033873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:23.035361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:23.036287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:23.036287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:23.036287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:23.043126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 451/911] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:23.046603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2805a0-68c1-4981-8448-301d14d76db8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:23.066757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d814d1-c43f-4fbb-9e75-9074bd47db98 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:23.134343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48546916-c2a1-4368-82f1-804b9d861abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:23.135398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48546916-c2a1-4368-82f1-804b9d861abd None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.135971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48546916-c2a1-4368-82f1-804b9d861abd None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.137112 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48546916-c2a1-4368-82f1-804b9d861abd None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.138349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48546916-c2a1-4368-82f1-804b9d861abd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:23.138888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48546916-c2a1-4368-82f1-804b9d861abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.141581 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48546916-c2a1-4368-82f1-804b9d861abd None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:23.162095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 461/912] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:29:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:23.163920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48546916-c2a1-4368-82f1-804b9d861abd None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:23.261055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2805a0-68c1-4981-8448-301d14d76db8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:23.335631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cf510-ee76-47f6-8aa1-f413945a278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:23.336742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cf510-ee76-47f6-8aa1-f413945a278f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.337257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cf510-ee76-47f6-8aa1-f413945a278f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.337710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cf510-ee76-47f6-8aa1-f413945a278f None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.338819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cf510-ee76-47f6-8aa1-f413945a278f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:23.339856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cf510-ee76-47f6-8aa1-f413945a278f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.342398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cf510-ee76-47f6-8aa1-f413945a278f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:23.360410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:23.376355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 452/913] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:23.378303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cf510-ee76-47f6-8aa1-f413945a278f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:23.387548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48546916-c2a1-4368-82f1-804b9d861abd None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:23.455599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da043969-867e-40e4-9220-20c45bf06871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:23.456908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043969-867e-40e4-9220-20c45bf06871 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.457548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043969-867e-40e4-9220-20c45bf06871 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.458172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da043969-867e-40e4-9220-20c45bf06871 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.459610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da043969-867e-40e4-9220-20c45bf06871 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:23.460298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da043969-867e-40e4-9220-20c45bf06871 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.463551 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da043969-867e-40e4-9220-20c45bf06871 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:23.466516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:23.476395 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 462/914] 10.222.0.83 () {56 vars in 1114 bytes} [Mon Aug 29 21:29:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:23.483850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da043969-867e-40e4-9220-20c45bf06871 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:23.592818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cf510-ee76-47f6-8aa1-f413945a278f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:23.638781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ffcc0-e8c1-40d8-9150-0bb111d33d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:23.639417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ffcc0-e8c1-40d8-9150-0bb111d33d9d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.640143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ffcc0-e8c1-40d8-9150-0bb111d33d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.640426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ffcc0-e8c1-40d8-9150-0bb111d33d9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.652141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ffcc0-e8c1-40d8-9150-0bb111d33d9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.654491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ffcc0-e8c1-40d8-9150-0bb111d33d9d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:23.669858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da043969-867e-40e4-9220-20c45bf06871 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-458ffcc0-e8c1-40d8-9150-0bb111d33d9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:23.674434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:23.676177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:23.678191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:23.678191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:23.678191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:23.678191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:23.678191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:23.678191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:23.678191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:23.678191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:23.678191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 453/915] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:23.679154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51648cfb-3213-41f0-932c-a76f6e57e445 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.679154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51648cfb-3213-41f0-932c-a76f6e57e445 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.679970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51648cfb-3213-41f0-932c-a76f6e57e445 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.687489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 454/916] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:23.687489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51648cfb-3213-41f0-932c-a76f6e57e445 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:23.734321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe0093-07d4-4356-aa09-383545a16437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:23.735141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe0093-07d4-4356-aa09-383545a16437 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.735614 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe0093-07d4-4356-aa09-383545a16437 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.736004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe0093-07d4-4356-aa09-383545a16437 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.737005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe0093-07d4-4356-aa09-383545a16437 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.738843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe0093-07d4-4356-aa09-383545a16437 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:23.783942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:23.826157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 463/917] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:23.828131 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c07106-ae47-4a83-b88d-8a1424e53c40 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.828562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c07106-ae47-4a83-b88d-8a1424e53c40 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.828860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c07106-ae47-4a83-b88d-8a1424e53c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.850509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-a9c07106-ae47-4a83-b88d-8a1424e53c40 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:23.851730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a9c07106-ae47-4a83-b88d-8a1424e53c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:23.893257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51648cfb-3213-41f0-932c-a76f6e57e445 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:23.928376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:23.955204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 464/918] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:23.977341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20c769-dbfb-460b-adb9-ceba9985ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:23.978872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20c769-dbfb-460b-adb9-ceba9985ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:23.979653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20c769-dbfb-460b-adb9-ceba9985ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:23.980417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20c769-dbfb-460b-adb9-ceba9985ecc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:23.982227 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20c769-dbfb-460b-adb9-ceba9985ecc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:23.983066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20c769-dbfb-460b-adb9-ceba9985ecc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:23.986386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20c769-dbfb-460b-adb9-ceba9985ecc1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:24.021814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 455/919] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:24.029314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c07106-ae47-4a83-b88d-8a1424e53c40 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:24.177208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c07106-ae47-4a83-b88d-8a1424e53c40 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:24.220085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1ff17-2f2a-4854-ad49-60ed86f05901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:24.221154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ff17-2f2a-4854-ad49-60ed86f05901 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:24.221693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ff17-2f2a-4854-ad49-60ed86f05901 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:24.222165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1ff17-2f2a-4854-ad49-60ed86f05901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:24.223146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1ff17-2f2a-4854-ad49-60ed86f05901 None admin] RBAC: Adding query filter params (role.id=49450d81c24b4a9c9cfeddef6bb97052, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=8ba9ea33e0f444b88acdc9560856dae5) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:24.223670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1ff17-2f2a-4854-ad49-60ed86f05901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:24.225430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1ff17-2f2a-4854-ad49-60ed86f05901 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:24.232805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 465/920] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:24 2022] GET /identity/v3/role_assignments?user.id=8ba9ea33e0f444b88acdc9560856dae5&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=49450d81c24b4a9c9cfeddef6bb97052 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:24.255415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20c769-dbfb-460b-adb9-ceba9985ecc1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:24.393835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20c769-dbfb-460b-adb9-ceba9985ecc1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:24.415924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:24.442288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9b511-afdc-4fc5-9b35-93b6fe10267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:24.442288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9b511-afdc-4fc5-9b35-93b6fe10267f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:24.442288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9b511-afdc-4fc5-9b35-93b6fe10267f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:24.442288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9b511-afdc-4fc5-9b35-93b6fe10267f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:24.442891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9b511-afdc-4fc5-9b35-93b6fe10267f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:24.442891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9b511-afdc-4fc5-9b35-93b6fe10267f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-58e9b511-afdc-4fc5-9b35-93b6fe10267f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:24.452985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:24.454574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:24.456023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 456/921] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:24.462240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1ff17-2f2a-4854-ad49-60ed86f05901 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:24.559700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:24.636874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1ff17-2f2a-4854-ad49-60ed86f05901 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:24.662474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aac1be-0308-497e-93ff-1d6c639ae6d1 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:24.663315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aac1be-0308-497e-93ff-1d6c639ae6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:24.663315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aac1be-0308-497e-93ff-1d6c639ae6d1 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:24.664943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 457/922] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:24.671677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3880fb5-5ec1-4ee8-8213-c6534e775d75 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:24.671677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3880fb5-5ec1-4ee8-8213-c6534e775d75 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:24.672050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3880fb5-5ec1-4ee8-8213-c6534e775d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:24.699016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e3880fb5-5ec1-4ee8-8213-c6534e775d75 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:24.700185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e3880fb5-5ec1-4ee8-8213-c6534e775d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:24.704810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387d838-a0ab-421f-b167-6c70d385f088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:24.705895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387d838-a0ab-421f-b167-6c70d385f088 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:24.706367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387d838-a0ab-421f-b167-6c70d385f088 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:24.706797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387d838-a0ab-421f-b167-6c70d385f088 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:24.707981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387d838-a0ab-421f-b167-6c70d385f088 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:24.708544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387d838-a0ab-421f-b167-6c70d385f088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:24.711261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387d838-a0ab-421f-b167-6c70d385f088 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:24.721513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 466/923] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 21:29:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:24.730717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387d838-a0ab-421f-b167-6c70d385f088 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:24.840669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 458/924] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:24.876169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387d838-a0ab-421f-b167-6c70d385f088 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:24.904457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:24.949157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305649d-c07b-41f0-b88a-60145d30dbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:24.950786 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305649d-c07b-41f0-b88a-60145d30dbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:24.951592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305649d-c07b-41f0-b88a-60145d30dbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:24.952402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305649d-c07b-41f0-b88a-60145d30dbf2 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:24.954091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305649d-c07b-41f0-b88a-60145d30dbf2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:24.954979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305649d-c07b-41f0-b88a-60145d30dbf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:24.958139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305649d-c07b-41f0-b88a-60145d30dbf2 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:24.969372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 467/925] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 21:29:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:24.980510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3880fb5-5ec1-4ee8-8213-c6534e775d75 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:25.158080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3880fb5-5ec1-4ee8-8213-c6534e775d75 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:25.171394 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:25.201286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb835b-8329-40ed-ba5e-ba2584f6d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:25.202126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb835b-8329-40ed-ba5e-ba2584f6d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:25.202567 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb835b-8329-40ed-ba5e-ba2584f6d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:25.202852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb835b-8329-40ed-ba5e-ba2584f6d5d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:25.203766 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb835b-8329-40ed-ba5e-ba2584f6d5d2 None admin] RBAC: Adding query filter params (interface=public, service_id=af5a8a7607ec4967861a598ce87c642a, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:25.204068 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb835b-8329-40ed-ba5e-ba2584f6d5d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:25.205559 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb835b-8329-40ed-ba5e-ba2584f6d5d2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:25.207379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305649d-c07b-41f0-b88a-60145d30dbf2 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:25.214399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 459/926] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 21:29:24 2022] GET /identity/v3/endpoints?service_id=af5a8a7607ec4967861a598ce87c642a&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:25.222930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb835b-8329-40ed-ba5e-ba2584f6d5d2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:25.396867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305649d-c07b-41f0-b88a-60145d30dbf2 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:25.463478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb835b-8329-40ed-ba5e-ba2584f6d5d2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:25.486059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a58af-2eef-4f76-ba4d-7f36fed24afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:25.487579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a58af-2eef-4f76-ba4d-7f36fed24afa None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:25.488374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a58af-2eef-4f76-ba4d-7f36fed24afa None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:25.489125 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a58af-2eef-4f76-ba4d-7f36fed24afa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:25.490354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a58af-2eef-4f76-ba4d-7f36fed24afa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:25.492435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a58af-2eef-4f76-ba4d-7f36fed24afa None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-cb3a58af-2eef-4f76-ba4d-7f36fed24afa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:25.507088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:25.508158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 21:29:25.509267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:25.513367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 468/927] 10.222.0.83 () {56 vars in 1132 bytes} [Mon Aug 29 21:29:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:25.523099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a58af-2eef-4f76-ba4d-7f36fed24afa None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:25.524538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85da83c-1a39-42c2-bdbe-2a4404438d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:25.524868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85da83c-1a39-42c2-bdbe-2a4404438d22 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:25.525241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85da83c-1a39-42c2-bdbe-2a4404438d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:25.525522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85da83c-1a39-42c2-bdbe-2a4404438d22 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:25.526226 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85da83c-1a39-42c2-bdbe-2a4404438d22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:25.529234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85da83c-1a39-42c2-bdbe-2a4404438d22 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:25.537819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 460/928] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 21:29:25 2022] GET /identity/v3/services => generated 1497 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:29:25.613176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:25.738151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a58af-2eef-4f76-ba4d-7f36fed24afa None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:25.810751 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f685b2a-0308-42b0-9987-78ce93137d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:25.811710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f685b2a-0308-42b0-9987-78ce93137d1e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:25.812076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f685b2a-0308-42b0-9987-78ce93137d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:25.812391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f685b2a-0308-42b0-9987-78ce93137d1e None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:25.813379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f685b2a-0308-42b0-9987-78ce93137d1e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:25.813901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f685b2a-0308-42b0-9987-78ce93137d1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:25.816755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f685b2a-0308-42b0-9987-78ce93137d1e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:25.826749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 469/929] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:25.836617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85da83c-1a39-42c2-bdbe-2a4404438d22 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:25.922726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:26.047584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85da83c-1a39-42c2-bdbe-2a4404438d22 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:26.112751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a02b9-c7ea-4fb4-b356-330602721904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:26.113393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a02b9-c7ea-4fb4-b356-330602721904 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:26.113670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a02b9-c7ea-4fb4-b356-330602721904 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:26.113945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a02b9-c7ea-4fb4-b356-330602721904 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:26.114712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a02b9-c7ea-4fb4-b356-330602721904 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:26.115023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a02b9-c7ea-4fb4-b356-330602721904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:26.117452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a02b9-c7ea-4fb4-b356-330602721904 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:26.124556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 461/930] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:26.132055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f685b2a-0308-42b0-9987-78ce93137d1e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:26.346619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f685b2a-0308-42b0-9987-78ce93137d1e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:26.352056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:26.419327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4b896-307d-441c-a1df-9899a8d738f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:26.420403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b896-307d-441c-a1df-9899a8d738f4 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:26.420934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b896-307d-441c-a1df-9899a8d738f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:26.421433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b896-307d-441c-a1df-9899a8d738f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:26.422764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4b896-307d-441c-a1df-9899a8d738f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:26.425510 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4b896-307d-441c-a1df-9899a8d738f4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:26.540143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30f770-041a-46c3-810f-397cf6656c5a None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:26.540513 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30f770-041a-46c3-810f-397cf6656c5a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:26.540758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30f770-041a-46c3-810f-397cf6656c5a None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:26.542975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 462/931] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:26.547262 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 470/932] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:26.550806 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff16b8e-2dd8-4226-90ef-e7703817a238 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:26.551320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff16b8e-2dd8-4226-90ef-e7703817a238 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:26.551837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff16b8e-2dd8-4226-90ef-e7703817a238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:26.584975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1ff16b8e-2dd8-4226-90ef-e7703817a238 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:26.587361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1ff16b8e-2dd8-4226-90ef-e7703817a238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:26.701716 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 463/933] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:27.227327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4b896-307d-441c-a1df-9899a8d738f4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:27.442761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4b896-307d-441c-a1df-9899a8d738f4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:27.514260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab48e4-3c94-44b6-9179-6b22dcfa8cf6 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:27.515473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab48e4-3c94-44b6-9179-6b22dcfa8cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:27.516044 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab48e4-3c94-44b6-9179-6b22dcfa8cf6 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:27.518381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:27.519423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 464/934] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:27.519561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:27.523692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:27.523692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:27.523692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:27.524903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:27.525917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a610785-effe-41f0-96c8-5b6c91457495 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:27.527130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a610785-effe-41f0-96c8-5b6c91457495 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:27.527614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a610785-effe-41f0-96c8-5b6c91457495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:27.530357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: WARNING keystone.server.flask.common [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 21:29:27.549522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6a610785-effe-41f0-96c8-5b6c91457495 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:27.552018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6a610785-effe-41f0-96c8-5b6c91457495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:27.599098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:27.618748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.sql.core [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 21:29:27.618748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 21:29:27.618748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [parameters: {'id': '3f126b74854d4e4a907b841078169111', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 21:29:27.618748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81953) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3f126b74854d4e4a907b841078169111.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3f126b74854d4e4a907b841078169111. Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:29:27.628227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application result.read() Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 21:29:27.633780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application yield resource Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise self.value Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application session.commit() Aug 29 21:29:27.634890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self.session.flush() Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application compat.raise_( Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 21:29:27.635839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 21:29:27.636798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application result.read() Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:29:27.637731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [parameters: {'id': '3f126b74854d4e4a907b841078169111', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:27.638638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:27.640047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:27.641170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:27.641170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 21:29:27.641170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 21:29:27.641170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:27.641170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:27.641170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 21:29:27.641170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 21:29:27.641170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3f126b74854d4e4a907b841078169111. Aug 29 21:29:27.641170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:27.641170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 471/935] 10.222.0.83 () {60 vars in 1140 bytes} [Mon Aug 29 21:29:27 2022] POST /identity/v3/projects => generated 262 bytes in 404 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:27.646082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:27.674572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:27.698416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 465/936] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:27.842573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d459a72-9bc9-4538-986a-87ab86f53a78 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:27.914702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d88f6-d1bf-4a20-89b3-6c8bac32c22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:27.915881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d88f6-d1bf-4a20-89b3-6c8bac32c22b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:27.916392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d88f6-d1bf-4a20-89b3-6c8bac32c22b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:27.916914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d88f6-d1bf-4a20-89b3-6c8bac32c22b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:27.930974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d88f6-d1bf-4a20-89b3-6c8bac32c22b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:27.934237 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d88f6-d1bf-4a20-89b3-6c8bac32c22b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-310d88f6-d1bf-4a20-89b3-6c8bac32c22b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:27.956838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:27.957760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:27.958697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:27.958697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:27.958697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:27.958697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:27.958697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:27.958697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:27.958697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:27.958697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:27.963434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 472/937] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:27.967990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a610785-effe-41f0-96c8-5b6c91457495 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:27.990674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d88f6-d1bf-4a20-89b3-6c8bac32c22b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:28.133606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:28.136527 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a610785-effe-41f0-96c8-5b6c91457495 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:28.163131 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d88f6-d1bf-4a20-89b3-6c8bac32c22b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:28.194485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434db32-87af-42ec-8f59-52ebd7ef8b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:28.195112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434db32-87af-42ec-8f59-52ebd7ef8b5c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:28.195394 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434db32-87af-42ec-8f59-52ebd7ef8b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:28.195656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434db32-87af-42ec-8f59-52ebd7ef8b5c None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:28.196331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434db32-87af-42ec-8f59-52ebd7ef8b5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:28.197379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434db32-87af-42ec-8f59-52ebd7ef8b5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:28.199008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434db32-87af-42ec-8f59-52ebd7ef8b5c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:28.226983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 466/938] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:28.226983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e064a-a8ba-4f1b-bf98-fe1a7d3ed810 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:28.226983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e064a-a8ba-4f1b-bf98-fe1a7d3ed810 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:28.226983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e064a-a8ba-4f1b-bf98-fe1a7d3ed810 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:28.227703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 467/939] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:28.229265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d950bc6-3b61-4d16-865b-23fb8cb29f9d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:28.229548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d950bc6-3b61-4d16-865b-23fb8cb29f9d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:28.230479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d950bc6-3b61-4d16-865b-23fb8cb29f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:28.232749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b77d1-4409-4a9c-86d5-4eeac8263cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:28.233822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b77d1-4409-4a9c-86d5-4eeac8263cbb None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:28.234394 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b77d1-4409-4a9c-86d5-4eeac8263cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:28.234830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b77d1-4409-4a9c-86d5-4eeac8263cbb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:28.252556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5d950bc6-3b61-4d16-865b-23fb8cb29f9d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:28.253893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5d950bc6-3b61-4d16-865b-23fb8cb29f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:28.256142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b77d1-4409-4a9c-86d5-4eeac8263cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-390b77d1-4409-4a9c-86d5-4eeac8263cbb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:28.268323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:28.269441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:28.270381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:28.271039 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 473/940] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 21:29:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:28.279005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:28.279771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b77d1-4409-4a9c-86d5-4eeac8263cbb None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:28.361039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 468/941] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:28.488779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b77d1-4409-4a9c-86d5-4eeac8263cbb None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:28.555503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67569770-9738-451c-9c7c-4da0a4feba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:28.556608 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67569770-9738-451c-9c7c-4da0a4feba2d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:28.557115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67569770-9738-451c-9c7c-4da0a4feba2d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:28.557612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67569770-9738-451c-9c7c-4da0a4feba2d None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:28.559009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67569770-9738-451c-9c7c-4da0a4feba2d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:28.559478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67569770-9738-451c-9c7c-4da0a4feba2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:28.562142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67569770-9738-451c-9c7c-4da0a4feba2d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:28.566189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:28.584031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 474/942] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 21:29:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:28.589967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d950bc6-3b61-4d16-865b-23fb8cb29f9d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:28.661512 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67569770-9738-451c-9c7c-4da0a4feba2d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:28.743785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d950bc6-3b61-4d16-865b-23fb8cb29f9d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:28.787241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e0fb-b66e-4991-a2e4-62d783bc1557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:28.787914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e0fb-b66e-4991-a2e4-62d783bc1557 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:28.788189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e0fb-b66e-4991-a2e4-62d783bc1557 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:28.788458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6027e0fb-b66e-4991-a2e4-62d783bc1557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:28.800610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027e0fb-b66e-4991-a2e4-62d783bc1557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:28.802784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6027e0fb-b66e-4991-a2e4-62d783bc1557 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:28.813255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-6027e0fb-b66e-4991-a2e4-62d783bc1557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:28.821185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:28.822241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:28.823241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:28.823241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:28.823241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:28.827703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 469/943] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:28.830398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e0fb-b66e-4991-a2e4-62d783bc1557 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:28.889752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67569770-9738-451c-9c7c-4da0a4feba2d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:28.956140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6027e0fb-b66e-4991-a2e4-62d783bc1557 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:28.965970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d924f9c-9c9c-478b-a012-eb5249bec72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:28.967046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d924f9c-9c9c-478b-a012-eb5249bec72f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:28.967521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d924f9c-9c9c-478b-a012-eb5249bec72f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:28.968137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d924f9c-9c9c-478b-a012-eb5249bec72f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:28.969141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d924f9c-9c9c-478b-a012-eb5249bec72f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:28.971813 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d924f9c-9c9c-478b-a012-eb5249bec72f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-9d924f9c-9c9c-478b-a012-eb5249bec72f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:28.990264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:28.992865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:28.994994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 475/944] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:29.005137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d924f9c-9c9c-478b-a012-eb5249bec72f None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:29.013970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c015d3-4348-460d-ba3a-017ffb78e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:29.013970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c015d3-4348-460d-ba3a-017ffb78e91a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:29.013970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c015d3-4348-460d-ba3a-017ffb78e91a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:29.015423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c015d3-4348-460d-ba3a-017ffb78e91a None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:29.015423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c015d3-4348-460d-ba3a-017ffb78e91a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:29.015870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c015d3-4348-460d-ba3a-017ffb78e91a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:29.017944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c015d3-4348-460d-ba3a-017ffb78e91a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:29.040766 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 470/945] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:29.045126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c015d3-4348-460d-ba3a-017ffb78e91a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:29.104604 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:29.155080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d924f9c-9c9c-478b-a012-eb5249bec72f None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:29.184238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:29.206546 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08aeb3-0352-475f-9e1e-96ccde50908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:29.207706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08aeb3-0352-475f-9e1e-96ccde50908e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:29.208175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08aeb3-0352-475f-9e1e-96ccde50908e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:29.208705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08aeb3-0352-475f-9e1e-96ccde50908e None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:29.209573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08aeb3-0352-475f-9e1e-96ccde50908e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:29.210086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08aeb3-0352-475f-9e1e-96ccde50908e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:29.211695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08aeb3-0352-475f-9e1e-96ccde50908e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:29.223791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 476/946] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 21:29:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:29.225204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08aeb3-0352-475f-9e1e-96ccde50908e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:29.272161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c015d3-4348-460d-ba3a-017ffb78e91a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:29.341826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117da3a1-4d80-4731-917b-e73ab1852ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:29.343399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117da3a1-4d80-4731-917b-e73ab1852ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:29.343966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117da3a1-4d80-4731-917b-e73ab1852ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:29.344588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117da3a1-4d80-4731-917b-e73ab1852ab2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:29.361419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117da3a1-4d80-4731-917b-e73ab1852ab2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:29.364150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117da3a1-4d80-4731-917b-e73ab1852ab2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:29.365000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08aeb3-0352-475f-9e1e-96ccde50908e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-117da3a1-4d80-4731-917b-e73ab1852ab2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:29.389388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:29.391307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:29.392374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:29.392374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:29.392374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:29.392374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:29.392374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:29.392374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:29.392374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:29.392374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:29.392374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:29:29.392374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:29.395354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 471/947] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 21:29:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:29.406177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117da3a1-4d80-4731-917b-e73ab1852ab2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:29.408891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:29.421206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ea808-2e8d-4052-b5c2-32cb9af106aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:29.422338 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ea808-2e8d-4052-b5c2-32cb9af106aa None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:29.422989 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ea808-2e8d-4052-b5c2-32cb9af106aa None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:29.423613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ea808-2e8d-4052-b5c2-32cb9af106aa None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:29.424560 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ea808-2e8d-4052-b5c2-32cb9af106aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:29.425095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ea808-2e8d-4052-b5c2-32cb9af106aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:29.427475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ea808-2e8d-4052-b5c2-32cb9af106aa None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:29.436181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 477/948] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 21:29:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:29.446370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ea808-2e8d-4052-b5c2-32cb9af106aa None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:29.562862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117da3a1-4d80-4731-917b-e73ab1852ab2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:29.594976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:29.617979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ea808-2e8d-4052-b5c2-32cb9af106aa None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:29.619500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f0b2c-4e95-4d01-bac1-fdb1002dd964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:29.623132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f0b2c-4e95-4d01-bac1-fdb1002dd964 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:29.623849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f0b2c-4e95-4d01-bac1-fdb1002dd964 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:29.624595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f0b2c-4e95-4d01-bac1-fdb1002dd964 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:29.626263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f0b2c-4e95-4d01-bac1-fdb1002dd964 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:29.627103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f0b2c-4e95-4d01-bac1-fdb1002dd964 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:29.630170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f0b2c-4e95-4d01-bac1-fdb1002dd964 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:29.675691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 472/949] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 21:29:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:29.677654 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f0b2c-4e95-4d01-bac1-fdb1002dd964 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:29.681995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efea00-130e-4b49-b267-7291f8be7c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:29.683899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efea00-130e-4b49-b267-7291f8be7c77 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:29.684358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efea00-130e-4b49-b267-7291f8be7c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:29.684810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efea00-130e-4b49-b267-7291f8be7c77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:29.687128 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efea00-130e-4b49-b267-7291f8be7c77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:29.689890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efea00-130e-4b49-b267-7291f8be7c77 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:29.803331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 478/950] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:29.838573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f0b2c-4e95-4d01-bac1-fdb1002dd964 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:29.927963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d13638-b8cf-40b4-88b8-e9eca60e88cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:29.929205 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d13638-b8cf-40b4-88b8-e9eca60e88cc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:29.929686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d13638-b8cf-40b4-88b8-e9eca60e88cc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:29.930217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d13638-b8cf-40b4-88b8-e9eca60e88cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:29.953891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d13638-b8cf-40b4-88b8-e9eca60e88cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:29.956836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d13638-b8cf-40b4-88b8-e9eca60e88cc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-07d13638-b8cf-40b4-88b8-e9eca60e88cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:29.990084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:29.991161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:29.992111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:29.992111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:29.992111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:29.992774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 473/951] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:30.008000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efea00-130e-4b49-b267-7291f8be7c77 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:30.076204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:30.115826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c768e0-61b2-40e0-ab11-e4ef9fc4e0e3 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:30.116203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c768e0-61b2-40e0-ab11-e4ef9fc4e0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:30.116899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c768e0-61b2-40e0-ab11-e4ef9fc4e0e3 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:30.120237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 474/952] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:30.129132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85df04-2315-42b0-a5d9-505f529ed78a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:30.129604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85df04-2315-42b0-a5d9-505f529ed78a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:30.130577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85df04-2315-42b0-a5d9-505f529ed78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:30.150639 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efea00-130e-4b49-b267-7291f8be7c77 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:30.168155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0e85df04-2315-42b0-a5d9-505f529ed78a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:30.170645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0e85df04-2315-42b0-a5d9-505f529ed78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:30.195292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391c5b-7490-4694-b9a0-42f954fb9056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:30.196329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391c5b-7490-4694-b9a0-42f954fb9056 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:30.196844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391c5b-7490-4694-b9a0-42f954fb9056 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:30.197647 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76391c5b-7490-4694-b9a0-42f954fb9056 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:30.199157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76391c5b-7490-4694-b9a0-42f954fb9056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:30.200706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76391c5b-7490-4694-b9a0-42f954fb9056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:30.202472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76391c5b-7490-4694-b9a0-42f954fb9056 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:30.217733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:30.223371 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 479/953] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:30.237107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391c5b-7490-4694-b9a0-42f954fb9056 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:30.296544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 475/954] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:30.397788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76391c5b-7490-4694-b9a0-42f954fb9056 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:30.407784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:30.442413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eeb3d-3787-4fce-a7a2-2f531a5df82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:30.443388 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eeb3d-3787-4fce-a7a2-2f531a5df82d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:30.443713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eeb3d-3787-4fce-a7a2-2f531a5df82d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:30.443986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eeb3d-3787-4fce-a7a2-2f531a5df82d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:30.453323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eeb3d-3787-4fce-a7a2-2f531a5df82d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:30.454913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eeb3d-3787-4fce-a7a2-2f531a5df82d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-291eeb3d-3787-4fce-a7a2-2f531a5df82d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:30.468719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:30.470452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:30.472182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:30.472182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:30.472182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:30.472182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:30.472182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:30.472182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:30.472182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:30.472182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:30.472182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 480/955] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:30.483967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85df04-2315-42b0-a5d9-505f529ed78a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:30.580980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eeb3d-3787-4fce-a7a2-2f531a5df82d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:30.622727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85df04-2315-42b0-a5d9-505f529ed78a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:30.666946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7022bb-08ea-445e-ac57-154b3ff73e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:30.668199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7022bb-08ea-445e-ac57-154b3ff73e4d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:30.668682 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7022bb-08ea-445e-ac57-154b3ff73e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:30.669122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7022bb-08ea-445e-ac57-154b3ff73e4d None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:30.670540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7022bb-08ea-445e-ac57-154b3ff73e4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:30.671061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7022bb-08ea-445e-ac57-154b3ff73e4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:30.672917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7022bb-08ea-445e-ac57-154b3ff73e4d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:30.687405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 476/956] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:30.696432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7022bb-08ea-445e-ac57-154b3ff73e4d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:30.734091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:30.743749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eeb3d-3787-4fce-a7a2-2f531a5df82d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:30.820329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26858a0a-c555-49f6-a99e-9d72e3b73711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:30.821871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858a0a-c555-49f6-a99e-9d72e3b73711 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:30.822593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858a0a-c555-49f6-a99e-9d72e3b73711 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:30.823245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858a0a-c555-49f6-a99e-9d72e3b73711 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:30.825159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26858a0a-c555-49f6-a99e-9d72e3b73711 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:30.828211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26858a0a-c555-49f6-a99e-9d72e3b73711 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:30.839316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7022bb-08ea-445e-ac57-154b3ff73e4d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-26858a0a-c555-49f6-a99e-9d72e3b73711 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:30.846476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:30.848724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:29:30.850470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:30.855287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 481/957] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:30.865497 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26858a0a-c555-49f6-a99e-9d72e3b73711 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:30.894921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7a525-b1bc-4339-b630-102274543802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:30.895608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a525-b1bc-4339-b630-102274543802 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:30.895884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a525-b1bc-4339-b630-102274543802 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:30.896160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7a525-b1bc-4339-b630-102274543802 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/8ba9ea33e0f444b88acdc9560856dae5/roles/49450d81c24b4a9c9cfeddef6bb97052` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:30.899082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7a525-b1bc-4339-b630-102274543802 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=8ba9ea33e0f444b88acdc9560856dae5, role_id=49450d81c24b4a9c9cfeddef6bb97052)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:30.900605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7a525-b1bc-4339-b630-102274543802 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:30.939213 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:31.031867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 477/958] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:29:30 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/8ba9ea33e0f444b88acdc9560856dae5/roles/49450d81c24b4a9c9cfeddef6bb97052 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:29:31.034822 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d2c5e-8039-4d79-bffa-bad56c4e9036 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:31.034822 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d2c5e-8039-4d79-bffa-bad56c4e9036 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:31.035130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d2c5e-8039-4d79-bffa-bad56c4e9036 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:31.037919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 478/959] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:31.048271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ad26-5999-4cf5-8fdf-7d8eb658a35b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:31.048712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ad26-5999-4cf5-8fdf-7d8eb658a35b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:31.049236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9ad26-5999-4cf5-8fdf-7d8eb658a35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:31.087554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-dac9ad26-5999-4cf5-8fdf-7d8eb658a35b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:31.090849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dac9ad26-5999-4cf5-8fdf-7d8eb658a35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:31.092348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26858a0a-c555-49f6-a99e-9d72e3b73711 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:31.177993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7af609-53cd-4eb2-8647-b68cc4206e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:31.179100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7af609-53cd-4eb2-8647-b68cc4206e96 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:31.179554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7af609-53cd-4eb2-8647-b68cc4206e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:31.180028 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7af609-53cd-4eb2-8647-b68cc4206e96 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:31.181214 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7af609-53cd-4eb2-8647-b68cc4206e96 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:31.181754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7af609-53cd-4eb2-8647-b68cc4206e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:31.184467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7af609-53cd-4eb2-8647-b68cc4206e96 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:31.202114 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 482/960] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:31.207071 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7af609-53cd-4eb2-8647-b68cc4206e96 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:31.263082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 479/961] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:31.421081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:31.434436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7af609-53cd-4eb2-8647-b68cc4206e96 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:31.507434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba0739-2add-4b65-be49-8765a6a5b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:31.508648 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba0739-2add-4b65-be49-8765a6a5b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:31.509164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba0739-2add-4b65-be49-8765a6a5b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:31.509666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba0739-2add-4b65-be49-8765a6a5b3b3 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:31.510905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba0739-2add-4b65-be49-8765a6a5b3b3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:31.511498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba0739-2add-4b65-be49-8765a6a5b3b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:31.514303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba0739-2add-4b65-be49-8765a6a5b3b3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:31.523921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 483/962] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:31.774149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9ad26-5999-4cf5-8fdf-7d8eb658a35b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:31.786601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:31.955034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9ad26-5999-4cf5-8fdf-7d8eb658a35b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:32.028276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:32.029502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:32.030085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:32.030693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.031985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:32.038713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:32.043916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WARNING keystone.server.flask.common [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 21:29:32.125029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.sql.core [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 21:29:32.125029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 21:29:32.125029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [parameters: {'user_id': '1ffbf38754224a04a931bd40f84c0a61', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 21:29:32.125029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81954) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application result.read() Aug 29 21:29:32.157393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:29:32.158944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application yield resource Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application next(self.gen) Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise self.value Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application session.commit() Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 21:29:32.159924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self.session.flush() Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application compat.raise_( Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 21:29:32.161543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 21:29:32.163217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application conn.query(q) Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application result.read() Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 21:29:32.171931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [parameters: {'user_id': '1ffbf38754224a04a931bd40f84c0a61', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:32.173079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 21:29:32.174079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 21:29:32.175280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 21:29:32.175280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 21:29:32.175280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 21:29:32.175280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 21:29:32.175280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 21:29:32.175280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:32.175280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 480/963] 10.222.0.83 () {60 vars in 1131 bytes} [Mon Aug 29 21:29:31 2022] POST /identity/v3/users => generated 160 bytes in 387 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:32.175893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba0739-2add-4b65-be49-8765a6a5b3b3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:32.346507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba0739-2add-4b65-be49-8765a6a5b3b3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:32.389381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfceb1-be80-4e64-a722-92378a460daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:32.390247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfceb1-be80-4e64-a722-92378a460daa None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:32.390653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfceb1-be80-4e64-a722-92378a460daa None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:32.391049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfceb1-be80-4e64-a722-92378a460daa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.400516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfceb1-be80-4e64-a722-92378a460daa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:32.402282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfceb1-be80-4e64-a722-92378a460daa None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-b7cfceb1-be80-4e64-a722-92378a460daa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:32.416056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:32.418677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:32.421014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 484/964] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:29:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:32.430009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:32.545342 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:32.565022 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af8f6-7876-46e9-a2eb-e88ab88be394 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:32.565699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af8f6-7876-46e9-a2eb-e88ab88be394 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:32.566223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af8f6-7876-46e9-a2eb-e88ab88be394 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.568660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 485/965] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:32.574597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648dade-a5fb-44bd-be74-04b8ebbe602d None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:32.575008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648dade-a5fb-44bd-be74-04b8ebbe602d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:32.575389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648dade-a5fb-44bd-be74-04b8ebbe602d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.607674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-a648dade-a5fb-44bd-be74-04b8ebbe602d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:32.609987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a648dade-a5fb-44bd-be74-04b8ebbe602d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:32.628240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f020a29-5258-4700-ad48-6adc037efaa6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:32.630378 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:32.682360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bab8f3-39b1-40d3-85bc-dce2f3455108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:32.683805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bab8f3-39b1-40d3-85bc-dce2f3455108 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:32.684192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bab8f3-39b1-40d3-85bc-dce2f3455108 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:32.684700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bab8f3-39b1-40d3-85bc-dce2f3455108 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:32.686034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bab8f3-39b1-40d3-85bc-dce2f3455108 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:32.686528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bab8f3-39b1-40d3-85bc-dce2f3455108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:32.688410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bab8f3-39b1-40d3-85bc-dce2f3455108 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:32.742740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 481/966] 10.222.0.83 () {56 vars in 1101 bytes} [Mon Aug 29 21:29:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:32.752731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 486/967] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:33.247743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bab8f3-39b1-40d3-85bc-dce2f3455108 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:33.440595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bab8f3-39b1-40d3-85bc-dce2f3455108 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:33.488522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:33.505210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca28d3b-13a4-4673-bd4a-634adf4c939b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:33.506202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca28d3b-13a4-4673-bd4a-634adf4c939b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:33.506626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca28d3b-13a4-4673-bd4a-634adf4c939b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:33.507052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca28d3b-13a4-4673-bd4a-634adf4c939b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:33.507998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca28d3b-13a4-4673-bd4a-634adf4c939b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:33.510355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca28d3b-13a4-4673-bd4a-634adf4c939b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-8ca28d3b-13a4-4673-bd4a-634adf4c939b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:33.527350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:33.529460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:33.531143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:33.540863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 482/968] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:33.543487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648dade-a5fb-44bd-be74-04b8ebbe602d None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:33.703507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648dade-a5fb-44bd-be74-04b8ebbe602d None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:33.746814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58acb13-2cf8-4b1f-b1e1-ad96c01cc05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:33.747603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58acb13-2cf8-4b1f-b1e1-ad96c01cc05e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:33.747858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58acb13-2cf8-4b1f-b1e1-ad96c01cc05e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:33.748198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58acb13-2cf8-4b1f-b1e1-ad96c01cc05e None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:33.749011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58acb13-2cf8-4b1f-b1e1-ad96c01cc05e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:33.749322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58acb13-2cf8-4b1f-b1e1-ad96c01cc05e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:33.750738 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58acb13-2cf8-4b1f-b1e1-ad96c01cc05e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:33.760546 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 487/969] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 21:29:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:33.771485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca28d3b-13a4-4673-bd4a-634adf4c939b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:33.993075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca28d3b-13a4-4673-bd4a-634adf4c939b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:34.039700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989af06-0b74-4011-a519-16545217b7f7 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.040091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989af06-0b74-4011-a519-16545217b7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.040588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989af06-0b74-4011-a519-16545217b7f7 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.043247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 488/970] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:34.051918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e81ace-8eb7-4b27-a264-ea96ae999f01 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.052417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e81ace-8eb7-4b27-a264-ea96ae999f01 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.052924 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e81ace-8eb7-4b27-a264-ea96ae999f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.063396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1dc92-296b-489a-a5f0-f63b53cfc021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:34.064450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1dc92-296b-489a-a5f0-f63b53cfc021 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.065012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1dc92-296b-489a-a5f0-f63b53cfc021 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.065500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1dc92-296b-489a-a5f0-f63b53cfc021 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.066666 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1dc92-296b-489a-a5f0-f63b53cfc021 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:34.067192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1dc92-296b-489a-a5f0-f63b53cfc021 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:34.069794 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1dc92-296b-489a-a5f0-f63b53cfc021 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:34.084947 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 483/971] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 21:29:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:34.085184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-76e81ace-8eb7-4b27-a264-ea96ae999f01 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:34.085502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-76e81ace-8eb7-4b27-a264-ea96ae999f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:34.086877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1dc92-296b-489a-a5f0-f63b53cfc021 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:34.101606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:34.201063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:34.219466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 489/972] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:34.221648 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16043049-bc21-449d-9ad7-efa071b0a13a None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.222140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16043049-bc21-449d-9ad7-efa071b0a13a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.222746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16043049-bc21-449d-9ad7-efa071b0a13a None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.225450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 490/973] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:34.234367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487fb67-a1c9-4544-95a0-73ed2ffc174f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.234845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487fb67-a1c9-4544-95a0-73ed2ffc174f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.235318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487fb67-a1c9-4544-95a0-73ed2ffc174f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.262074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1dc92-296b-489a-a5f0-f63b53cfc021 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:34.266899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c487fb67-a1c9-4544-95a0-73ed2ffc174f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:34.268985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c487fb67-a1c9-4544-95a0-73ed2ffc174f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:34.318750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404dbd8-d235-4884-914b-63c80edd7b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:34.319785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404dbd8-d235-4884-914b-63c80edd7b63 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.320296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404dbd8-d235-4884-914b-63c80edd7b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.320782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404dbd8-d235-4884-914b-63c80edd7b63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.322033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404dbd8-d235-4884-914b-63c80edd7b63 None admin] RBAC: Adding query filter params (interface=admin, service_id=af5a8a7607ec4967861a598ce87c642a, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:34.322573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404dbd8-d235-4884-914b-63c80edd7b63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:34.325033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404dbd8-d235-4884-914b-63c80edd7b63 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:34.334402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 484/974] 10.222.0.83 () {56 vars in 1249 bytes} [Mon Aug 29 21:29:34 2022] GET /identity/v3/endpoints?service_id=af5a8a7607ec4967861a598ce87c642a&interface=admin®ion_id=RegionOne => generated 193 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:34.341305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404dbd8-d235-4884-914b-63c80edd7b63 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:34.398903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 491/975] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:34.482812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404dbd8-d235-4884-914b-63c80edd7b63 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:34.509665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:34.513023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487fb67-a1c9-4544-95a0-73ed2ffc174f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:34.534337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffaa3d-df1f-449e-9911-61a9295e8496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:34.534986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffaa3d-df1f-449e-9911-61a9295e8496 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.535237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffaa3d-df1f-449e-9911-61a9295e8496 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.535506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffaa3d-df1f-449e-9911-61a9295e8496 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.536132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffaa3d-df1f-449e-9911-61a9295e8496 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:34.537587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffaa3d-df1f-449e-9911-61a9295e8496 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:34.545174 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 485/976] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 21:29:34 2022] GET /identity/v3/services => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:29:34.611952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:34.658347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487fb67-a1c9-4544-95a0-73ed2ffc174f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:34.720120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0db77-7992-4844-8cae-2aefdddb85da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:34.721173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0db77-7992-4844-8cae-2aefdddb85da None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.721561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0db77-7992-4844-8cae-2aefdddb85da None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.722727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0db77-7992-4844-8cae-2aefdddb85da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.738644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0db77-7992-4844-8cae-2aefdddb85da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-f3c0db77-7992-4844-8cae-2aefdddb85da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:34.743787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:34.745776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:34.747526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 492/977] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 21:29:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:34.752762 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffaa3d-df1f-449e-9911-61a9295e8496 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:34.888517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0db77-7992-4844-8cae-2aefdddb85da None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:34.890766 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffaa3d-df1f-449e-9911-61a9295e8496 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:34.937209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966a114-9349-48ed-abde-f9a5f578afad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:34.937839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966a114-9349-48ed-abde-f9a5f578afad None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:34.938123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966a114-9349-48ed-abde-f9a5f578afad None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:34.938398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966a114-9349-48ed-abde-f9a5f578afad None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:34.939080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966a114-9349-48ed-abde-f9a5f578afad None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:34.939385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966a114-9349-48ed-abde-f9a5f578afad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:34.940878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966a114-9349-48ed-abde-f9a5f578afad None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:34.956735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 486/978] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 21:29:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:34.963353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966a114-9349-48ed-abde-f9a5f578afad None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:35.037054 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:35.075690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0db77-7992-4844-8cae-2aefdddb85da None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:35.117487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966a114-9349-48ed-abde-f9a5f578afad None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:35.119683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:35.127528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd420a-cf93-4dc9-a078-a96aa0e842b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:35.128165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd420a-cf93-4dc9-a078-a96aa0e842b5 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:35.128467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd420a-cf93-4dc9-a078-a96aa0e842b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:35.128757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd420a-cf93-4dc9-a078-a96aa0e842b5 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:35.129448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd420a-cf93-4dc9-a078-a96aa0e842b5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:35.131292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd420a-cf93-4dc9-a078-a96aa0e842b5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:35.177021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691337cb-5bff-4aca-b8aa-9738dbce0de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:35.177021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691337cb-5bff-4aca-b8aa-9738dbce0de4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:35.177021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691337cb-5bff-4aca-b8aa-9738dbce0de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:35.177021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691337cb-5bff-4aca-b8aa-9738dbce0de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:35.185785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691337cb-5bff-4aca-b8aa-9738dbce0de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:35.190769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691337cb-5bff-4aca-b8aa-9738dbce0de4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-691337cb-5bff-4aca-b8aa-9738dbce0de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:35.207867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:35.209818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:35.211578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:35.211578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:35.211578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:35.211578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 487/979] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:35.216746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691337cb-5bff-4aca-b8aa-9738dbce0de4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:35.292911 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 493/980] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:29:34 2022] POST /identity/v3/services => generated 242 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:29:35.356538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:35.366842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691337cb-5bff-4aca-b8aa-9738dbce0de4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:35.424915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b3240-0a2a-44af-9a8d-7ac8a0650a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:35.425723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b3240-0a2a-44af-9a8d-7ac8a0650a9c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:35.426148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b3240-0a2a-44af-9a8d-7ac8a0650a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:35.426547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741b3240-0a2a-44af-9a8d-7ac8a0650a9c None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:35.427452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b3240-0a2a-44af-9a8d-7ac8a0650a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:35.427841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b3240-0a2a-44af-9a8d-7ac8a0650a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:35.429573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741b3240-0a2a-44af-9a8d-7ac8a0650a9c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:35.450150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 488/981] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:35.452859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd420a-cf93-4dc9-a078-a96aa0e842b5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:35.633024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd420a-cf93-4dc9-a078-a96aa0e842b5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:35.688651 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4181-1150-4285-a561-030d266912a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:35.689098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4181-1150-4285-a561-030d266912a1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:35.689388 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4181-1150-4285-a561-030d266912a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:35.689643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab4181-1150-4285-a561-030d266912a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:35.700338 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab4181-1150-4285-a561-030d266912a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:35.701962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab4181-1150-4285-a561-030d266912a1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-dcab4181-1150-4285-a561-030d266912a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:35.717113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:35.718971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:35.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:35.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:35.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:35.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:35.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:35.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:35.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:35.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:35.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 21:29:35.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:35.723319 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 494/982] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 21:29:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:35.725057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b3240-0a2a-44af-9a8d-7ac8a0650a9c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:35.897312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741b3240-0a2a-44af-9a8d-7ac8a0650a9c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:35.949012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fb5cf-a55e-4d9e-be60-5374c184e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:35.949535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fb5cf-a55e-4d9e-be60-5374c184e5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:35.949819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fb5cf-a55e-4d9e-be60-5374c184e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:35.950100 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6fb5cf-a55e-4d9e-be60-5374c184e5b9 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:35.950865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fb5cf-a55e-4d9e-be60-5374c184e5b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:35.951167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fb5cf-a55e-4d9e-be60-5374c184e5b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:35.952835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6fb5cf-a55e-4d9e-be60-5374c184e5b9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:35.978012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 489/983] 10.222.0.83 () {56 vars in 1149 bytes} [Mon Aug 29 21:29:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:35.986945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4181-1150-4285-a561-030d266912a1 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:36.077839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:36.164235 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab4181-1150-4285-a561-030d266912a1 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:36.237797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc664d-24ae-4e7b-92c3-afc49ecf5980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:36.238771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc664d-24ae-4e7b-92c3-afc49ecf5980 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:36.239246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc664d-24ae-4e7b-92c3-afc49ecf5980 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:36.239778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc664d-24ae-4e7b-92c3-afc49ecf5980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:36.379934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc664d-24ae-4e7b-92c3-afc49ecf5980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:36.382921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc664d-24ae-4e7b-92c3-afc49ecf5980 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:36.490750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:36.590758 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 495/984] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:35 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:29:36.600209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fb5cf-a55e-4d9e-be60-5374c184e5b9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:36.623474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:36.768502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6fb5cf-a55e-4d9e-be60-5374c184e5b9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:36.817408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d5782-37df-4452-b9ef-7dec86ced249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:36.818130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d5782-37df-4452-b9ef-7dec86ced249 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:36.818416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d5782-37df-4452-b9ef-7dec86ced249 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:36.818692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d5782-37df-4452-b9ef-7dec86ced249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:36.831757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d5782-37df-4452-b9ef-7dec86ced249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:36.833264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d5782-37df-4452-b9ef-7dec86ced249 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-323d5782-37df-4452-b9ef-7dec86ced249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:36.853538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:36.856117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:36.858479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:36.858479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:36.858479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:36.858479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 490/985] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:36.862065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc664d-24ae-4e7b-92c3-afc49ecf5980 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:37.018423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc664d-24ae-4e7b-92c3-afc49ecf5980 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:37.085684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae0504-a9ed-4bc9-aab5-040db6431f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:37.086645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae0504-a9ed-4bc9-aab5-040db6431f3b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:37.087147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae0504-a9ed-4bc9-aab5-040db6431f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:37.087632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae0504-a9ed-4bc9-aab5-040db6431f3b None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:37.088889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae0504-a9ed-4bc9-aab5-040db6431f3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:37.089976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae0504-a9ed-4bc9-aab5-040db6431f3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:37.092589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae0504-a9ed-4bc9-aab5-040db6431f3b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:37.120593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 496/986] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:37.122465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d5782-37df-4452-b9ef-7dec86ced249 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:37.206349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:37.275020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d5782-37df-4452-b9ef-7dec86ced249 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:37.347800 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf674-cf47-48fc-ab0a-d14dd40dab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:37.349671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf674-cf47-48fc-ab0a-d14dd40dab51 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:37.350605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf674-cf47-48fc-ab0a-d14dd40dab51 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:37.351391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf674-cf47-48fc-ab0a-d14dd40dab51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:37.368831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcf674-cf47-48fc-ab0a-d14dd40dab51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:37.372790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dcf674-cf47-48fc-ab0a-d14dd40dab51 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b0dcf674-cf47-48fc-ab0a-d14dd40dab51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:37.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:37.399594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:37.401601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:37.401601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:37.401601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:37.401601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:37.401601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:37.401601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:37.401601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:37.401601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:37.408787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 491/987] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:37.412734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae0504-a9ed-4bc9-aab5-040db6431f3b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:37.444112 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:37.576456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db720e-0819-4c7f-b401-f11cb5cd7dcc None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:37.576986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db720e-0819-4c7f-b401-f11cb5cd7dcc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:37.577449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db720e-0819-4c7f-b401-f11cb5cd7dcc None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:37.582153 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 492/988] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:37.590378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d767-3290-4c76-9dc1-0a2e0512c055 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:37.590821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d767-3290-4c76-9dc1-0a2e0512c055 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:37.591249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d767-3290-4c76-9dc1-0a2e0512c055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:37.621386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2407d767-3290-4c76-9dc1-0a2e0512c055 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:37.623396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2407d767-3290-4c76-9dc1-0a2e0512c055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:37.630767 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae0504-a9ed-4bc9-aab5-040db6431f3b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:37.689353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10a071-30f6-4e49-9d27-ee1b0e47216c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:37.690113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10a071-30f6-4e49-9d27-ee1b0e47216c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:37.690516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10a071-30f6-4e49-9d27-ee1b0e47216c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:37.690965 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10a071-30f6-4e49-9d27-ee1b0e47216c None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:37.692245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10a071-30f6-4e49-9d27-ee1b0e47216c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:37.692771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10a071-30f6-4e49-9d27-ee1b0e47216c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:37.695366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b10a071-30f6-4e49-9d27-ee1b0e47216c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:37.717464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 497/989] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:37.728031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10a071-30f6-4e49-9d27-ee1b0e47216c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:37.760421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 493/990] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:37.860023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:37.878464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb92e31-3a83-4607-85a6-eb485d525593 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:37.878713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb92e31-3a83-4607-85a6-eb485d525593 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:37.879081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb92e31-3a83-4607-85a6-eb485d525593 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:37.881115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 494/991] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:37.886915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478ac0-0e64-4147-bc44-76723cb32210 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:37.887357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478ac0-0e64-4147-bc44-76723cb32210 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:37.887516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478ac0-0e64-4147-bc44-76723cb32210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:37.910204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-01478ac0-0e64-4147-bc44-76723cb32210 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:37.911374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-01478ac0-0e64-4147-bc44-76723cb32210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:37.923571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10a071-30f6-4e49-9d27-ee1b0e47216c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:37.990425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:37.994769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbedce0-48ca-44af-ba97-305e0498acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:37.996593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbedce0-48ca-44af-ba97-305e0498acfb None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:37.996898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbedce0-48ca-44af-ba97-305e0498acfb None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:37.997178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbedce0-48ca-44af-ba97-305e0498acfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:37.997957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbedce0-48ca-44af-ba97-305e0498acfb None admin] RBAC: Adding query filter params (role.id=49450d81c24b4a9c9cfeddef6bb97052, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=8ba9ea33e0f444b88acdc9560856dae5) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:37.998267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbedce0-48ca-44af-ba97-305e0498acfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:38.001336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbedce0-48ca-44af-ba97-305e0498acfb None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:38.012312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 498/992] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:37 2022] GET /identity/v3/role_assignments?user.id=8ba9ea33e0f444b88acdc9560856dae5&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=49450d81c24b4a9c9cfeddef6bb97052 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:38.032804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 495/993] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:38.061405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbedce0-48ca-44af-ba97-305e0498acfb None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:38.189746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbedce0-48ca-44af-ba97-305e0498acfb None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:38.232327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876934-281a-4bf8-be6a-756d99709562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:38.233040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876934-281a-4bf8-be6a-756d99709562 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:38.233309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876934-281a-4bf8-be6a-756d99709562 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:38.233578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8876934-281a-4bf8-be6a-756d99709562 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:38.234185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8876934-281a-4bf8-be6a-756d99709562 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:38.235580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8876934-281a-4bf8-be6a-756d99709562 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:38.239257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-c8876934-281a-4bf8-be6a-756d99709562 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:38.246735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:38.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:38.253164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 499/994] 10.222.0.83 () {56 vars in 1126 bytes} [Mon Aug 29 21:29:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:38.255511 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01478ac0-0e64-4147-bc44-76723cb32210 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:38.462580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01478ac0-0e64-4147-bc44-76723cb32210 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:38.473439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876934-281a-4bf8-be6a-756d99709562 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:38.542650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f737fd-ca93-4e01-af0a-f287cc966ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:38.543686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f737fd-ca93-4e01-af0a-f287cc966ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:38.544167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f737fd-ca93-4e01-af0a-f287cc966ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:38.544684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f737fd-ca93-4e01-af0a-f287cc966ea5 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:38.545838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f737fd-ca93-4e01-af0a-f287cc966ea5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:38.546340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f737fd-ca93-4e01-af0a-f287cc966ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:38.548912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f737fd-ca93-4e01-af0a-f287cc966ea5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:38.566965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 496/995] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 21:29:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:38.575393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f737fd-ca93-4e01-af0a-f287cc966ea5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:38.662679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8876934-281a-4bf8-be6a-756d99709562 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:38.670178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:38.723138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4e712-b11f-438f-a556-3ea784c176d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:38.724022 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4e712-b11f-438f-a556-3ea784c176d4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:38.725024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4e712-b11f-438f-a556-3ea784c176d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:38.725024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4e712-b11f-438f-a556-3ea784c176d4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:38.725450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4e712-b11f-438f-a556-3ea784c176d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:38.727786 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4e712-b11f-438f-a556-3ea784c176d4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-d7f4e712-b11f-438f-a556-3ea784c176d4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:38.740404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:38.741538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:29:38.742396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:38.747868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 500/996] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:38.748822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4e712-b11f-438f-a556-3ea784c176d4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:38.768551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f737fd-ca93-4e01-af0a-f287cc966ea5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:38.825509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503521b9-0ed0-4268-ab9f-90f6b862f00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:38.826136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503521b9-0ed0-4268-ab9f-90f6b862f00f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:38.826416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503521b9-0ed0-4268-ab9f-90f6b862f00f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:38.826684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503521b9-0ed0-4268-ab9f-90f6b862f00f None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:38.827327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503521b9-0ed0-4268-ab9f-90f6b862f00f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:38.827623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503521b9-0ed0-4268-ab9f-90f6b862f00f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:38.829066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503521b9-0ed0-4268-ab9f-90f6b862f00f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:38.837181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 497/997] 10.222.0.83 () {56 vars in 1122 bytes} [Mon Aug 29 21:29:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:38.844303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503521b9-0ed0-4268-ab9f-90f6b862f00f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:38.848783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:38.920297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4e712-b11f-438f-a556-3ea784c176d4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:38.977174 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5278-b809-4301-9117-41ca89ed7a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:38.978142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5278-b809-4301-9117-41ca89ed7a27 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:38.978142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5278-b809-4301-9117-41ca89ed7a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:38.978321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5278-b809-4301-9117-41ca89ed7a27 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:38.978855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f5278-b809-4301-9117-41ca89ed7a27 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:38.979150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f5278-b809-4301-9117-41ca89ed7a27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:38.981178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f5278-b809-4301-9117-41ca89ed7a27 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:38.987094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 501/998] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:38.997810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5278-b809-4301-9117-41ca89ed7a27 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:39.043438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503521b9-0ed0-4268-ab9f-90f6b862f00f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:39.056373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:39.081927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ba159-805b-4918-93fc-28c69f7911f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:39.082546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ba159-805b-4918-93fc-28c69f7911f2 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:39.082823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ba159-805b-4918-93fc-28c69f7911f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:39.083164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ba159-805b-4918-93fc-28c69f7911f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:39.083879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ba159-805b-4918-93fc-28c69f7911f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:39.085306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7ba159-805b-4918-93fc-28c69f7911f2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:39.138820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5278-b809-4301-9117-41ca89ed7a27 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:39.173320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:39.185918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 498/999] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:29:39.192390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c49baf-c420-41db-be6b-72549a7f7f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:39.193137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c49baf-c420-41db-be6b-72549a7f7f5c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:39.193422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c49baf-c420-41db-be6b-72549a7f7f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:39.194090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c49baf-c420-41db-be6b-72549a7f7f5c None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:39.194576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c49baf-c420-41db-be6b-72549a7f7f5c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:39.194885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c49baf-c420-41db-be6b-72549a7f7f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:39.196612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c49baf-c420-41db-be6b-72549a7f7f5c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:39.206912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 502/1000] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:39.213921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ba159-805b-4918-93fc-28c69f7911f2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:39.384922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7ba159-805b-4918-93fc-28c69f7911f2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:39.435163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823f90a-ccde-41f9-8f5b-0ea1fef6cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:39.435800 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823f90a-ccde-41f9-8f5b-0ea1fef6cc1e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:39.436092 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823f90a-ccde-41f9-8f5b-0ea1fef6cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:39.436371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823f90a-ccde-41f9-8f5b-0ea1fef6cc1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:39.437578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823f90a-ccde-41f9-8f5b-0ea1fef6cc1e None admin] RBAC: Adding query filter params (interface=public, service_id=7f0b19e194a74dc98dd9ccf72c8f32bc, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:39.437901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823f90a-ccde-41f9-8f5b-0ea1fef6cc1e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:39.439309 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823f90a-ccde-41f9-8f5b-0ea1fef6cc1e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:39.450481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 499/1001] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 21:29:39 2022] GET /identity/v3/endpoints?service_id=7f0b19e194a74dc98dd9ccf72c8f32bc&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:39.457537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c49baf-c420-41db-be6b-72549a7f7f5c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:39.669804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c49baf-c420-41db-be6b-72549a7f7f5c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:39.742982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b1245-c0dd-40ff-943a-c60ea53d8603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:39.744025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b1245-c0dd-40ff-943a-c60ea53d8603 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:39.744535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b1245-c0dd-40ff-943a-c60ea53d8603 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:39.745023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b1245-c0dd-40ff-943a-c60ea53d8603 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:39.746219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b1245-c0dd-40ff-943a-c60ea53d8603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:39.748868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b1245-c0dd-40ff-943a-c60ea53d8603 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:39.768541 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 503/1002] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 21:29:39 2022] GET /identity/v3/services => generated 1727 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:29:40.847537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6067e7e-986f-4812-8684-6f1138e8a676 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:40.848522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6067e7e-986f-4812-8684-6f1138e8a676 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:40.848522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6067e7e-986f-4812-8684-6f1138e8a676 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:40.851369 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 500/1003] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:40.861374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d817a-cf9f-44d6-ade1-035e9ed23a4a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:40.861944 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d817a-cf9f-44d6-ade1-035e9ed23a4a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:40.862323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d817a-cf9f-44d6-ade1-035e9ed23a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:40.896166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-916d817a-cf9f-44d6-ade1-035e9ed23a4a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:40.898250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-916d817a-cf9f-44d6-ade1-035e9ed23a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:41.021278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:41.057623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 504/1004] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:41.548208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6067e7e-986f-4812-8684-6f1138e8a676 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:41.606477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:41.695512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6067e7e-986f-4812-8684-6f1138e8a676 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:41.743744 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95439754-66f2-4d82-b541-8b79f77ddbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:41.744398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95439754-66f2-4d82-b541-8b79f77ddbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:41.744775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95439754-66f2-4d82-b541-8b79f77ddbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:41.745049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95439754-66f2-4d82-b541-8b79f77ddbc2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:41.746408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95439754-66f2-4d82-b541-8b79f77ddbc2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:41.747908 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95439754-66f2-4d82-b541-8b79f77ddbc2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-95439754-66f2-4d82-b541-8b79f77ddbc2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:41.759671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:41.765317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:41.766642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 501/1005] 10.222.0.83 () {56 vars in 1105 bytes} [Mon Aug 29 21:29:41 2022] GET /identity/v3/services/image => generated 86 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:41.770833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d817a-cf9f-44d6-ade1-035e9ed23a4a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:41.976992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d817a-cf9f-44d6-ade1-035e9ed23a4a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:42.030142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe10ed2-53f5-4599-bfdf-9ffe87b075b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:42.030833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe10ed2-53f5-4599-bfdf-9ffe87b075b4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:42.031200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe10ed2-53f5-4599-bfdf-9ffe87b075b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:42.032110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe10ed2-53f5-4599-bfdf-9ffe87b075b4 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:42.032256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe10ed2-53f5-4599-bfdf-9ffe87b075b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:42.032500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe10ed2-53f5-4599-bfdf-9ffe87b075b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:42.033933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe10ed2-53f5-4599-bfdf-9ffe87b075b4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:42.046192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 505/1006] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:42.046484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97703c-c386-4fd4-b7a5-fa0b30fa2dfe None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:42.046484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97703c-c386-4fd4-b7a5-fa0b30fa2dfe None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:42.046484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97703c-c386-4fd4-b7a5-fa0b30fa2dfe None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:42.046484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 502/1007] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:42.047419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe10ed2-53f5-4599-bfdf-9ffe87b075b4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:42.050926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de33e5b-db17-4d39-822c-ca7ea3bb8a51 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:42.051193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de33e5b-db17-4d39-822c-ca7ea3bb8a51 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:42.051472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de33e5b-db17-4d39-822c-ca7ea3bb8a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:42.072384 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5de33e5b-db17-4d39-822c-ca7ea3bb8a51 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:42.073748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5de33e5b-db17-4d39-822c-ca7ea3bb8a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:42.119589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:42.155274 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 503/1008] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:42.192916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe10ed2-53f5-4599-bfdf-9ffe87b075b4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:42.206541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb19a6-9038-4d2a-aa26-735b0689e5e0 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:42.207200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb19a6-9038-4d2a-aa26-735b0689e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:42.207759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb19a6-9038-4d2a-aa26-735b0689e5e0 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:42.209502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 504/1009] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:42.216986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac4d6d-1a9e-4e32-8d6c-eef367e24bf4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:42.217270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac4d6d-1a9e-4e32-8d6c-eef367e24bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:42.217578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac4d6d-1a9e-4e32-8d6c-eef367e24bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:42.238886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d9ac4d6d-1a9e-4e32-8d6c-eef367e24bf4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:42.240073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d9ac4d6d-1a9e-4e32-8d6c-eef367e24bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:42.256915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768748-004b-4ac2-bf79-3342dd4cce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:42.257726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768748-004b-4ac2-bf79-3342dd4cce51 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:42.258205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768748-004b-4ac2-bf79-3342dd4cce51 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:42.258662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9768748-004b-4ac2-bf79-3342dd4cce51 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:42.259480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768748-004b-4ac2-bf79-3342dd4cce51 None admin] RBAC: Adding query filter params (type=image) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:42.259925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768748-004b-4ac2-bf79-3342dd4cce51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:42.261824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9768748-004b-4ac2-bf79-3342dd4cce51 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:42.268282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 506/1010] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:42.291392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:42.405737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 505/1011] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:42.455314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768748-004b-4ac2-bf79-3342dd4cce51 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:42.684845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9768748-004b-4ac2-bf79-3342dd4cce51 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:42.706794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:42.751985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cf540-3072-43d2-b78a-8ddec17c2b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:42.753145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf540-3072-43d2-b78a-8ddec17c2b7f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:42.753561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf540-3072-43d2-b78a-8ddec17c2b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:42.753968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cf540-3072-43d2-b78a-8ddec17c2b7f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:42.755036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cf540-3072-43d2-b78a-8ddec17c2b7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:42.758140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90cf540-3072-43d2-b78a-8ddec17c2b7f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-d90cf540-3072-43d2-b78a-8ddec17c2b7f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:42.776152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:42.778977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:42.780743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 507/1012] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:42.789933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac4d6d-1a9e-4e32-8d6c-eef367e24bf4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:42.865069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cf540-3072-43d2-b78a-8ddec17c2b7f None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:42.945168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac4d6d-1a9e-4e32-8d6c-eef367e24bf4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:43.020425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84db6-e729-49c7-b7e6-7470acc99acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:43.021599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84db6-e729-49c7-b7e6-7470acc99acc None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:43.022093 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84db6-e729-49c7-b7e6-7470acc99acc None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:43.022638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84db6-e729-49c7-b7e6-7470acc99acc None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:43.023838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84db6-e729-49c7-b7e6-7470acc99acc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:43.024525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84db6-e729-49c7-b7e6-7470acc99acc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:43.027737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84db6-e729-49c7-b7e6-7470acc99acc None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:43.036403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90cf540-3072-43d2-b78a-8ddec17c2b7f None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:43.040819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 506/1013] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:43.045372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84db6-e729-49c7-b7e6-7470acc99acc None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:43.101581 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:43.112703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d8cf2-7c68-4343-98f1-8771a111d426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:43.113819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d8cf2-7c68-4343-98f1-8771a111d426 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:43.114261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d8cf2-7c68-4343-98f1-8771a111d426 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:43.114758 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d8cf2-7c68-4343-98f1-8771a111d426 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:43.116854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d8cf2-7c68-4343-98f1-8771a111d426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:43.121467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d8cf2-7c68-4343-98f1-8771a111d426 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:43.124290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 508/1014] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:43.133161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d8cf2-7c68-4343-98f1-8771a111d426 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:43.219081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:43.249978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84db6-e729-49c7-b7e6-7470acc99acc None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:43.317126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14500e53-bcfd-41e4-ae50-da68d88efb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:43.318331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14500e53-bcfd-41e4-ae50-da68d88efb89 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:43.318619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14500e53-bcfd-41e4-ae50-da68d88efb89 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:43.318892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14500e53-bcfd-41e4-ae50-da68d88efb89 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:43.319558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14500e53-bcfd-41e4-ae50-da68d88efb89 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:43.319978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14500e53-bcfd-41e4-ae50-da68d88efb89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:43.321316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14500e53-bcfd-41e4-ae50-da68d88efb89 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:43.329743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 507/1015] 10.222.0.83 () {56 vars in 1112 bytes} [Mon Aug 29 21:29:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:43.332902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d8cf2-7c68-4343-98f1-8771a111d426 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:43.339558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14500e53-bcfd-41e4-ae50-da68d88efb89 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:43.391908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064127d-18ab-456e-9ba3-bd7c7aadb673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:43.393366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064127d-18ab-456e-9ba3-bd7c7aadb673 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:43.394061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064127d-18ab-456e-9ba3-bd7c7aadb673 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:43.394547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064127d-18ab-456e-9ba3-bd7c7aadb673 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:43.395860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064127d-18ab-456e-9ba3-bd7c7aadb673 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:43.398658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064127d-18ab-456e-9ba3-bd7c7aadb673 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:43.513856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:43.539536 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14500e53-bcfd-41e4-ae50-da68d88efb89 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:43.545408 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 509/1016] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:29:43 2022] POST /identity/v3/projects => generated 311 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:43.612803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f008c-166f-45eb-8d5e-5199627984af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:43.613788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f008c-166f-45eb-8d5e-5199627984af None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:43.614230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f008c-166f-45eb-8d5e-5199627984af None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:43.614758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f008c-166f-45eb-8d5e-5199627984af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:43.615745 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f008c-166f-45eb-8d5e-5199627984af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:43.618118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f008c-166f-45eb-8d5e-5199627984af None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:43.766552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 508/1017] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:44.719181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb594c7-df46-444f-b886-4959accdb656 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:44.720048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb594c7-df46-444f-b886-4959accdb656 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:44.720048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb594c7-df46-444f-b886-4959accdb656 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:44.722553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 510/1018] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:44.728868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21649df-b077-4f92-9c31-c624f2703873 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:44.729683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21649df-b077-4f92-9c31-c624f2703873 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:44.729683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21649df-b077-4f92-9c31-c624f2703873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:44.754597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d21649df-b077-4f92-9c31-c624f2703873 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:44.756724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d21649df-b077-4f92-9c31-c624f2703873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:44.901483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 509/1019] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:44 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:45.215994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb594c7-df46-444f-b886-4959accdb656 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:45.337332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:45.346847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb594c7-df46-444f-b886-4959accdb656 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:45.392235 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d6a87-0c0b-48ab-91d6-1019f1654a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:45.392956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d6a87-0c0b-48ab-91d6-1019f1654a18 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:45.393276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d6a87-0c0b-48ab-91d6-1019f1654a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:45.393567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d6a87-0c0b-48ab-91d6-1019f1654a18 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:45.394337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d6a87-0c0b-48ab-91d6-1019f1654a18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:45.395719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d6a87-0c0b-48ab-91d6-1019f1654a18 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:45.519255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 511/1020] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:29:45 2022] POST /identity/v3/services => generated 242 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:29:45.992046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083a910-2f01-4ab2-8d63-3b375b225a46 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:45.992875 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083a910-2f01-4ab2-8d63-3b375b225a46 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:45.992875 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083a910-2f01-4ab2-8d63-3b375b225a46 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:45.994640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 510/1021] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:46.004277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dad93-fe24-4949-ab61-b9225e2b6996 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:46.004277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dad93-fe24-4949-ab61-b9225e2b6996 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:46.004277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dad93-fe24-4949-ab61-b9225e2b6996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:46.029906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-406dad93-fe24-4949-ab61-b9225e2b6996 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:46.031357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-406dad93-fe24-4949-ab61-b9225e2b6996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:46.127633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 512/1022] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:46.266572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80affd6a-0373-4220-a3f7-1f5fe51d8672 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:46.266832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80affd6a-0373-4220-a3f7-1f5fe51d8672 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:46.267213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80affd6a-0373-4220-a3f7-1f5fe51d8672 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:46.268811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 511/1023] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:46.275808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee606f-6737-4811-b8db-054b39a83c3d None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:46.276382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee606f-6737-4811-b8db-054b39a83c3d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:46.276689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee606f-6737-4811-b8db-054b39a83c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:46.304506 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-36ee606f-6737-4811-b8db-054b39a83c3d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:46.306410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-36ee606f-6737-4811-b8db-054b39a83c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:46.422025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80affd6a-0373-4220-a3f7-1f5fe51d8672 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:46.432939 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 513/1024] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:46.513187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:46.557777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80affd6a-0373-4220-a3f7-1f5fe51d8672 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:46.602162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdf377-cd96-48b6-bac1-d274b0a80959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:46.602823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdf377-cd96-48b6-bac1-d274b0a80959 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:46.603088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdf377-cd96-48b6-bac1-d274b0a80959 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:46.603481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdf377-cd96-48b6-bac1-d274b0a80959 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:46.604755 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdf377-cd96-48b6-bac1-d274b0a80959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:46.606781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdf377-cd96-48b6-bac1-d274b0a80959 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:46.608824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 512/1025] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:46.615882 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee606f-6737-4811-b8db-054b39a83c3d None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:46.645294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:46.739462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdf377-cd96-48b6-bac1-d274b0a80959 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:46.846845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee606f-6737-4811-b8db-054b39a83c3d None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:46.917522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73f958-695a-40d1-b3da-768a4c17c51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:46.918962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73f958-695a-40d1-b3da-768a4c17c51a None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:46.919345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73f958-695a-40d1-b3da-768a4c17c51a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:46.919670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73f958-695a-40d1-b3da-768a4c17c51a None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:46.922035 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73f958-695a-40d1-b3da-768a4c17c51a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:46.923674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73f958-695a-40d1-b3da-768a4c17c51a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:46.930597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdf377-cd96-48b6-bac1-d274b0a80959 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:46.992400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc2abb-7357-4482-8493-f29257f7ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:46.996731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc2abb-7357-4482-8493-f29257f7ec03 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:46.996731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc2abb-7357-4482-8493-f29257f7ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:46.996731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc2abb-7357-4482-8493-f29257f7ec03 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:46.997943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:47.014610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc2abb-7357-4482-8493-f29257f7ec03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-f4dc2abb-7357-4482-8493-f29257f7ec03 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:47.024778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:47.026709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:47.029479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 513/1026] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 21:29:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:47.045526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc2abb-7357-4482-8493-f29257f7ec03 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:47.046651 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 514/1027] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:29:46 2022] POST /identity/v3/users => generated 285 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:29:47.264428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc2abb-7357-4482-8493-f29257f7ec03 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:47.323430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea22b4-a877-49e1-a0d4-9e916bc2e683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:47.324648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea22b4-a877-49e1-a0d4-9e916bc2e683 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:47.325121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea22b4-a877-49e1-a0d4-9e916bc2e683 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:47.325611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea22b4-a877-49e1-a0d4-9e916bc2e683 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:47.326867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea22b4-a877-49e1-a0d4-9e916bc2e683 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:47.327426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea22b4-a877-49e1-a0d4-9e916bc2e683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:47.330226 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea22b4-a877-49e1-a0d4-9e916bc2e683 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:47.348204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 514/1028] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 21:29:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:47.358544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73f958-695a-40d1-b3da-768a4c17c51a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:47.502187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:47.578490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73f958-695a-40d1-b3da-768a4c17c51a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:47.655829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d80b48-b15d-40be-ad83-6be2058f44c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:47.656976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d80b48-b15d-40be-ad83-6be2058f44c8 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:47.657434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d80b48-b15d-40be-ad83-6be2058f44c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:47.657915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d80b48-b15d-40be-ad83-6be2058f44c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:47.681200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d80b48-b15d-40be-ad83-6be2058f44c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:47.684123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d80b48-b15d-40be-ad83-6be2058f44c8 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-10d80b48-b15d-40be-ad83-6be2058f44c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:47.717717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:47.719616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:47.723217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:47.723217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:47.723217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:47.725000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 515/1029] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:47.731846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea22b4-a877-49e1-a0d4-9e916bc2e683 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:47.851649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:47.939945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea22b4-a877-49e1-a0d4-9e916bc2e683 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:48.020453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf87425-6d66-4047-92d6-5058e277abe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:48.021476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf87425-6d66-4047-92d6-5058e277abe2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:48.021476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf87425-6d66-4047-92d6-5058e277abe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:48.021938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf87425-6d66-4047-92d6-5058e277abe2 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:48.023143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf87425-6d66-4047-92d6-5058e277abe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:48.023702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf87425-6d66-4047-92d6-5058e277abe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:48.026847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf87425-6d66-4047-92d6-5058e277abe2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:48.059131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 515/1030] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:48.062788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d80b48-b15d-40be-ad83-6be2058f44c8 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:48.111146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d367-22ef-49e9-b282-066918f658ea None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:48.111483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d367-22ef-49e9-b282-066918f658ea None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:48.111618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20d367-22ef-49e9-b282-066918f658ea None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:48.113501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 516/1031] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:48.119135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6071c4-62b0-4b4a-a84d-d50c8d140dbf None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:48.119420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6071c4-62b0-4b4a-a84d-d50c8d140dbf None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:48.119562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6071c4-62b0-4b4a-a84d-d50c8d140dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:48.142411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-be6071c4-62b0-4b4a-a84d-d50c8d140dbf None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:48.143729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-be6071c4-62b0-4b4a-a84d-d50c8d140dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:48.245347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 517/1032] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:48.272027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d80b48-b15d-40be-ad83-6be2058f44c8 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:48.309652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:48.344952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3b807-5c36-474c-a05a-a14f42626bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:48.346499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3b807-5c36-474c-a05a-a14f42626bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:48.347537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3b807-5c36-474c-a05a-a14f42626bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:48.348177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e3b807-5c36-474c-a05a-a14f42626bd1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:48.360757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3b807-5c36-474c-a05a-a14f42626bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:48.362471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e3b807-5c36-474c-a05a-a14f42626bd1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-15e3b807-5c36-474c-a05a-a14f42626bd1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:48.376906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:48.379159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:48.381520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 516/1033] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 21:29:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:48.389191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6071c4-62b0-4b4a-a84d-d50c8d140dbf None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:48.491281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:48.591897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3b807-5c36-474c-a05a-a14f42626bd1 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:48.593812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6071c4-62b0-4b4a-a84d-d50c8d140dbf None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:48.638691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d49685-d057-4b22-9062-7c6a0f76dc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:48.639306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d49685-d057-4b22-9062-7c6a0f76dc03 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:48.639618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d49685-d057-4b22-9062-7c6a0f76dc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:48.639859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d49685-d057-4b22-9062-7c6a0f76dc03 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:48.640984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d49685-d057-4b22-9062-7c6a0f76dc03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:48.641173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d49685-d057-4b22-9062-7c6a0f76dc03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:48.643662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d49685-d057-4b22-9062-7c6a0f76dc03 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:48.676881 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 518/1034] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 21:29:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:48.686752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d49685-d057-4b22-9062-7c6a0f76dc03 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:48.784986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e3b807-5c36-474c-a05a-a14f42626bd1 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:48.836151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1f672-29f2-4fdb-ae16-1ae59e159d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:48.836972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1f672-29f2-4fdb-ae16-1ae59e159d5a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:48.837441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1f672-29f2-4fdb-ae16-1ae59e159d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:48.837849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1f672-29f2-4fdb-ae16-1ae59e159d5a None admin] PATH_INFO: `/v3/services/image` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:48.838613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1f672-29f2-4fdb-ae16-1ae59e159d5a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:48.841079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1f672-29f2-4fdb-ae16-1ae59e159d5a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-aab1f672-29f2-4fdb-ae16-1ae59e159d5a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:48.858048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:48.859736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:48.860917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 517/1035] 10.222.0.83 () {56 vars in 1105 bytes} [Mon Aug 29 21:29:48 2022] GET /identity/v3/services/image => generated 86 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:48.870088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1f672-29f2-4fdb-ae16-1ae59e159d5a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:48.873719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d49685-d057-4b22-9062-7c6a0f76dc03 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:48.888504 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:48.942292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:48.946183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6a562-a848-452a-aa2e-c62513bb3ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:48.947261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6a562-a848-452a-aa2e-c62513bb3ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:48.947752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6a562-a848-452a-aa2e-c62513bb3ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:48.948239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6a562-a848-452a-aa2e-c62513bb3ca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:49.068144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1f672-29f2-4fdb-ae16-1ae59e159d5a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:49.083296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6a562-a848-452a-aa2e-c62513bb3ca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:49.086331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce6a562-a848-452a-aa2e-c62513bb3ca1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:49.137504 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008989fc-f329-4789-a525-f926c7597497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:49.138646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008989fc-f329-4789-a525-f926c7597497 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:49.140149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008989fc-f329-4789-a525-f926c7597497 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:49.140149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008989fc-f329-4789-a525-f926c7597497 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:49.140951 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008989fc-f329-4789-a525-f926c7597497 None admin] RBAC: Adding query filter params (name=image) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:49.141503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008989fc-f329-4789-a525-f926c7597497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:49.144142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008989fc-f329-4789-a525-f926c7597497 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:49.162155 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 518/1036] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:49.164814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008989fc-f329-4789-a525-f926c7597497 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:49.260032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 519/1037] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:48 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:29:49.270286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6a562-a848-452a-aa2e-c62513bb3ca1 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:49.285285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:49.347972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008989fc-f329-4789-a525-f926c7597497 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:49.364628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:49.429314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0c919-a58e-4cb7-b0a0-e2defc512f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:49.430368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0c919-a58e-4cb7-b0a0-e2defc512f1c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:49.430826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0c919-a58e-4cb7-b0a0-e2defc512f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:49.431288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a0c919-a58e-4cb7-b0a0-e2defc512f1c None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:49.432457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0c919-a58e-4cb7-b0a0-e2defc512f1c None admin] RBAC: Adding query filter params (type=image) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:49.433001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0c919-a58e-4cb7-b0a0-e2defc512f1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:49.435457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a0c919-a58e-4cb7-b0a0-e2defc512f1c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:49.444785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 519/1038] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:49.453192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0c919-a58e-4cb7-b0a0-e2defc512f1c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:49.475497 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6a562-a848-452a-aa2e-c62513bb3ca1 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:49.543421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c9924-2992-4d45-be9b-02e20c334b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:49.544277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c9924-2992-4d45-be9b-02e20c334b71 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:49.544601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c9924-2992-4d45-be9b-02e20c334b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:49.544851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c9924-2992-4d45-be9b-02e20c334b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:49.556847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c9924-2992-4d45-be9b-02e20c334b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:49.558453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c9924-2992-4d45-be9b-02e20c334b71 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-e86c9924-2992-4d45-be9b-02e20c334b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:49.575878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:49.577833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:49.579599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:49.579599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:49.579599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:49.579599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 520/1039] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:49.583656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c9924-2992-4d45-be9b-02e20c334b71 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:49.662603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a0c919-a58e-4cb7-b0a0-e2defc512f1c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:49.669295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:49.724679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131165b-5436-4588-867e-ac30e4f45d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:49.726119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131165b-5436-4588-867e-ac30e4f45d32 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:49.726597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131165b-5436-4588-867e-ac30e4f45d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:49.727067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131165b-5436-4588-867e-ac30e4f45d32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:49.728382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131165b-5436-4588-867e-ac30e4f45d32 None admin] RBAC: Adding query filter params (interface=public, service_id=feb691822f814313bf9daaae50381230, region_id=RegionOne) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:49.728941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131165b-5436-4588-867e-ac30e4f45d32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:49.731612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131165b-5436-4588-867e-ac30e4f45d32 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:49.742103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 520/1040] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 21:29:49 2022] GET /identity/v3/endpoints?service_id=feb691822f814313bf9daaae50381230&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:49.743865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b571db-1fc0-4bf8-a48f-103d5065059e None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:49.751386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b571db-1fc0-4bf8-a48f-103d5065059e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:49.751386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b571db-1fc0-4bf8-a48f-103d5065059e None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:49.752298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c9924-2992-4d45-be9b-02e20c334b71 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:49.752511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 521/1041] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:49.752511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b571db-1fc0-4bf8-a48f-103d5065059e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:49.811511 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39ce01-56b9-4abf-9b6e-fdea2e92abc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:49.812036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ce01-56b9-4abf-9b6e-fdea2e92abc2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:49.812318 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ce01-56b9-4abf-9b6e-fdea2e92abc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:49.812634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39ce01-56b9-4abf-9b6e-fdea2e92abc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:49.813540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39ce01-56b9-4abf-9b6e-fdea2e92abc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:49.813848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39ce01-56b9-4abf-9b6e-fdea2e92abc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:49.815398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39ce01-56b9-4abf-9b6e-fdea2e92abc2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:49.823228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:49.830476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 521/1042] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:49.831967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da50b2-cca6-47ec-a0a6-3d6797b2d74f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:49.832312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da50b2-cca6-47ec-a0a6-3d6797b2d74f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:49.832587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da50b2-cca6-47ec-a0a6-3d6797b2d74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:49.853528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-70da50b2-cca6-47ec-a0a6-3d6797b2d74f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:49.854803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-70da50b2-cca6-47ec-a0a6-3d6797b2d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:49.950129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 522/1043] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:49.951599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da50b2-cca6-47ec-a0a6-3d6797b2d74f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:49.954480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b571db-1fc0-4bf8-a48f-103d5065059e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:50.023330 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781047d-990e-4e3d-acfd-a28da7ec5b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:50.024658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781047d-990e-4e3d-acfd-a28da7ec5b94 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:50.025234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781047d-990e-4e3d-acfd-a28da7ec5b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:50.025698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781047d-990e-4e3d-acfd-a28da7ec5b94 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:50.026548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781047d-990e-4e3d-acfd-a28da7ec5b94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:50.028393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781047d-990e-4e3d-acfd-a28da7ec5b94 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:50.052530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 522/1044] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 21:29:49 2022] GET /identity/v3/services => generated 1957 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:29:50.070925 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:50.190973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da50b2-cca6-47ec-a0a6-3d6797b2d74f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:50.260454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4ced9-bec1-495a-bf4e-4c0fecde025d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:50.262032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4ced9-bec1-495a-bf4e-4c0fecde025d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:50.262501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4ced9-bec1-495a-bf4e-4c0fecde025d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:50.262954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4ced9-bec1-495a-bf4e-4c0fecde025d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:50.276186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4ced9-bec1-495a-bf4e-4c0fecde025d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:50.279947 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4ced9-bec1-495a-bf4e-4c0fecde025d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d6c4ced9-bec1-495a-bf4e-4c0fecde025d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:50.300069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:50.302855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:50.305002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:50.305002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:50.305002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:50.305002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:50.305002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:50.305002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:50.305002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:50.305002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:50.305002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 523/1045] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:50.311730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781047d-990e-4e3d-acfd-a28da7ec5b94 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:50.372851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4ced9-bec1-495a-bf4e-4c0fecde025d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:50.471452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:50.478219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781047d-990e-4e3d-acfd-a28da7ec5b94 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:50.542768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408f255-f355-4fa5-a5fd-98ad435b60ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:50.543479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408f255-f355-4fa5-a5fd-98ad435b60ad None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:50.543818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408f255-f355-4fa5-a5fd-98ad435b60ad None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:50.544154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e408f255-f355-4fa5-a5fd-98ad435b60ad None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:50.546115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408f255-f355-4fa5-a5fd-98ad435b60ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:50.546622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408f255-f355-4fa5-a5fd-98ad435b60ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:50.549294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e408f255-f355-4fa5-a5fd-98ad435b60ad None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:50.552026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4ced9-bec1-495a-bf4e-4c0fecde025d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:50.570389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:50.572056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 523/1046] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:50.582283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408f255-f355-4fa5-a5fd-98ad435b60ad None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:50.622459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00fce8-ff85-4740-9589-aa71fdc2d17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:50.623618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00fce8-ff85-4740-9589-aa71fdc2d17c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:50.623892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00fce8-ff85-4740-9589-aa71fdc2d17c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:50.624355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00fce8-ff85-4740-9589-aa71fdc2d17c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:50.645535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa00fce8-ff85-4740-9589-aa71fdc2d17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-aa00fce8-ff85-4740-9589-aa71fdc2d17c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:50.654496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:50.656399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:50.658916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:50.664928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 524/1047] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:29:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:50.666512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00fce8-ff85-4740-9589-aa71fdc2d17c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:50.775597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e408f255-f355-4fa5-a5fd-98ad435b60ad None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:50.847216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1491f-8430-4e5c-9ee1-234436eef166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:50.847993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1491f-8430-4e5c-9ee1-234436eef166 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:50.848329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1491f-8430-4e5c-9ee1-234436eef166 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:50.848800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1491f-8430-4e5c-9ee1-234436eef166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:50.850118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1491f-8430-4e5c-9ee1-234436eef166 None admin] RBAC: Adding query filter params (role.id=49450d81c24b4a9c9cfeddef6bb97052, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=8434659c6b164b97b5ac27fb7e4d6a26) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:50.851613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1491f-8430-4e5c-9ee1-234436eef166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:50.854734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1491f-8430-4e5c-9ee1-234436eef166 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:50.884630 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 524/1048] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:50 2022] GET /identity/v3/role_assignments?user.id=8434659c6b164b97b5ac27fb7e4d6a26&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=49450d81c24b4a9c9cfeddef6bb97052 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:50.892894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00fce8-ff85-4740-9589-aa71fdc2d17c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:50.945915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f27a6-f427-4fc6-abe9-735abaae08e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:50.946945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f27a6-f427-4fc6-abe9-735abaae08e2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:50.947429 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f27a6-f427-4fc6-abe9-735abaae08e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:50.948010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f27a6-f427-4fc6-abe9-735abaae08e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:50.949180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f27a6-f427-4fc6-abe9-735abaae08e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:50.949700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f27a6-f427-4fc6-abe9-735abaae08e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:50.952401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f27a6-f427-4fc6-abe9-735abaae08e2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:50.976271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 525/1049] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:50.977697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1491f-8430-4e5c-9ee1-234436eef166 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:51.031143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:51.179158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1491f-8430-4e5c-9ee1-234436eef166 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:51.243729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9520bb4-0b26-49e8-ad9f-61415dc55338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:51.244907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520bb4-0b26-49e8-ad9f-61415dc55338 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:51.245401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520bb4-0b26-49e8-ad9f-61415dc55338 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:51.245885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9520bb4-0b26-49e8-ad9f-61415dc55338 None admin] PATH_INFO: `/v3/users/69f49784135b4038b34f984b5070c983` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:51.273532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9520bb4-0b26-49e8-ad9f-61415dc55338 None admin] RBAC: Authorizing `identity:get_user(user_id=69f49784135b4038b34f984b5070c983)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:51.276438 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9520bb4-0b26-49e8-ad9f-61415dc55338 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:51.280704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 525/1050] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:29:50 2022] GET /identity/v3/users/69f49784135b4038b34f984b5070c983 => generated 285 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:51.290276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f27a6-f427-4fc6-abe9-735abaae08e2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:51.357765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:51.442212 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f27a6-f427-4fc6-abe9-735abaae08e2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:51.487787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53054fdc-b63f-43c8-9363-d086c33b868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:51.488853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53054fdc-b63f-43c8-9363-d086c33b868b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:51.489345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53054fdc-b63f-43c8-9363-d086c33b868b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:51.489820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53054fdc-b63f-43c8-9363-d086c33b868b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:51.578697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53054fdc-b63f-43c8-9363-d086c33b868b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:51.580612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53054fdc-b63f-43c8-9363-d086c33b868b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:51.617305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:51.743913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 526/1051] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:51 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:29:51.754163 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9520bb4-0b26-49e8-ad9f-61415dc55338 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:51.915276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:51.939152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9520bb4-0b26-49e8-ad9f-61415dc55338 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:51.984230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f77e4-d0dd-4515-a6c2-4446e3814c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:51.985257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f77e4-d0dd-4515-a6c2-4446e3814c7b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:51.985949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f77e4-d0dd-4515-a6c2-4446e3814c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:51.986384 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f77e4-d0dd-4515-a6c2-4446e3814c7b None admin] PATH_INFO: `/v3/projects/3b49bb0389054389a36cfc1189da9dea` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:51.987871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f77e4-d0dd-4515-a6c2-4446e3814c7b None admin] RBAC: Authorizing `identity:get_project(project_id=3b49bb0389054389a36cfc1189da9dea)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:51.989579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f77e4-d0dd-4515-a6c2-4446e3814c7b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:51.992051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 526/1052] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:29:51 2022] GET /identity/v3/projects/3b49bb0389054389a36cfc1189da9dea => generated 311 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:52.008548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53054fdc-b63f-43c8-9363-d086c33b868b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:52.169011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53054fdc-b63f-43c8-9363-d086c33b868b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:52.208199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:52.217079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae0946-b6c7-44ff-83cd-1f85af6de409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:52.227134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae0946-b6c7-44ff-83cd-1f85af6de409 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:52.227134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae0946-b6c7-44ff-83cd-1f85af6de409 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:52.227134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae0946-b6c7-44ff-83cd-1f85af6de409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:52.227134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae0946-b6c7-44ff-83cd-1f85af6de409 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=3b49bb0389054389a36cfc1189da9dea, user.id=69f49784135b4038b34f984b5070c983) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:52.227134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae0946-b6c7-44ff-83cd-1f85af6de409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:52.227134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae0946-b6c7-44ff-83cd-1f85af6de409 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:52.237036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 527/1053] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:29:52 2022] GET /identity/v3/role_assignments?user.id=69f49784135b4038b34f984b5070c983&scope.project.id=3b49bb0389054389a36cfc1189da9dea&role.id=c0316e22a13a4034846c451753b4c14e => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:52.662123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e29c6-9ecb-4c71-8589-7264ae2ff394 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:52.662603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e29c6-9ecb-4c71-8589-7264ae2ff394 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:52.663010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e29c6-9ecb-4c71-8589-7264ae2ff394 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:52.664896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 527/1054] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:52.670902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43f8b-3063-4267-b5c6-b83bdcd773a2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:52.671991 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43f8b-3063-4267-b5c6-b83bdcd773a2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:52.671991 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a43f8b-3063-4267-b5c6-b83bdcd773a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:52.696070 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-89a43f8b-3063-4267-b5c6-b83bdcd773a2 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:52.697326 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-89a43f8b-3063-4267-b5c6-b83bdcd773a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:52.801751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 528/1055] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:53.110766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e29c6-9ecb-4c71-8589-7264ae2ff394 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:53.157550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a555161-7a0b-4693-a932-944a1fecff77 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:53.157861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a555161-7a0b-4693-a932-944a1fecff77 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:53.158085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a555161-7a0b-4693-a932-944a1fecff77 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:53.159829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 529/1056] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:53.166424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3af20-df3f-48aa-95aa-24f34d48522d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:53.166769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3af20-df3f-48aa-95aa-24f34d48522d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:53.166985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3af20-df3f-48aa-95aa-24f34d48522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:53.189269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-91a3af20-df3f-48aa-95aa-24f34d48522d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:53.190494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-91a3af20-df3f-48aa-95aa-24f34d48522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:53.263178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e29c6-9ecb-4c71-8589-7264ae2ff394 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:53.287570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 530/1057] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:53.318577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de0446-5342-4c14-a9fb-5543ddfc8a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:53.319597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de0446-5342-4c14-a9fb-5543ddfc8a58 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:53.320061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de0446-5342-4c14-a9fb-5543ddfc8a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:53.320658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de0446-5342-4c14-a9fb-5543ddfc8a58 None admin] PATH_INFO: `/v3/services/image` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:53.322091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de0446-5342-4c14-a9fb-5543ddfc8a58 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:53.325348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de0446-5342-4c14-a9fb-5543ddfc8a58 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-81de0446-5342-4c14-a9fb-5543ddfc8a58 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:53.344343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:53.345838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 21:29:53.346724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:53.348231 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 528/1058] 10.222.0.83 () {56 vars in 1105 bytes} [Mon Aug 29 21:29:53 2022] GET /identity/v3/services/image => generated 86 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:53.357364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3af20-df3f-48aa-95aa-24f34d48522d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:53.469881 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:53.564913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3af20-df3f-48aa-95aa-24f34d48522d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:53.588131 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de0446-5342-4c14-a9fb-5543ddfc8a58 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:53.607919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:53.613124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9488f-6b7f-40b8-aaf0-16b7f3b38fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:53.614125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9488f-6b7f-40b8-aaf0-16b7f3b38fda None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:53.614595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9488f-6b7f-40b8-aaf0-16b7f3b38fda None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:53.615083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9488f-6b7f-40b8-aaf0-16b7f3b38fda None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:53.616272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9488f-6b7f-40b8-aaf0-16b7f3b38fda None admin] RBAC: Adding query filter params (name=image) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:53.616826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9488f-6b7f-40b8-aaf0-16b7f3b38fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:53.618243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9488f-6b7f-40b8-aaf0-16b7f3b38fda None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:53.624670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 531/1059] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:53.631569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9488f-6b7f-40b8-aaf0-16b7f3b38fda None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:53.739563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de0446-5342-4c14-a9fb-5543ddfc8a58 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:53.804590 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536235d0-dc55-46bb-a6c6-e9ac42cf596d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:53.806029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536235d0-dc55-46bb-a6c6-e9ac42cf596d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:53.806725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536235d0-dc55-46bb-a6c6-e9ac42cf596d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:53.807189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536235d0-dc55-46bb-a6c6-e9ac42cf596d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:53.808363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9488f-6b7f-40b8-aaf0-16b7f3b38fda None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:53.830723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536235d0-dc55-46bb-a6c6-e9ac42cf596d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-536235d0-dc55-46bb-a6c6-e9ac42cf596d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:53.841280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:53.843082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:53.845369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:53.846651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:53.851431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 529/1060] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 21:29:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:53.852884 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536235d0-dc55-46bb-a6c6-e9ac42cf596d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:53.872060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8215b-a625-4ef3-9f8e-7981ce171543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:53.872726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8215b-a625-4ef3-9f8e-7981ce171543 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:53.873058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8215b-a625-4ef3-9f8e-7981ce171543 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:53.873300 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8215b-a625-4ef3-9f8e-7981ce171543 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:53.874461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8215b-a625-4ef3-9f8e-7981ce171543 None admin] RBAC: Adding query filter params (type=image) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:53.874768 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8215b-a625-4ef3-9f8e-7981ce171543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:53.876593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8215b-a625-4ef3-9f8e-7981ce171543 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:53.885940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 532/1061] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:53.896170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8215b-a625-4ef3-9f8e-7981ce171543 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:53.987306 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:54.050270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536235d0-dc55-46bb-a6c6-e9ac42cf596d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:54.113291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8215b-a625-4ef3-9f8e-7981ce171543 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:54.120701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99319119-6d03-4903-b719-a60d56cda232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:54.121772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99319119-6d03-4903-b719-a60d56cda232 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:54.122269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99319119-6d03-4903-b719-a60d56cda232 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:54.122765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99319119-6d03-4903-b719-a60d56cda232 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:54.124040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99319119-6d03-4903-b719-a60d56cda232 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:54.124663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99319119-6d03-4903-b719-a60d56cda232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:54.128093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99319119-6d03-4903-b719-a60d56cda232 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:54.143247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 530/1062] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 21:29:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:54.149616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99319119-6d03-4903-b719-a60d56cda232 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:54.190013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773e332-ca84-4dc1-8b5f-e059e9ac9fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:54.191505 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773e332-ca84-4dc1-8b5f-e059e9ac9fe3 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:54.192269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773e332-ca84-4dc1-8b5f-e059e9ac9fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:54.193224 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773e332-ca84-4dc1-8b5f-e059e9ac9fe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:54.194782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773e332-ca84-4dc1-8b5f-e059e9ac9fe3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:54.197804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773e332-ca84-4dc1-8b5f-e059e9ac9fe3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:54.328914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99319119-6d03-4903-b719-a60d56cda232 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:54.396624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 533/1063] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:29:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:29:54.404464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:54.416970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c10c7-3f4e-49bd-ac74-a54a1511f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:54.418550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c10c7-3f4e-49bd-ac74-a54a1511f0ae None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:54.419085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c10c7-3f4e-49bd-ac74-a54a1511f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:54.419371 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c10c7-3f4e-49bd-ac74-a54a1511f0ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:54.441282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c10c7-3f4e-49bd-ac74-a54a1511f0ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:54.443870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c10c7-3f4e-49bd-ac74-a54a1511f0ae None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-378c10c7-3f4e-49bd-ac74-a54a1511f0ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:54.471919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:54.481216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:54.483542 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:54.483542 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:54.483542 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:54.483542 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 531/1064] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:54.488317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773e332-ca84-4dc1-8b5f-e059e9ac9fe3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:54.548186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91d72-91e5-4462-9b9d-704b95da5f45 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:54.548461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91d72-91e5-4462-9b9d-704b95da5f45 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:54.548631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:54.548788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa91d72-91e5-4462-9b9d-704b95da5f45 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:54.550576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 532/1065] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:54.559810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bace3-b21f-44d1-ae75-2a033d8e1206 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:54.563094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bace3-b21f-44d1-ae75-2a033d8e1206 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:54.563094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bace3-b21f-44d1-ae75-2a033d8e1206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:54.589102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-623bace3-b21f-44d1-ae75-2a033d8e1206 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:54.591286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-623bace3-b21f-44d1-ae75-2a033d8e1206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:54.645245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773e332-ca84-4dc1-8b5f-e059e9ac9fe3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:54.706019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4745b1-a3f5-46dd-b705-0ffc70db99ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:54.706929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4745b1-a3f5-46dd-b705-0ffc70db99ac None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:54.707392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4745b1-a3f5-46dd-b705-0ffc70db99ac None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:54.707851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4745b1-a3f5-46dd-b705-0ffc70db99ac None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:54.709049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4745b1-a3f5-46dd-b705-0ffc70db99ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:54.709576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4745b1-a3f5-46dd-b705-0ffc70db99ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:54.712113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4745b1-a3f5-46dd-b705-0ffc70db99ac None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:54.722700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 533/1066] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:54.735666 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 534/1067] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:54.742626 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bace3-b21f-44d1-ae75-2a033d8e1206 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:54.881675 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bace3-b21f-44d1-ae75-2a033d8e1206 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:54.901521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:54.931304 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087adbc-7151-4296-b1b1-fd7f480d3d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:54.932242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087adbc-7151-4296-b1b1-fd7f480d3d12 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:54.932720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087adbc-7151-4296-b1b1-fd7f480d3d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:54.933210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e087adbc-7151-4296-b1b1-fd7f480d3d12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:54.943147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087adbc-7151-4296-b1b1-fd7f480d3d12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:54.944917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e087adbc-7151-4296-b1b1-fd7f480d3d12 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-e087adbc-7151-4296-b1b1-fd7f480d3d12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:29:54.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:54.962336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:54.963498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 534/1068] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 21:29:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:54.971612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4745b1-a3f5-46dd-b705-0ffc70db99ac None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:55.125763 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087adbc-7151-4296-b1b1-fd7f480d3d12 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:55.185314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:55.192869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4745b1-a3f5-46dd-b705-0ffc70db99ac None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:55.260514 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06add5-1890-4ba3-b892-e8c329f51f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:55.262347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06add5-1890-4ba3-b892-e8c329f51f54 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:55.262851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06add5-1890-4ba3-b892-e8c329f51f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:55.263342 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06add5-1890-4ba3-b892-e8c329f51f54 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:55.264788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06add5-1890-4ba3-b892-e8c329f51f54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:55.265343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06add5-1890-4ba3-b892-e8c329f51f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:55.268164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06add5-1890-4ba3-b892-e8c329f51f54 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:55.306747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 535/1069] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 21:29:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:55.314165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06add5-1890-4ba3-b892-e8c329f51f54 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:55.337372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e087adbc-7151-4296-b1b1-fd7f480d3d12 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:55.409273 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916e84-4cdc-446b-8076-ac8b22006b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:55.410299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916e84-4cdc-446b-8076-ac8b22006b4e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:55.410800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916e84-4cdc-446b-8076-ac8b22006b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:55.411295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35916e84-4cdc-446b-8076-ac8b22006b4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:55.432433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35916e84-4cdc-446b-8076-ac8b22006b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-35916e84-4cdc-446b-8076-ac8b22006b4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:55.442223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:55.444192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:55.446074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 535/1070] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:29:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:55.453332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916e84-4cdc-446b-8076-ac8b22006b4e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:55.462812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06add5-1890-4ba3-b892-e8c329f51f54 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:55.501297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:55.515232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0205f55-2d12-4ea7-89cd-f739f33b309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:55.516174 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0205f55-2d12-4ea7-89cd-f739f33b309d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:55.516596 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0205f55-2d12-4ea7-89cd-f739f33b309d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:55.516998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0205f55-2d12-4ea7-89cd-f739f33b309d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:55.537858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0205f55-2d12-4ea7-89cd-f739f33b309d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:55.539634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0205f55-2d12-4ea7-89cd-f739f33b309d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-c0205f55-2d12-4ea7-89cd-f739f33b309d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:55.559657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:55.561758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:55.563456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:55.563456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:55.563456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:55.563456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 536/1071] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:55.567287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0205f55-2d12-4ea7-89cd-f739f33b309d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:55.580579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:55.619738 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35916e84-4cdc-446b-8076-ac8b22006b4e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:55.672400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e24970-37c1-4729-a0c9-8866d51b5736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:55.673821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e24970-37c1-4729-a0c9-8866d51b5736 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:55.674403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e24970-37c1-4729-a0c9-8866d51b5736 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:55.675065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e24970-37c1-4729-a0c9-8866d51b5736 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:55.676375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e24970-37c1-4729-a0c9-8866d51b5736 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:55.677059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e24970-37c1-4729-a0c9-8866d51b5736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:55.678858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e24970-37c1-4729-a0c9-8866d51b5736 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:55.700987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 536/1072] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:29:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:55.710401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e24970-37c1-4729-a0c9-8866d51b5736 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:55.763368 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0205f55-2d12-4ea7-89cd-f739f33b309d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:55.830400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6dbfe-1975-41a9-8597-ca687ec5208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:55.831249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6dbfe-1975-41a9-8597-ca687ec5208d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:55.831717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6dbfe-1975-41a9-8597-ca687ec5208d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:55.832185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6dbfe-1975-41a9-8597-ca687ec5208d None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:55.833413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6dbfe-1975-41a9-8597-ca687ec5208d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:55.834052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6dbfe-1975-41a9-8597-ca687ec5208d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:55.836887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c6dbfe-1975-41a9-8597-ca687ec5208d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:55.872022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 537/1073] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:55.872338 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:55.875443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6dbfe-1975-41a9-8597-ca687ec5208d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:55.880051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e24970-37c1-4729-a0c9-8866d51b5736 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:55.939623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67212b82-63d9-49b2-b14d-42a73e457fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:55.940731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67212b82-63d9-49b2-b14d-42a73e457fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:55.941205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67212b82-63d9-49b2-b14d-42a73e457fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:55.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67212b82-63d9-49b2-b14d-42a73e457fc4 None admin] PATH_INFO: `/v3/users/69f49784135b4038b34f984b5070c983` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:55.944063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67212b82-63d9-49b2-b14d-42a73e457fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=69f49784135b4038b34f984b5070c983)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:55.946779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67212b82-63d9-49b2-b14d-42a73e457fc4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:55.957996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 537/1074] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:29:55 2022] GET /identity/v3/users/69f49784135b4038b34f984b5070c983 => generated 285 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:55.959560 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67212b82-63d9-49b2-b14d-42a73e457fc4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:55.983504 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:56.045423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6dbfe-1975-41a9-8597-ca687ec5208d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:56.105753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253282f5-2e17-44ad-b24a-a4392626fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:56.106453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253282f5-2e17-44ad-b24a-a4392626fa4e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:56.106739 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253282f5-2e17-44ad-b24a-a4392626fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:56.107024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253282f5-2e17-44ad-b24a-a4392626fa4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:56.116173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253282f5-2e17-44ad-b24a-a4392626fa4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:56.118731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253282f5-2e17-44ad-b24a-a4392626fa4e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:56.125025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67212b82-63d9-49b2-b14d-42a73e457fc4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-253282f5-2e17-44ad-b24a-a4392626fa4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:29:56.135840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:56.143611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:56.145650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:29:56.145650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:29:56.145650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:29:56.145650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:29:56.145650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:29:56.145650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:29:56.145650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:29:56.145650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:56.145650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 538/1075] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:56.145650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253282f5-2e17-44ad-b24a-a4392626fa4e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:56.183137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185d596-7dcd-43be-912a-e1a99d068259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:56.183989 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185d596-7dcd-43be-912a-e1a99d068259 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:56.184145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185d596-7dcd-43be-912a-e1a99d068259 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:56.184298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185d596-7dcd-43be-912a-e1a99d068259 None admin] PATH_INFO: `/v3/projects/3b49bb0389054389a36cfc1189da9dea` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:56.185692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185d596-7dcd-43be-912a-e1a99d068259 None admin] RBAC: Authorizing `identity:get_project(project_id=3b49bb0389054389a36cfc1189da9dea)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:56.187460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185d596-7dcd-43be-912a-e1a99d068259 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:56.189902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 538/1076] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:29:55 2022] GET /identity/v3/projects/3b49bb0389054389a36cfc1189da9dea => generated 311 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:29:56.195991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185d596-7dcd-43be-912a-e1a99d068259 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:56.245178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:56.295600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253282f5-2e17-44ad-b24a-a4392626fa4e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:56.348077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:56.352793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185d596-7dcd-43be-912a-e1a99d068259 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:56.372077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5917c10-e23c-481d-a2e7-e057c778b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:56.372077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5917c10-e23c-481d-a2e7-e057c778b9bf None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:56.372077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5917c10-e23c-481d-a2e7-e057c778b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:56.372077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5917c10-e23c-481d-a2e7-e057c778b9bf None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:56.372712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5917c10-e23c-481d-a2e7-e057c778b9bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:56.372712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5917c10-e23c-481d-a2e7-e057c778b9bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:56.372712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5917c10-e23c-481d-a2e7-e057c778b9bf None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:56.381061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 539/1077] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:56.387864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5917c10-e23c-481d-a2e7-e057c778b9bf None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:56.409905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7506423-68d2-4f3b-a2f0-e974bc4ed4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:56.410938 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7506423-68d2-4f3b-a2f0-e974bc4ed4fa None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:56.411616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7506423-68d2-4f3b-a2f0-e974bc4ed4fa None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:56.412268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7506423-68d2-4f3b-a2f0-e974bc4ed4fa None admin] PATH_INFO: `/v3/projects/3b49bb0389054389a36cfc1189da9dea/users/69f49784135b4038b34f984b5070c983/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:56.416167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7506423-68d2-4f3b-a2f0-e974bc4ed4fa None admin] RBAC: Authorizing `identity:create_grant(project_id=3b49bb0389054389a36cfc1189da9dea, user_id=69f49784135b4038b34f984b5070c983, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:56.418102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7506423-68d2-4f3b-a2f0-e974bc4ed4fa None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:56.559386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 539/1078] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:29:56 2022] PUT /identity/v3/projects/3b49bb0389054389a36cfc1189da9dea/users/69f49784135b4038b34f984b5070c983/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:29:56.578525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5917c10-e23c-481d-a2e7-e057c778b9bf None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:56.627334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1b4ea-cd23-4991-8f90-374d75d619d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:56.628173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1b4ea-cd23-4991-8f90-374d75d619d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:56.628633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1b4ea-cd23-4991-8f90-374d75d619d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:56.629158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1b4ea-cd23-4991-8f90-374d75d619d0 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/8434659c6b164b97b5ac27fb7e4d6a26/roles/49450d81c24b4a9c9cfeddef6bb97052` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:56.632236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1b4ea-cd23-4991-8f90-374d75d619d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=8434659c6b164b97b5ac27fb7e4d6a26, role_id=49450d81c24b4a9c9cfeddef6bb97052)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:56.634036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1b4ea-cd23-4991-8f90-374d75d619d0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:56.752911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 540/1079] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:29:56 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/8434659c6b164b97b5ac27fb7e4d6a26/roles/49450d81c24b4a9c9cfeddef6bb97052 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:29:56.939515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bdc5f-7e30-4fd7-afa9-8e8abdd954fa None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:56.939997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bdc5f-7e30-4fd7-afa9-8e8abdd954fa None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:56.940147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bdc5f-7e30-4fd7-afa9-8e8abdd954fa None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:56.942122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 540/1080] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:56.952289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8afc6-9916-40c9-a776-f4b1caa7e05f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:56.952734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8afc6-9916-40c9-a776-f4b1caa7e05f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:56.952854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8afc6-9916-40c9-a776-f4b1caa7e05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:56.979401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-23a8afc6-9916-40c9-a776-f4b1caa7e05f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:56.981438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-23a8afc6-9916-40c9-a776-f4b1caa7e05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:57.059739 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:57.096930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 541/1081] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:57.382207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bdc5f-7e30-4fd7-afa9-8e8abdd954fa None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.493830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:57.507146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bdc5f-7e30-4fd7-afa9-8e8abdd954fa None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:57.557889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66788840-6bab-49cb-af9e-9c3ab47b5f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:57.558634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66788840-6bab-49cb-af9e-9c3ab47b5f0b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:57.558986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66788840-6bab-49cb-af9e-9c3ab47b5f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:57.559328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66788840-6bab-49cb-af9e-9c3ab47b5f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:57.683580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66788840-6bab-49cb-af9e-9c3ab47b5f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:57.686407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66788840-6bab-49cb-af9e-9c3ab47b5f0b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:57.836656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:57.850768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 541/1082] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:29:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:29:57.858006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8afc6-9916-40c9-a776-f4b1caa7e05f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:57.988846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8afc6-9916-40c9-a776-f4b1caa7e05f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.055630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb5b34-8941-4696-9b69-a7df042a6da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.056746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb5b34-8941-4696-9b69-a7df042a6da3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.057231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb5b34-8941-4696-9b69-a7df042a6da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.057705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb5b34-8941-4696-9b69-a7df042a6da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.074461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb5b34-8941-4696-9b69-a7df042a6da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.076132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb5b34-8941-4696-9b69-a7df042a6da3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-7aeb5b34-8941-4696-9b69-a7df042a6da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:58.099414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:58.101649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:58.103526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:58.103526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:58.103526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:58.103526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 542/1083] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:58.108557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66788840-6bab-49cb-af9e-9c3ab47b5f0b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:58.231855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66788840-6bab-49cb-af9e-9c3ab47b5f0b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:58.276896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186493c3-f1c5-4ef8-bb19-dbb9bf90fdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:58.277784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186493c3-f1c5-4ef8-bb19-dbb9bf90fdac None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.277964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186493c3-f1c5-4ef8-bb19-dbb9bf90fdac None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.278255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186493c3-f1c5-4ef8-bb19-dbb9bf90fdac None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.278905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186493c3-f1c5-4ef8-bb19-dbb9bf90fdac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:58.279434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186493c3-f1c5-4ef8-bb19-dbb9bf90fdac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:58.280663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186493c3-f1c5-4ef8-bb19-dbb9bf90fdac None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:58.300524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 542/1084] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:58.876816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bd4ca-8f94-4c24-b0e6-ee2de81e9e1e None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.877225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bd4ca-8f94-4c24-b0e6-ee2de81e9e1e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.877593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3bd4ca-8f94-4c24-b0e6-ee2de81e9e1e None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.879260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 543/1085] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:29:58.885873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26dba4-9607-452f-91a4-f4775c1295b0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:58.886716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26dba4-9607-452f-91a4-f4775c1295b0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:58.886871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26dba4-9607-452f-91a4-f4775c1295b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:58.912797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-1b26dba4-9607-452f-91a4-f4775c1295b0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:58.914833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-1b26dba4-9607-452f-91a4-f4775c1295b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:58.974072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:58.998970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 543/1086] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:29:59.270540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bd4ca-8f94-4c24-b0e6-ee2de81e9e1e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.306566 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:59.388474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3bd4ca-8f94-4c24-b0e6-ee2de81e9e1e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.429782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bd131-2be4-475d-aa22-b2ccc2a544e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.430513 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bd131-2be4-475d-aa22-b2ccc2a544e8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.430853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bd131-2be4-475d-aa22-b2ccc2a544e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.431187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bd131-2be4-475d-aa22-b2ccc2a544e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.443253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bd131-2be4-475d-aa22-b2ccc2a544e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-b04bd131-2be4-475d-aa22-b2ccc2a544e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:29:59.448213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:59.449783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:29:59.452060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 544/1087] 10.222.0.83 () {56 vars in 1120 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:29:59.457866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26dba4-9607-452f-91a4-f4775c1295b0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.615254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26dba4-9607-452f-91a4-f4775c1295b0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.646204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3b71-677f-4659-9abb-a3edcd7f8028 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.646483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3b71-677f-4659-9abb-a3edcd7f8028 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.646759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b3b71-677f-4659-9abb-a3edcd7f8028 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.648910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 545/1088] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:29:59.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a6b87-0ea2-4d55-93d3-c7505dadad22 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.655496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a6b87-0ea2-4d55-93d3-c7505dadad22 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.655768 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a6b87-0ea2-4d55-93d3-c7505dadad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.675967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-194a6b87-0ea2-4d55-93d3-c7505dadad22 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:29:59.677263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-194a6b87-0ea2-4d55-93d3-c7505dadad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:29:59.684573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d885e-ea95-475e-a6f1-185b41aa8abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.685566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d885e-ea95-475e-a6f1-185b41aa8abe None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.686043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d885e-ea95-475e-a6f1-185b41aa8abe None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.686769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d885e-ea95-475e-a6f1-185b41aa8abe None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.688297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d885e-ea95-475e-a6f1-185b41aa8abe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:29:59.688875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d885e-ea95-475e-a6f1-185b41aa8abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.691435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d885e-ea95-475e-a6f1-185b41aa8abe None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.708060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 544/1089] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:29:59.715503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d885e-ea95-475e-a6f1-185b41aa8abe None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.768828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 546/1090] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:29:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:29:59.773943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:29:59.865865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d885e-ea95-475e-a6f1-185b41aa8abe None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:29:59.906733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5283a-da6e-4000-9979-4b9c22144bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:29:59.907645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5283a-da6e-4000-9979-4b9c22144bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:29:59.907849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5283a-da6e-4000-9979-4b9c22144bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:29:59.908082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5283a-da6e-4000-9979-4b9c22144bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:29:59.921286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5283a-da6e-4000-9979-4b9c22144bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:29:59.922780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5283a-da6e-4000-9979-4b9c22144bd7 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-bda5283a-da6e-4000-9979-4b9c22144bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:29:59.939808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:29:59.941666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:29:59.943303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:29:59.943303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:29:59.943303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:29:59.943303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 545/1091] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:29:59.947897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a6b87-0ea2-4d55-93d3-c7505dadad22 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:29:59.991468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.048334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5283a-da6e-4000-9979-4b9c22144bd7 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.130429 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a6b87-0ea2-4d55-93d3-c7505dadad22 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.170914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca41f7f-31e8-4e36-86eb-65b9636d5ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.171916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca41f7f-31e8-4e36-86eb-65b9636d5ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.172203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca41f7f-31e8-4e36-86eb-65b9636d5ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.172513 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca41f7f-31e8-4e36-86eb-65b9636d5ce6 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.173281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca41f7f-31e8-4e36-86eb-65b9636d5ce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:00.173586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca41f7f-31e8-4e36-86eb-65b9636d5ce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.175018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca41f7f-31e8-4e36-86eb-65b9636d5ce6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.176823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.184593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5283a-da6e-4000-9979-4b9c22144bd7 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.188142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 547/1092] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:00.197117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca41f7f-31e8-4e36-86eb-65b9636d5ce6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.229510 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae5b5-ec62-408d-a376-9f725a9cca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.230363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae5b5-ec62-408d-a376-9f725a9cca09 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.230725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae5b5-ec62-408d-a376-9f725a9cca09 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.231105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dae5b5-ec62-408d-a376-9f725a9cca09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.244890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dae5b5-ec62-408d-a376-9f725a9cca09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-89dae5b5-ec62-408d-a376-9f725a9cca09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:30:00.250819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:00.252798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:30:00.254298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 546/1093] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:30:00.261722 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae5b5-ec62-408d-a376-9f725a9cca09 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.313957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.344548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca41f7f-31e8-4e36-86eb-65b9636d5ce6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.398103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7d3af-f7dd-4c74-b696-8249ce956245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.399085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7d3af-f7dd-4c74-b696-8249ce956245 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.399547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7d3af-f7dd-4c74-b696-8249ce956245 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.400159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7d3af-f7dd-4c74-b696-8249ce956245 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.407116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dae5b5-ec62-408d-a376-9f725a9cca09 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.414509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7d3af-f7dd-4c74-b696-8249ce956245 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.417181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7d3af-f7dd-4c74-b696-8249ce956245 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-7fe7d3af-f7dd-4c74-b696-8249ce956245 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:30:00.439749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:00.441159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:30:00.442481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 548/1094] 10.222.0.83 () {56 vars in 1093 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:30:00.449147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7d3af-f7dd-4c74-b696-8249ce956245 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.453743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8a0aa-7848-49c8-adb5-69a78144e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.454727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8a0aa-7848-49c8-adb5-69a78144e76c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.455116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8a0aa-7848-49c8-adb5-69a78144e76c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.455439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8a0aa-7848-49c8-adb5-69a78144e76c None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.456335 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8a0aa-7848-49c8-adb5-69a78144e76c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:00.456881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8a0aa-7848-49c8-adb5-69a78144e76c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.459396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8a0aa-7848-49c8-adb5-69a78144e76c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.482620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 547/1095] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:00.483865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8a0aa-7848-49c8-adb5-69a78144e76c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.504995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.606943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8a0aa-7848-49c8-adb5-69a78144e76c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.610276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7d3af-f7dd-4c74-b696-8249ce956245 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.653039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaa1f9-8cab-4f10-a0ec-83f1010d0a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.653695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaa1f9-8cab-4f10-a0ec-83f1010d0a73 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.653999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaa1f9-8cab-4f10-a0ec-83f1010d0a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.654411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eaa1f9-8cab-4f10-a0ec-83f1010d0a73 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.655474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaa1f9-8cab-4f10-a0ec-83f1010d0a73 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:00.658046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaa1f9-8cab-4f10-a0ec-83f1010d0a73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.658046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eaa1f9-8cab-4f10-a0ec-83f1010d0a73 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.665655 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29926a20-89e5-4356-8835-104b3406e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.666942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926a20-89e5-4356-8835-104b3406e9ac None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.668094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926a20-89e5-4356-8835-104b3406e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.668538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29926a20-89e5-4356-8835-104b3406e9ac None admin] PATH_INFO: `/v3/users/69f49784135b4038b34f984b5070c983` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.670137 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.670381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29926a20-89e5-4356-8835-104b3406e9ac None admin] RBAC: Authorizing `identity:get_user(user_id=69f49784135b4038b34f984b5070c983)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.672785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29926a20-89e5-4356-8835-104b3406e9ac None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:00.675963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 548/1096] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/users/69f49784135b4038b34f984b5070c983 => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:00.680619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 549/1097] 10.222.0.83 () {56 vars in 1133 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:00.683256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29926a20-89e5-4356-8835-104b3406e9ac None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.686623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaa1f9-8cab-4f10-a0ec-83f1010d0a73 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:00.811706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.818357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eaa1f9-8cab-4f10-a0ec-83f1010d0a73 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.836396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29926a20-89e5-4356-8835-104b3406e9ac None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:00.863355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd922d7e-e992-4f35-ad34-ced95c45b002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.863983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922d7e-e992-4f35-ad34-ced95c45b002 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.864268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922d7e-e992-4f35-ad34-ced95c45b002 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.864587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd922d7e-e992-4f35-ad34-ced95c45b002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.892379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d8e7-8182-4335-8282-931b48c577fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:00.893466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d8e7-8182-4335-8282-931b48c577fc None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:00.893954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d8e7-8182-4335-8282-931b48c577fc None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:00.894451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d8e7-8182-4335-8282-931b48c577fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:00.950539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:00.954424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd922d7e-e992-4f35-ad34-ced95c45b002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:00.955901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd922d7e-e992-4f35-ad34-ced95c45b002 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.029299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4d8e7-8182-4335-8282-931b48c577fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.031687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4d8e7-8182-4335-8282-931b48c577fc None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.079646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 550/1098] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:30:01.086236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd922d7e-e992-4f35-ad34-ced95c45b002 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.149465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:01.176646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 549/1099] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:30:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:30:01.186458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d8e7-8182-4335-8282-931b48c577fc None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.204545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:01.209503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd922d7e-e992-4f35-ad34-ced95c45b002 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.251162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0382e-fbaa-4a92-aaf3-799226eca846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.251847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0382e-fbaa-4a92-aaf3-799226eca846 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.252126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0382e-fbaa-4a92-aaf3-799226eca846 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.252390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0382e-fbaa-4a92-aaf3-799226eca846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.265243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0382e-fbaa-4a92-aaf3-799226eca846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.266843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0382e-fbaa-4a92-aaf3-799226eca846 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-23c0382e-fbaa-4a92-aaf3-799226eca846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:30:01.283050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:01.285000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:30:01.286435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:30:01.286435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:30:01.286435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:30:01.286435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 551/1100] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:30:01.290331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0382e-fbaa-4a92-aaf3-799226eca846 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.321083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d8e7-8182-4335-8282-931b48c577fc None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.365255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b44199-d529-4924-b7a0-958a07d7d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.365955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b44199-d529-4924-b7a0-958a07d7d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.366229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b44199-d529-4924-b7a0-958a07d7d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.366499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b44199-d529-4924-b7a0-958a07d7d2b9 None admin] PATH_INFO: `/v3/projects/3b49bb0389054389a36cfc1189da9dea` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.367701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b44199-d529-4924-b7a0-958a07d7d2b9 None admin] RBAC: Authorizing `identity:get_project(project_id=3b49bb0389054389a36cfc1189da9dea)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.369258 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b44199-d529-4924-b7a0-958a07d7d2b9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.371576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 550/1101] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/projects/3b49bb0389054389a36cfc1189da9dea => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:01.378129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b44199-d529-4924-b7a0-958a07d7d2b9 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.411868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0382e-fbaa-4a92-aaf3-799226eca846 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.441615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:01.451670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531d33f-bbe7-4c4d-a30f-6af9b3796917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.452606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531d33f-bbe7-4c4d-a30f-6af9b3796917 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.452606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531d33f-bbe7-4c4d-a30f-6af9b3796917 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.457595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531d33f-bbe7-4c4d-a30f-6af9b3796917 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.457595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531d33f-bbe7-4c4d-a30f-6af9b3796917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:01.457595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531d33f-bbe7-4c4d-a30f-6af9b3796917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.457595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531d33f-bbe7-4c4d-a30f-6af9b3796917 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.475202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 552/1102] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:01.477039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531d33f-bbe7-4c4d-a30f-6af9b3796917 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.493199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:01.498531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b44199-d529-4924-b7a0-958a07d7d2b9 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.547545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abf447-8aab-4593-9d34-ef37a6feaa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.548991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abf447-8aab-4593-9d34-ef37a6feaa42 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.548991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abf447-8aab-4593-9d34-ef37a6feaa42 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.548991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abf447-8aab-4593-9d34-ef37a6feaa42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.550251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abf447-8aab-4593-9d34-ef37a6feaa42 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=3b49bb0389054389a36cfc1189da9dea, user.id=69f49784135b4038b34f984b5070c983) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:01.550781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abf447-8aab-4593-9d34-ef37a6feaa42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.552897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abf447-8aab-4593-9d34-ef37a6feaa42 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.560321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 551/1103] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/role_assignments?user.id=69f49784135b4038b34f984b5070c983&scope.project.id=3b49bb0389054389a36cfc1189da9dea&role.id=c0316e22a13a4034846c451753b4c14e => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:01.602764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531d33f-bbe7-4c4d-a30f-6af9b3796917 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.647189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a085f-d870-45f7-8c16-4cd0e0d79bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.647852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a085f-d870-45f7-8c16-4cd0e0d79bcd None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.648129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a085f-d870-45f7-8c16-4cd0e0d79bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.648399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a085f-d870-45f7-8c16-4cd0e0d79bcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.656678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a085f-d870-45f7-8c16-4cd0e0d79bcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.658186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a085f-d870-45f7-8c16-4cd0e0d79bcd None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-4f6a085f-d870-45f7-8c16-4cd0e0d79bcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:30:01.671813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:01.673370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:01.674316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:30:01.674316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:30:01.674316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:30:01.674316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:30:01.674316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:30:01.674316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:30:01.674316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:30:01.674316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:30:01.674316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 553/1104] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:30:01.681912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abf447-8aab-4593-9d34-ef37a6feaa42 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.810925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abf447-8aab-4593-9d34-ef37a6feaa42 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:01.830640 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:01.851018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017d0df-942c-412e-86a9-6aa7a4257504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:01.851642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017d0df-942c-412e-86a9-6aa7a4257504 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:01.851923 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017d0df-942c-412e-86a9-6aa7a4257504 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:01.852195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017d0df-942c-412e-86a9-6aa7a4257504 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:01.853005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017d0df-942c-412e-86a9-6aa7a4257504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:01.853316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017d0df-942c-412e-86a9-6aa7a4257504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:01.855328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4017d0df-942c-412e-86a9-6aa7a4257504 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:01.870952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 552/1105] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:01.877120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a085f-d870-45f7-8c16-4cd0e0d79bcd None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:01.963515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:02.006222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a085f-d870-45f7-8c16-4cd0e0d79bcd None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:02.052215 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a798b6-0155-48dd-97e4-155b91c83171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:02.052989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a798b6-0155-48dd-97e4-155b91c83171 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:02.053352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a798b6-0155-48dd-97e4-155b91c83171 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:02.053705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a798b6-0155-48dd-97e4-155b91c83171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:02.054529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a798b6-0155-48dd-97e4-155b91c83171 None admin] RBAC: Adding query filter params (role.id=49450d81c24b4a9c9cfeddef6bb97052, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=8434659c6b164b97b5ac27fb7e4d6a26) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:02.054940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a798b6-0155-48dd-97e4-155b91c83171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:02.056547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a798b6-0155-48dd-97e4-155b91c83171 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:02.064151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 554/1106] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:30:01 2022] GET /identity/v3/role_assignments?user.id=8434659c6b164b97b5ac27fb7e4d6a26&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=49450d81c24b4a9c9cfeddef6bb97052 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:03.602745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f230c-5c48-4527-944c-729ce5b56fd7 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:03.639709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f230c-5c48-4527-944c-729ce5b56fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:03.639709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f230c-5c48-4527-944c-729ce5b56fd7 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:03.639709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 553/1107] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:30:03.640163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527e8ca-ca19-4a97-90cf-f8bea8e48c23 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:03.640163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527e8ca-ca19-4a97-90cf-f8bea8e48c23 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:03.640163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527e8ca-ca19-4a97-90cf-f8bea8e48c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:03.640163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3527e8ca-ca19-4a97-90cf-f8bea8e48c23 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:03.640163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3527e8ca-ca19-4a97-90cf-f8bea8e48c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:03.712125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 555/1108] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:30:03.984991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f230c-5c48-4527-944c-729ce5b56fd7 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:04.103638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f230c-5c48-4527-944c-729ce5b56fd7 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:04.146113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec5004-6968-46f0-b49a-ce641b7ce80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:04.146849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec5004-6968-46f0-b49a-ce641b7ce80a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:04.147130 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec5004-6968-46f0-b49a-ce641b7ce80a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:04.147401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec5004-6968-46f0-b49a-ce641b7ce80a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:04.148694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec5004-6968-46f0-b49a-ce641b7ce80a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:04.150279 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec5004-6968-46f0-b49a-ce641b7ce80a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:04.152629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 554/1109] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:30:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:04.159183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527e8ca-ca19-4a97-90cf-f8bea8e48c23 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:04.230957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:04.275910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527e8ca-ca19-4a97-90cf-f8bea8e48c23 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:04.318661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef365e-2546-43aa-ba7d-0de4aba9e1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:04.319324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef365e-2546-43aa-ba7d-0de4aba9e1a9 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:04.319648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef365e-2546-43aa-ba7d-0de4aba9e1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:04.319927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef365e-2546-43aa-ba7d-0de4aba9e1a9 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:04.320633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef365e-2546-43aa-ba7d-0de4aba9e1a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:04.322156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef365e-2546-43aa-ba7d-0de4aba9e1a9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:04.488672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 556/1110] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:30:04 2022] POST /identity/v3/users => generated 286 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:06.613166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ca550-3f59-463a-91d8-9fb1d649f24f None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:06.613775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ca550-3f59-463a-91d8-9fb1d649f24f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:06.613775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ca550-3f59-463a-91d8-9fb1d649f24f None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:06.615076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 555/1111] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:06.621545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3514e9-7e94-4979-9744-a6f5c1d7f353 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:06.622262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3514e9-7e94-4979-9744-a6f5c1d7f353 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:06.622262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3514e9-7e94-4979-9744-a6f5c1d7f353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:06.641608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2b3514e9-7e94-4979-9744-a6f5c1d7f353 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:06.642829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2b3514e9-7e94-4979-9744-a6f5c1d7f353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:06.717575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 557/1112] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:30:06.991824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ca550-3f59-463a-91d8-9fb1d649f24f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:07.048198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:07.107922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ca550-3f59-463a-91d8-9fb1d649f24f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:07.144910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764936-eee4-4ea7-a9f1-3549c4151de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:07.145552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764936-eee4-4ea7-a9f1-3549c4151de3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:07.145836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764936-eee4-4ea7-a9f1-3549c4151de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:07.146109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28764936-eee4-4ea7-a9f1-3549c4151de3 None admin] PATH_INFO: `/v3/roles/971e130ba91d4b7ab75b8e33d322760b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:07.147566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28764936-eee4-4ea7-a9f1-3549c4151de3 None admin] RBAC: Authorizing `identity:get_role(role_id=971e130ba91d4b7ab75b8e33d322760b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:07.148989 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28764936-eee4-4ea7-a9f1-3549c4151de3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:07.150374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 556/1113] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:06 2022] GET /identity/v3/roles/971e130ba91d4b7ab75b8e33d322760b => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:07.156607 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3514e9-7e94-4979-9744-a6f5c1d7f353 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:07.211788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:07.291566 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3514e9-7e94-4979-9744-a6f5c1d7f353 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:07.359627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a44cb-d8ba-49a2-bb80-7ffea1c5983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:07.360772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a44cb-d8ba-49a2-bb80-7ffea1c5983f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:07.361221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a44cb-d8ba-49a2-bb80-7ffea1c5983f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:07.361540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a44cb-d8ba-49a2-bb80-7ffea1c5983f None admin] PATH_INFO: `/v3/users/98c34045224e41f7bf1a0e359731d761` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:07.387627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a44cb-d8ba-49a2-bb80-7ffea1c5983f None admin] RBAC: Authorizing `identity:get_user(user_id=98c34045224e41f7bf1a0e359731d761)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:07.390448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a44cb-d8ba-49a2-bb80-7ffea1c5983f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:07.393630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 558/1114] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:07 2022] GET /identity/v3/users/98c34045224e41f7bf1a0e359731d761 => generated 286 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:07.399976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764936-eee4-4ea7-a9f1-3549c4151de3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:07.517334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28764936-eee4-4ea7-a9f1-3549c4151de3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:07.533665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:07.558534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0ac7b-b450-418e-94b9-331e9457ec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:07.559065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0ac7b-b450-418e-94b9-331e9457ec1d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:07.559345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0ac7b-b450-418e-94b9-331e9457ec1d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:07.559615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0ac7b-b450-418e-94b9-331e9457ec1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:07.647916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0ac7b-b450-418e-94b9-331e9457ec1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:07.649423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0ac7b-b450-418e-94b9-331e9457ec1d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:07.836216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 557/1115] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:30:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:30:07.843242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a44cb-d8ba-49a2-bb80-7ffea1c5983f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:07.961378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a44cb-d8ba-49a2-bb80-7ffea1c5983f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:07.973851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:08.003953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af3b6a-24a2-4322-bdbd-152ef2f383c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:08.019459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3b6a-24a2-4322-bdbd-152ef2f383c1 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:08.019459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3b6a-24a2-4322-bdbd-152ef2f383c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:08.019459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af3b6a-24a2-4322-bdbd-152ef2f383c1 None admin] PATH_INFO: `/v3/projects/3b49bb0389054389a36cfc1189da9dea` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:08.019459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af3b6a-24a2-4322-bdbd-152ef2f383c1 None admin] RBAC: Authorizing `identity:get_project(project_id=3b49bb0389054389a36cfc1189da9dea)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:08.019459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af3b6a-24a2-4322-bdbd-152ef2f383c1 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:08.019459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 559/1116] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:30:07 2022] GET /identity/v3/projects/3b49bb0389054389a36cfc1189da9dea => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:08.020948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0ac7b-b450-418e-94b9-331e9457ec1d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:08.033363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:08.132799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0ac7b-b450-418e-94b9-331e9457ec1d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:08.171217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ebf8c-f186-4a90-bb58-eb5474988956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:08.171841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ebf8c-f186-4a90-bb58-eb5474988956 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:08.172123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ebf8c-f186-4a90-bb58-eb5474988956 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:08.172399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ebf8c-f186-4a90-bb58-eb5474988956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:08.173275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ebf8c-f186-4a90-bb58-eb5474988956 None admin] RBAC: Adding query filter params (role.id=971e130ba91d4b7ab75b8e33d322760b, scope.project.id=3b49bb0389054389a36cfc1189da9dea, user.id=98c34045224e41f7bf1a0e359731d761) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:08.173624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ebf8c-f186-4a90-bb58-eb5474988956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:08.175171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ebf8c-f186-4a90-bb58-eb5474988956 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:08.181872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 558/1117] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:30:08 2022] GET /identity/v3/role_assignments?user.id=98c34045224e41f7bf1a0e359731d761&scope.project.id=3b49bb0389054389a36cfc1189da9dea&role.id=971e130ba91d4b7ab75b8e33d322760b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:10.208165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314dcd3-6e64-4117-bfae-91d6a4924742 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:10.208816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314dcd3-6e64-4117-bfae-91d6a4924742 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:10.208970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314dcd3-6e64-4117-bfae-91d6a4924742 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:10.210209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 560/1118] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:10.216755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6260c06-0c2f-436c-9b03-2e6e13cbb8cc None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:10.217479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6260c06-0c2f-436c-9b03-2e6e13cbb8cc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:10.217479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6260c06-0c2f-436c-9b03-2e6e13cbb8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:10.236629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-d6260c06-0c2f-436c-9b03-2e6e13cbb8cc None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:10.237907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d6260c06-0c2f-436c-9b03-2e6e13cbb8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:10.314152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 559/1119] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:30:10.587212 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314dcd3-6e64-4117-bfae-91d6a4924742 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:10.714277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314dcd3-6e64-4117-bfae-91d6a4924742 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:10.754354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b3a9e-72b1-453c-ac77-3256b1fa9a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:10.755146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b3a9e-72b1-453c-ac77-3256b1fa9a28 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:10.755537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b3a9e-72b1-453c-ac77-3256b1fa9a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:10.756192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b3a9e-72b1-453c-ac77-3256b1fa9a28 None admin] PATH_INFO: `/v3/roles/971e130ba91d4b7ab75b8e33d322760b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:10.757942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b3a9e-72b1-453c-ac77-3256b1fa9a28 None admin] RBAC: Authorizing `identity:get_role(role_id=971e130ba91d4b7ab75b8e33d322760b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:10.759415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b3a9e-72b1-453c-ac77-3256b1fa9a28 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:10.765252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 561/1120] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:10 2022] GET /identity/v3/roles/971e130ba91d4b7ab75b8e33d322760b => generated 223 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:10.771778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6260c06-0c2f-436c-9b03-2e6e13cbb8cc None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:10.780879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:10.893999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6260c06-0c2f-436c-9b03-2e6e13cbb8cc None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:10.937611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d9d68-a1cc-4626-9316-bc5770086b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:10.938266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9d68-a1cc-4626-9316-bc5770086b8e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:10.938545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9d68-a1cc-4626-9316-bc5770086b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:10.938817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9d68-a1cc-4626-9316-bc5770086b8e None admin] PATH_INFO: `/v3/users/98c34045224e41f7bf1a0e359731d761` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:10.940104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d9d68-a1cc-4626-9316-bc5770086b8e None admin] RBAC: Authorizing `identity:get_user(user_id=98c34045224e41f7bf1a0e359731d761)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:10.942409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d9d68-a1cc-4626-9316-bc5770086b8e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:10.944157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 560/1121] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:10 2022] GET /identity/v3/users/98c34045224e41f7bf1a0e359731d761 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:10.950406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b3a9e-72b1-453c-ac77-3256b1fa9a28 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:11.009451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:11.070851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b3a9e-72b1-453c-ac77-3256b1fa9a28 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:11.110070 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec582b0f-f344-4412-912a-8cd458813c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:11.110718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec582b0f-f344-4412-912a-8cd458813c17 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:11.110996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec582b0f-f344-4412-912a-8cd458813c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:11.111268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec582b0f-f344-4412-912a-8cd458813c17 None admin] PATH_INFO: `/v3/projects/3b49bb0389054389a36cfc1189da9dea` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:11.112441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec582b0f-f344-4412-912a-8cd458813c17 None admin] RBAC: Authorizing `identity:get_project(project_id=3b49bb0389054389a36cfc1189da9dea)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:11.113974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec582b0f-f344-4412-912a-8cd458813c17 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:11.115685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 562/1122] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:30:10 2022] GET /identity/v3/projects/3b49bb0389054389a36cfc1189da9dea => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:11.122079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d9d68-a1cc-4626-9316-bc5770086b8e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:11.208985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:11.237068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d9d68-a1cc-4626-9316-bc5770086b8e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:11.275470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca616e-a215-4513-89c7-d93736121749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:11.276133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca616e-a215-4513-89c7-d93736121749 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:11.277072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca616e-a215-4513-89c7-d93736121749 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:11.277343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca616e-a215-4513-89c7-d93736121749 None admin] PATH_INFO: `/v3/projects/3b49bb0389054389a36cfc1189da9dea/users/98c34045224e41f7bf1a0e359731d761/roles/971e130ba91d4b7ab75b8e33d322760b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:11.279667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca616e-a215-4513-89c7-d93736121749 None admin] RBAC: Authorizing `identity:create_grant(project_id=3b49bb0389054389a36cfc1189da9dea, user_id=98c34045224e41f7bf1a0e359731d761, role_id=971e130ba91d4b7ab75b8e33d322760b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:11.281267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca616e-a215-4513-89c7-d93736121749 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:11.428745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 561/1123] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:30:11 2022] PUT /identity/v3/projects/3b49bb0389054389a36cfc1189da9dea/users/98c34045224e41f7bf1a0e359731d761/roles/971e130ba91d4b7ab75b8e33d322760b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:30:13.516015 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f5616-b380-4d3e-9334-0822343ab4c8 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:13.516690 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f5616-b380-4d3e-9334-0822343ab4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:13.516690 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f5616-b380-4d3e-9334-0822343ab4c8 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:13.518217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 563/1124] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:30:13.524416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd591766-08ed-430c-b7bc-d38e39f76da8 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:13.525055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd591766-08ed-430c-b7bc-d38e39f76da8 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:13.525055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd591766-08ed-430c-b7bc-d38e39f76da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:13.544770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-cd591766-08ed-430c-b7bc-d38e39f76da8 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:13.546174 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-cd591766-08ed-430c-b7bc-d38e39f76da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:13.627642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 562/1125] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:30:13.909003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f5616-b380-4d3e-9334-0822343ab4c8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:14.030813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f5616-b380-4d3e-9334-0822343ab4c8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:14.046677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:14.071268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc3ad-788e-403a-bf5e-9108a7d55fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:14.073545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc3ad-788e-403a-bf5e-9108a7d55fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:14.073545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc3ad-788e-403a-bf5e-9108a7d55fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:14.073545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc3ad-788e-403a-bf5e-9108a7d55fb9 None admin] PATH_INFO: `/v3/roles/971e130ba91d4b7ab75b8e33d322760b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:14.074207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afc3ad-788e-403a-bf5e-9108a7d55fb9 None admin] RBAC: Authorizing `identity:get_role(role_id=971e130ba91d4b7ab75b8e33d322760b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:14.075612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afc3ad-788e-403a-bf5e-9108a7d55fb9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:14.077075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 564/1126] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:13 2022] GET /identity/v3/roles/971e130ba91d4b7ab75b8e33d322760b => generated 223 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:14.086571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd591766-08ed-430c-b7bc-d38e39f76da8 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:14.191947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:14.235872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd591766-08ed-430c-b7bc-d38e39f76da8 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:14.274139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b27255-76bb-4141-8d2f-22687a84bfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:14.274784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b27255-76bb-4141-8d2f-22687a84bfd3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:14.275063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b27255-76bb-4141-8d2f-22687a84bfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:14.275332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b27255-76bb-4141-8d2f-22687a84bfd3 None admin] PATH_INFO: `/v3/users/98c34045224e41f7bf1a0e359731d761` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:14.277040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b27255-76bb-4141-8d2f-22687a84bfd3 None admin] RBAC: Authorizing `identity:get_user(user_id=98c34045224e41f7bf1a0e359731d761)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:14.278487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b27255-76bb-4141-8d2f-22687a84bfd3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:14.280318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 563/1127] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:14 2022] GET /identity/v3/users/98c34045224e41f7bf1a0e359731d761 => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:14.286432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc3ad-788e-403a-bf5e-9108a7d55fb9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:14.402659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc3ad-788e-403a-bf5e-9108a7d55fb9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:14.442780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010055d5-53b9-435a-9e45-3d7b08e9f95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:14.443431 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010055d5-53b9-435a-9e45-3d7b08e9f95f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:14.443709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010055d5-53b9-435a-9e45-3d7b08e9f95f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:14.443979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010055d5-53b9-435a-9e45-3d7b08e9f95f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:14.503093 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:14.526238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010055d5-53b9-435a-9e45-3d7b08e9f95f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:14.527732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010055d5-53b9-435a-9e45-3d7b08e9f95f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:14.647220 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 565/1128] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:30:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:30:14.654111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b27255-76bb-4141-8d2f-22687a84bfd3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:14.810436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b27255-76bb-4141-8d2f-22687a84bfd3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:14.847179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:14.852863 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13803a0d-d85c-4e8b-9635-fa662a34ebb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:14.853525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803a0d-d85c-4e8b-9635-fa662a34ebb3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:14.853843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803a0d-d85c-4e8b-9635-fa662a34ebb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:14.854125 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13803a0d-d85c-4e8b-9635-fa662a34ebb3 None admin] PATH_INFO: `/v3/projects/3b49bb0389054389a36cfc1189da9dea` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:14.856057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13803a0d-d85c-4e8b-9635-fa662a34ebb3 None admin] RBAC: Authorizing `identity:get_project(project_id=3b49bb0389054389a36cfc1189da9dea)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:14.857569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13803a0d-d85c-4e8b-9635-fa662a34ebb3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:14.863287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 564/1129] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:30:14 2022] GET /identity/v3/projects/3b49bb0389054389a36cfc1189da9dea => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:14.866508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010055d5-53b9-435a-9e45-3d7b08e9f95f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:15.003392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:15.043266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010055d5-53b9-435a-9e45-3d7b08e9f95f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:15.091358 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c507c-9866-42b1-93a2-5ef5486c1bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:15.091943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c507c-9866-42b1-93a2-5ef5486c1bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:15.092278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c507c-9866-42b1-93a2-5ef5486c1bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:15.092647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c507c-9866-42b1-93a2-5ef5486c1bf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:15.093444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c507c-9866-42b1-93a2-5ef5486c1bf4 None admin] RBAC: Adding query filter params (role.id=971e130ba91d4b7ab75b8e33d322760b, scope.project.id=3b49bb0389054389a36cfc1189da9dea, user.id=98c34045224e41f7bf1a0e359731d761) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:15.093818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c507c-9866-42b1-93a2-5ef5486c1bf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:15.095409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c507c-9866-42b1-93a2-5ef5486c1bf4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:15.102600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 566/1130] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:30:14 2022] GET /identity/v3/role_assignments?user.id=98c34045224e41f7bf1a0e359731d761&scope.project.id=3b49bb0389054389a36cfc1189da9dea&role.id=971e130ba91d4b7ab75b8e33d322760b => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:17.187686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb0e5-5eb7-4bc2-b456-2be651172647 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.188636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb0e5-5eb7-4bc2-b456-2be651172647 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.188636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1fb0e5-5eb7-4bc2-b456-2be651172647 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.190391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 565/1131] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:17.196867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c7321-3371-4318-8a9e-04716b384296 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.197702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c7321-3371-4318-8a9e-04716b384296 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.197885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c7321-3371-4318-8a9e-04716b384296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.218359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-780c7321-3371-4318-8a9e-04716b384296 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:17.219649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-780c7321-3371-4318-8a9e-04716b384296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:17.303838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 567/1132] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:30:17.579011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb0e5-5eb7-4bc2-b456-2be651172647 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:17.712294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1fb0e5-5eb7-4bc2-b456-2be651172647 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:17.755430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c5e70-96ce-4d6a-9cca-f2d33e5bce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:17.756342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5e70-96ce-4d6a-9cca-f2d33e5bce97 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.756654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5e70-96ce-4d6a-9cca-f2d33e5bce97 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.756924 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c5e70-96ce-4d6a-9cca-f2d33e5bce97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.758164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c5e70-96ce-4d6a-9cca-f2d33e5bce97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:17.759637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c5e70-96ce-4d6a-9cca-f2d33e5bce97 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:17.761469 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 566/1133] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:30:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:17.768125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c7321-3371-4318-8a9e-04716b384296 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:17.858799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:17.887620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c7321-3371-4318-8a9e-04716b384296 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:17.952127 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832e276-7ab1-41a9-b7ae-e599ed8185a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:17.953217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832e276-7ab1-41a9-b7ae-e599ed8185a9 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:17.953715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832e276-7ab1-41a9-b7ae-e599ed8185a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:17.954208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832e276-7ab1-41a9-b7ae-e599ed8185a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:17.955464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832e276-7ab1-41a9-b7ae-e599ed8185a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:17.958320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0832e276-7ab1-41a9-b7ae-e599ed8185a9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:18.099470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 568/1134] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:30:17 2022] POST /identity/v3/projects => generated 311 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:20.176900 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa9f97-ff59-4ef9-a2fb-ed70b8eec4aa None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:20.177516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa9f97-ff59-4ef9-a2fb-ed70b8eec4aa None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:20.177698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa9f97-ff59-4ef9-a2fb-ed70b8eec4aa None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:20.179724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 567/1135] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:20.186608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2f760-abc5-41b7-a3fc-c16568335a76 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:20.187185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2f760-abc5-41b7-a3fc-c16568335a76 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:20.187185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2f760-abc5-41b7-a3fc-c16568335a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:20.207527 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-46e2f760-abc5-41b7-a3fc-c16568335a76 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:20.208851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-46e2f760-abc5-41b7-a3fc-c16568335a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:20.283870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 569/1136] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:30:20.559980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa9f97-ff59-4ef9-a2fb-ed70b8eec4aa None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:20.642372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:20.681084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa9f97-ff59-4ef9-a2fb-ed70b8eec4aa None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:20.721291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1b618-287d-4a81-a45c-e8a4e7db1c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:20.721930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1b618-287d-4a81-a45c-e8a4e7db1c60 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:20.722206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1b618-287d-4a81-a45c-e8a4e7db1c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:20.722475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1b618-287d-4a81-a45c-e8a4e7db1c60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:20.723662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1b618-287d-4a81-a45c-e8a4e7db1c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:20.725325 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e1b618-287d-4a81-a45c-e8a4e7db1c60 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:20.727000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 568/1137] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:30:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:20.733584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2f760-abc5-41b7-a3fc-c16568335a76 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:20.798784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:20.845225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2f760-abc5-41b7-a3fc-c16568335a76 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:20.881155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd00ca3-45b8-420c-9709-f93cf81534b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:20.881776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd00ca3-45b8-420c-9709-f93cf81534b9 None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:20.882056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd00ca3-45b8-420c-9709-f93cf81534b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:20.882327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd00ca3-45b8-420c-9709-f93cf81534b9 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:20.882999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd00ca3-45b8-420c-9709-f93cf81534b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:20.884441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd00ca3-45b8-420c-9709-f93cf81534b9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:21.035269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 570/1138] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:30:20 2022] POST /identity/v3/users => generated 286 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:30:23.403315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64dadd-dd16-432f-be6b-78b3174af420 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:23.403895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64dadd-dd16-432f-be6b-78b3174af420 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:23.403895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab64dadd-dd16-432f-be6b-78b3174af420 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:23.405493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 569/1139] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:23.411528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28755d-5ded-4ef8-9628-e08a8a64b7c7 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:23.412288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28755d-5ded-4ef8-9628-e08a8a64b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:23.412288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28755d-5ded-4ef8-9628-e08a8a64b7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:23.436063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fd28755d-5ded-4ef8-9628-e08a8a64b7c7 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:23.438467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fd28755d-5ded-4ef8-9628-e08a8a64b7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:23.594134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 571/1140] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:30:23.867538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64dadd-dd16-432f-be6b-78b3174af420 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:23.989032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab64dadd-dd16-432f-be6b-78b3174af420 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:24.033472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7c09d-fac5-4617-a2c9-7c8abfedd745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:24.034595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7c09d-fac5-4617-a2c9-7c8abfedd745 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.035096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7c09d-fac5-4617-a2c9-7c8abfedd745 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.035586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7c09d-fac5-4617-a2c9-7c8abfedd745 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.040960 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:24.057121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7c09d-fac5-4617-a2c9-7c8abfedd745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-45e7c09d-fac5-4617-a2c9-7c8abfedd745 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:30:24.067748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:24.068996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:24.069922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:30:24.070605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 570/1141] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:30:24.076653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28755d-5ded-4ef8-9628-e08a8a64b7c7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:24.125485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:24.190829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28755d-5ded-4ef8-9628-e08a8a64b7c7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:24.232228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2a61a-9aba-4fd9-a63c-d3cb1f09d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:24.232975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2a61a-9aba-4fd9-a63c-d3cb1f09d15a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.233252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2a61a-9aba-4fd9-a63c-d3cb1f09d15a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.233524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2a61a-9aba-4fd9-a63c-d3cb1f09d15a None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.234206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2a61a-9aba-4fd9-a63c-d3cb1f09d15a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:24.234509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2a61a-9aba-4fd9-a63c-d3cb1f09d15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:24.235933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2a61a-9aba-4fd9-a63c-d3cb1f09d15a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:24.245847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 572/1142] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:30:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:24.252078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7c09d-fac5-4617-a2c9-7c8abfedd745 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:24.371768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7c09d-fac5-4617-a2c9-7c8abfedd745 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:24.413736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8565-97e6-41ec-9353-3ac48384fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:24.414420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8565-97e6-41ec-9353-3ac48384fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.414665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8565-97e6-41ec-9353-3ac48384fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.414992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c8565-97e6-41ec-9353-3ac48384fbc2 None admin] PATH_INFO: `/v3/users/2cfc1e70fc3049478f487fdec61a37fd` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.430846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c8565-97e6-41ec-9353-3ac48384fbc2 None admin] RBAC: Authorizing `identity:get_user(user_id=2cfc1e70fc3049478f487fdec61a37fd)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:24.432339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c8565-97e6-41ec-9353-3ac48384fbc2 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:24.434111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 571/1143] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:24 2022] GET /identity/v3/users/2cfc1e70fc3049478f487fdec61a37fd => generated 286 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:24.440559 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2a61a-9aba-4fd9-a63c-d3cb1f09d15a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:24.554847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2a61a-9aba-4fd9-a63c-d3cb1f09d15a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:24.558259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:24.595085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6d396-2d57-407b-96bf-17a6bce16296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:24.596064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6d396-2d57-407b-96bf-17a6bce16296 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.596734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6d396-2d57-407b-96bf-17a6bce16296 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.597235 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6d396-2d57-407b-96bf-17a6bce16296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.683936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6d396-2d57-407b-96bf-17a6bce16296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:24.685347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6d396-2d57-407b-96bf-17a6bce16296 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:24.801924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 573/1144] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:30:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:30:24.808730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8565-97e6-41ec-9353-3ac48384fbc2 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:24.870469 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:24.919777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c8565-97e6-41ec-9353-3ac48384fbc2 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:24.962854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ce777-2ed0-46c2-89a7-785d2df5113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:24.963440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ce777-2ed0-46c2-89a7-785d2df5113f None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:24.963717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ce777-2ed0-46c2-89a7-785d2df5113f None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:24.964084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ce777-2ed0-46c2-89a7-785d2df5113f None admin] PATH_INFO: `/v3/projects/eba5ddb0169e425485f1990201c2eb22` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:24.965407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ce777-2ed0-46c2-89a7-785d2df5113f None admin] RBAC: Authorizing `identity:get_project(project_id=eba5ddb0169e425485f1990201c2eb22)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:24.966877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ce777-2ed0-46c2-89a7-785d2df5113f None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:24.968716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 572/1145] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:30:24 2022] GET /identity/v3/projects/eba5ddb0169e425485f1990201c2eb22 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:24.975547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6d396-2d57-407b-96bf-17a6bce16296 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:24.979661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:25.109617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6d396-2d57-407b-96bf-17a6bce16296 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:25.151564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e28e5-aa31-4eb1-ad80-0df20f21a20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:25.152179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e28e5-aa31-4eb1-ad80-0df20f21a20e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:25.152456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e28e5-aa31-4eb1-ad80-0df20f21a20e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:25.152759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e28e5-aa31-4eb1-ad80-0df20f21a20e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:25.153764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e28e5-aa31-4eb1-ad80-0df20f21a20e None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=eba5ddb0169e425485f1990201c2eb22, user.id=2cfc1e70fc3049478f487fdec61a37fd) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:25.154075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e28e5-aa31-4eb1-ad80-0df20f21a20e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:25.155750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e28e5-aa31-4eb1-ad80-0df20f21a20e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:25.162430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 574/1146] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:30:24 2022] GET /identity/v3/role_assignments?user.id=2cfc1e70fc3049478f487fdec61a37fd&scope.project.id=eba5ddb0169e425485f1990201c2eb22&role.id=c0316e22a13a4034846c451753b4c14e => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:27.295328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8e09-c209-45da-b341-a04a52dc21ea None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:27.295890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8e09-c209-45da-b341-a04a52dc21ea None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:27.295890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8e09-c209-45da-b341-a04a52dc21ea None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:27.297465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 573/1147] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:30:27.303839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab3e58-16c0-49c7-b86b-5675d4fe9729 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:27.304650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab3e58-16c0-49c7-b86b-5675d4fe9729 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:27.304886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab3e58-16c0-49c7-b86b-5675d4fe9729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:27.331699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5dab3e58-16c0-49c7-b86b-5675d4fe9729 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:27.333884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5dab3e58-16c0-49c7-b86b-5675d4fe9729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:27.448870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:27.458422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 575/1148] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:30:27.737833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b8e09-c209-45da-b341-a04a52dc21ea None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:27.874266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b8e09-c209-45da-b341-a04a52dc21ea None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:27.919579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:27.941355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e104f34-deaf-46cd-922b-29897316bf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:27.942419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e104f34-deaf-46cd-922b-29897316bf3a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:27.942913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e104f34-deaf-46cd-922b-29897316bf3a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:27.943411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e104f34-deaf-46cd-922b-29897316bf3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:27.967009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e104f34-deaf-46cd-922b-29897316bf3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-5e104f34-deaf-46cd-922b-29897316bf3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:30:27.977134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:27.979362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:30:27.981041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 574/1149] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:30:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:30:27.986911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab3e58-16c0-49c7-b86b-5675d4fe9729 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:28.175265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab3e58-16c0-49c7-b86b-5675d4fe9729 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:28.239469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958acbe6-6d53-41aa-9761-bb8487b4410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:28.240569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958acbe6-6d53-41aa-9761-bb8487b4410f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.241051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958acbe6-6d53-41aa-9761-bb8487b4410f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.241525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958acbe6-6d53-41aa-9761-bb8487b4410f None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.242766 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958acbe6-6d53-41aa-9761-bb8487b4410f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:28.243314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958acbe6-6d53-41aa-9761-bb8487b4410f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:28.246508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958acbe6-6d53-41aa-9761-bb8487b4410f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:28.262011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 576/1150] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:30:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:28.268207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e104f34-deaf-46cd-922b-29897316bf3a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:28.415115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e104f34-deaf-46cd-922b-29897316bf3a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:28.473160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0de4ad-d4f2-479c-9c72-77a0ffbf4bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:28.474199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0de4ad-d4f2-479c-9c72-77a0ffbf4bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.474692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0de4ad-d4f2-479c-9c72-77a0ffbf4bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.475170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0de4ad-d4f2-479c-9c72-77a0ffbf4bc9 None admin] PATH_INFO: `/v3/users/2cfc1e70fc3049478f487fdec61a37fd` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.477246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0de4ad-d4f2-479c-9c72-77a0ffbf4bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=2cfc1e70fc3049478f487fdec61a37fd)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:28.480711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0de4ad-d4f2-479c-9c72-77a0ffbf4bc9 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:28.483858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 575/1151] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:28 2022] GET /identity/v3/users/2cfc1e70fc3049478f487fdec61a37fd => generated 286 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:28.490929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958acbe6-6d53-41aa-9761-bb8487b4410f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:28.581228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:28.629614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958acbe6-6d53-41aa-9761-bb8487b4410f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:28.669380 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93225cbb-5812-43c7-96b7-12c8680027ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:28.670027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93225cbb-5812-43c7-96b7-12c8680027ce None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.670306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93225cbb-5812-43c7-96b7-12c8680027ce None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.670573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93225cbb-5812-43c7-96b7-12c8680027ce None admin] PATH_INFO: `/v3/projects/eba5ddb0169e425485f1990201c2eb22` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.671878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93225cbb-5812-43c7-96b7-12c8680027ce None admin] RBAC: Authorizing `identity:get_project(project_id=eba5ddb0169e425485f1990201c2eb22)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:28.673386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93225cbb-5812-43c7-96b7-12c8680027ce None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:28.675171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 577/1152] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:30:28 2022] GET /identity/v3/projects/eba5ddb0169e425485f1990201c2eb22 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:28.681684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0de4ad-d4f2-479c-9c72-77a0ffbf4bc9 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:28.738870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:28.795095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0de4ad-d4f2-479c-9c72-77a0ffbf4bc9 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:28.832547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0f57f-95a6-49e0-a0b5-1e029716aceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:28.833101 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0f57f-95a6-49e0-a0b5-1e029716aceb None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:28.833376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0f57f-95a6-49e0-a0b5-1e029716aceb None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:28.833644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0f57f-95a6-49e0-a0b5-1e029716aceb None admin] PATH_INFO: `/v3/projects/eba5ddb0169e425485f1990201c2eb22/users/2cfc1e70fc3049478f487fdec61a37fd/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:28.835652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0f57f-95a6-49e0-a0b5-1e029716aceb None admin] RBAC: Authorizing `identity:create_grant(project_id=eba5ddb0169e425485f1990201c2eb22, user_id=2cfc1e70fc3049478f487fdec61a37fd, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:28.837137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0f57f-95a6-49e0-a0b5-1e029716aceb None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:28.921848 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 576/1153] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:30:28 2022] PUT /identity/v3/projects/eba5ddb0169e425485f1990201c2eb22/users/2cfc1e70fc3049478f487fdec61a37fd/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:30.909191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a42a2f-d44c-4e86-9835-623eaa7d2a8f None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:30.909769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a42a2f-d44c-4e86-9835-623eaa7d2a8f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:30.909769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a42a2f-d44c-4e86-9835-623eaa7d2a8f None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:30.911079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 578/1154] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:30.917072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968405c4-918e-4333-80c2-b72b85c5cad0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:30.917862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968405c4-918e-4333-80c2-b72b85c5cad0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:30.918016 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968405c4-918e-4333-80c2-b72b85c5cad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:30.937344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-968405c4-918e-4333-80c2-b72b85c5cad0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:30.938768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-968405c4-918e-4333-80c2-b72b85c5cad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:31.020177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 577/1155] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:30:31.294099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a42a2f-d44c-4e86-9835-623eaa7d2a8f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:31.427748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a42a2f-d44c-4e86-9835-623eaa7d2a8f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:31.480233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:31.489597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c34a3e-104b-4517-894d-019b1c7e2275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:31.490239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c34a3e-104b-4517-894d-019b1c7e2275 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:31.490515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c34a3e-104b-4517-894d-019b1c7e2275 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:31.490785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c34a3e-104b-4517-894d-019b1c7e2275 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:31.504984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c34a3e-104b-4517-894d-019b1c7e2275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-38c34a3e-104b-4517-894d-019b1c7e2275 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:30:31.511406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:31.514428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:30:31.516346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 579/1156] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:30:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:30:31.521376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968405c4-918e-4333-80c2-b72b85c5cad0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:31.594708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:31.689772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968405c4-918e-4333-80c2-b72b85c5cad0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:31.749538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d54a1-029b-4c5a-b0db-b72fd45d95e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:31.750172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d54a1-029b-4c5a-b0db-b72fd45d95e6 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:31.750453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d54a1-029b-4c5a-b0db-b72fd45d95e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:31.750721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7d54a1-029b-4c5a-b0db-b72fd45d95e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:31.751407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d54a1-029b-4c5a-b0db-b72fd45d95e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:31.751711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d54a1-029b-4c5a-b0db-b72fd45d95e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:31.753182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7d54a1-029b-4c5a-b0db-b72fd45d95e6 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:31.763680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 578/1157] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:30:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:31.771941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c34a3e-104b-4517-894d-019b1c7e2275 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:31.953968 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c34a3e-104b-4517-894d-019b1c7e2275 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:32.002580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638358bc-9045-4706-97de-48a5db78be9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:32.003438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638358bc-9045-4706-97de-48a5db78be9a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:32.003868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638358bc-9045-4706-97de-48a5db78be9a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:32.004325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638358bc-9045-4706-97de-48a5db78be9a None admin] PATH_INFO: `/v3/users/2cfc1e70fc3049478f487fdec61a37fd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:32.006340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638358bc-9045-4706-97de-48a5db78be9a None admin] RBAC: Authorizing `identity:get_user(user_id=2cfc1e70fc3049478f487fdec61a37fd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:32.008151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638358bc-9045-4706-97de-48a5db78be9a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:32.011431 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 580/1158] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:31 2022] GET /identity/v3/users/2cfc1e70fc3049478f487fdec61a37fd => generated 286 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:32.020120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d54a1-029b-4c5a-b0db-b72fd45d95e6 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:32.178856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7d54a1-029b-4c5a-b0db-b72fd45d95e6 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:32.181844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:32.237476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d581bf5-e6b0-4913-94f2-10078f63f205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:32.238456 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d581bf5-e6b0-4913-94f2-10078f63f205 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:32.238807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d581bf5-e6b0-4913-94f2-10078f63f205 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:32.238990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d581bf5-e6b0-4913-94f2-10078f63f205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:32.332175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d581bf5-e6b0-4913-94f2-10078f63f205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:32.333815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d581bf5-e6b0-4913-94f2-10078f63f205 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:32.475101 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 579/1159] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:30:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:30:32.482935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638358bc-9045-4706-97de-48a5db78be9a None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:32.597247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:32.659487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638358bc-9045-4706-97de-48a5db78be9a None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:32.698473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e224482-7ea1-4d83-96eb-6a31154d8ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:32.699119 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224482-7ea1-4d83-96eb-6a31154d8ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:32.699389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224482-7ea1-4d83-96eb-6a31154d8ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:32.699669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e224482-7ea1-4d83-96eb-6a31154d8ba5 None admin] PATH_INFO: `/v3/projects/eba5ddb0169e425485f1990201c2eb22` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:32.700900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224482-7ea1-4d83-96eb-6a31154d8ba5 None admin] RBAC: Authorizing `identity:get_project(project_id=eba5ddb0169e425485f1990201c2eb22)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:32.702933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e224482-7ea1-4d83-96eb-6a31154d8ba5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:32.704802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 581/1160] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:30:32 2022] GET /identity/v3/projects/eba5ddb0169e425485f1990201c2eb22 => generated 311 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:32.711370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d581bf5-e6b0-4913-94f2-10078f63f205 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:32.713815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:32.857868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d581bf5-e6b0-4913-94f2-10078f63f205 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:32.917851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ce7b2-fdb1-4de4-90ca-2576cc467257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:32.918852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ce7b2-fdb1-4de4-90ca-2576cc467257 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:32.919367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ce7b2-fdb1-4de4-90ca-2576cc467257 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:32.920033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ce7b2-fdb1-4de4-90ca-2576cc467257 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:32.921176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ce7b2-fdb1-4de4-90ca-2576cc467257 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=eba5ddb0169e425485f1990201c2eb22, user.id=2cfc1e70fc3049478f487fdec61a37fd) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:32.921606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ce7b2-fdb1-4de4-90ca-2576cc467257 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:32.923295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ce7b2-fdb1-4de4-90ca-2576cc467257 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:32.934727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 580/1161] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:30:32 2022] GET /identity/v3/role_assignments?user.id=2cfc1e70fc3049478f487fdec61a37fd&scope.project.id=eba5ddb0169e425485f1990201c2eb22&role.id=c0316e22a13a4034846c451753b4c14e => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:35.035874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a372cb4-1b13-41e1-b1f3-8b51743557f9 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:35.036445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a372cb4-1b13-41e1-b1f3-8b51743557f9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:35.036445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a372cb4-1b13-41e1-b1f3-8b51743557f9 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:35.037827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 582/1162] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:35.047103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c021cb-e306-4afc-8437-f03e5f69c737 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:35.047680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c021cb-e306-4afc-8437-f03e5f69c737 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:35.048034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c021cb-e306-4afc-8437-f03e5f69c737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:35.079076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-36c021cb-e306-4afc-8437-f03e5f69c737 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:35.081193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-36c021cb-e306-4afc-8437-f03e5f69c737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:35.187363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:35.200513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 581/1163] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:30:35.480061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a372cb4-1b13-41e1-b1f3-8b51743557f9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:35.670370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a372cb4-1b13-41e1-b1f3-8b51743557f9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:35.716286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:35.737251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac187fc-619f-4ebb-a4e3-7ff216e4fb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:35.737251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac187fc-619f-4ebb-a4e3-7ff216e4fb34 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:35.737251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac187fc-619f-4ebb-a4e3-7ff216e4fb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:35.737251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac187fc-619f-4ebb-a4e3-7ff216e4fb34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:35.853039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac187fc-619f-4ebb-a4e3-7ff216e4fb34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:35.856071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac187fc-619f-4ebb-a4e3-7ff216e4fb34 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:36.026368 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 583/1164] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:30:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:30:36.033255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c021cb-e306-4afc-8437-f03e5f69c737 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:36.149196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c021cb-e306-4afc-8437-f03e5f69c737 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:36.190549 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706549ea-bfdd-44cb-a201-799ca03ff9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:36.191324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706549ea-bfdd-44cb-a201-799ca03ff9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:36.191658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706549ea-bfdd-44cb-a201-799ca03ff9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:36.192001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706549ea-bfdd-44cb-a201-799ca03ff9e1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:36.200675 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706549ea-bfdd-44cb-a201-799ca03ff9e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:36.202218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706549ea-bfdd-44cb-a201-799ca03ff9e1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-706549ea-bfdd-44cb-a201-799ca03ff9e1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:36.217241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:36.219272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:30:36.221352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 582/1165] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 21:30:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:30:36.225726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac187fc-619f-4ebb-a4e3-7ff216e4fb34 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:36.271017 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:36.410283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac187fc-619f-4ebb-a4e3-7ff216e4fb34 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:36.476207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190dee1-fcf4-4165-a9de-fe77e97d4f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:36.477302 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190dee1-fcf4-4165-a9de-fe77e97d4f28 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:36.477786 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190dee1-fcf4-4165-a9de-fe77e97d4f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:36.478267 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190dee1-fcf4-4165-a9de-fe77e97d4f28 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:36.479556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190dee1-fcf4-4165-a9de-fe77e97d4f28 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:36.480100 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190dee1-fcf4-4165-a9de-fe77e97d4f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:36.482792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190dee1-fcf4-4165-a9de-fe77e97d4f28 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:36.492878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 584/1166] 10.222.0.83 () {56 vars in 1115 bytes} [Mon Aug 29 21:30:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:38.656160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d14e-9f93-46d3-bbc3-30c55611f1f1 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:38.656777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d14e-9f93-46d3-bbc3-30c55611f1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:38.656777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6d14e-9f93-46d3-bbc3-30c55611f1f1 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:38.658641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 583/1167] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:38.665868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c99a84-b7fc-4b8e-a205-54b2b4ddca24 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:38.666645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c99a84-b7fc-4b8e-a205-54b2b4ddca24 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:38.666645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c99a84-b7fc-4b8e-a205-54b2b4ddca24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:38.687525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a0c99a84-b7fc-4b8e-a205-54b2b4ddca24 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:38.688857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a0c99a84-b7fc-4b8e-a205-54b2b4ddca24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:38.774220 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 585/1168] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:30:39.056446 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6d14e-9f93-46d3-bbc3-30c55611f1f1 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:39.154797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:39.236042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6d14e-9f93-46d3-bbc3-30c55611f1f1 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:39.284120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2728215-de00-401a-8272-8eb8e1e4ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:39.284725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2728215-de00-401a-8272-8eb8e1e4ec32 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:39.285050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2728215-de00-401a-8272-8eb8e1e4ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:39.285374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2728215-de00-401a-8272-8eb8e1e4ec32 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:39.286120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2728215-de00-401a-8272-8eb8e1e4ec32 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:39.287561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2728215-de00-401a-8272-8eb8e1e4ec32 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:39.397396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 584/1169] 10.222.0.83 () {60 vars in 1138 bytes} [Mon Aug 29 21:30:39 2022] POST /identity/v3/domains => generated 267 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:41.543884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8160f-cb7d-4f25-bd7a-ee2ed252d967 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:41.544546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8160f-cb7d-4f25-bd7a-ee2ed252d967 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:41.544906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8160f-cb7d-4f25-bd7a-ee2ed252d967 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:41.547144 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 586/1170] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:41.553398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04adb1-027d-4106-82da-9545f9dcf0a6 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:41.554248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04adb1-027d-4106-82da-9545f9dcf0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:41.554248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04adb1-027d-4106-82da-9545f9dcf0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:41.575672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0c04adb1-027d-4106-82da-9545f9dcf0a6 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:41.577296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0c04adb1-027d-4106-82da-9545f9dcf0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:41.674586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 585/1171] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:30:41.979413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8160f-cb7d-4f25-bd7a-ee2ed252d967 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:42.011407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:42.140059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8160f-cb7d-4f25-bd7a-ee2ed252d967 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:42.184186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07afff9-1fc8-48e7-8807-d32d1f03e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:42.185017 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07afff9-1fc8-48e7-8807-d32d1f03e49e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:42.185400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07afff9-1fc8-48e7-8807-d32d1f03e49e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:42.185776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07afff9-1fc8-48e7-8807-d32d1f03e49e None admin] PATH_INFO: `/v3/domains/5c568a20d07f4cfc891f6ff6afe39de1` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:42.202753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07afff9-1fc8-48e7-8807-d32d1f03e49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=5c568a20d07f4cfc891f6ff6afe39de1)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:42.204266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07afff9-1fc8-48e7-8807-d32d1f03e49e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:42.206041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 587/1172] 10.222.0.83 () {56 vars in 1183 bytes} [Mon Aug 29 21:30:41 2022] GET /identity/v3/domains/5c568a20d07f4cfc891f6ff6afe39de1 => generated 267 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:42.212424 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04adb1-027d-4106-82da-9545f9dcf0a6 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:42.269381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:42.334124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04adb1-027d-4106-82da-9545f9dcf0a6 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:42.384276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ed67d-3501-4fcf-bdcd-fb04fb209a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:42.385557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed67d-3501-4fcf-bdcd-fb04fb209a5d None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:42.385896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed67d-3501-4fcf-bdcd-fb04fb209a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:42.386176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ed67d-3501-4fcf-bdcd-fb04fb209a5d None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:42.386859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed67d-3501-4fcf-bdcd-fb04fb209a5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:42.388305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ed67d-3501-4fcf-bdcd-fb04fb209a5d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:42.500323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 586/1173] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:30:42 2022] POST /identity/v3/projects => generated 361 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:44.606323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55f44-0bf1-485c-aa47-d477373a51e9 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:44.606959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55f44-0bf1-485c-aa47-d477373a51e9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:44.607097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a55f44-0bf1-485c-aa47-d477373a51e9 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:44.609005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 588/1174] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:30:44.615070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14f1e-89a8-408d-b338-9ff703f1cd6d None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:44.615895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14f1e-89a8-408d-b338-9ff703f1cd6d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:44.616061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e14f1e-89a8-408d-b338-9ff703f1cd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:44.637285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-14e14f1e-89a8-408d-b338-9ff703f1cd6d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:44.638550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-14e14f1e-89a8-408d-b338-9ff703f1cd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:44.720188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 587/1175] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:30:44.995271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55f44-0bf1-485c-aa47-d477373a51e9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:45.129214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:45.156275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a55f44-0bf1-485c-aa47-d477373a51e9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:45.210617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714755b-fe0b-45b8-a375-fda3eee7a571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:45.211291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714755b-fe0b-45b8-a375-fda3eee7a571 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:45.211573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714755b-fe0b-45b8-a375-fda3eee7a571 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:45.211850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714755b-fe0b-45b8-a375-fda3eee7a571 None admin] PATH_INFO: `/v3/domains/5c568a20d07f4cfc891f6ff6afe39de1` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:45.213181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714755b-fe0b-45b8-a375-fda3eee7a571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5c568a20d07f4cfc891f6ff6afe39de1)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:45.214660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714755b-fe0b-45b8-a375-fda3eee7a571 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:45.216393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 589/1176] 10.222.0.83 () {56 vars in 1183 bytes} [Mon Aug 29 21:30:44 2022] GET /identity/v3/domains/5c568a20d07f4cfc891f6ff6afe39de1 => generated 267 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:45.223718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e14f1e-89a8-408d-b338-9ff703f1cd6d None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:45.274788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:45.376142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e14f1e-89a8-408d-b338-9ff703f1cd6d None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:45.417187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a89ed-9839-41bf-9d90-b9ab54d498d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:45.428710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a89ed-9839-41bf-9d90-b9ab54d498d7 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:45.428710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a89ed-9839-41bf-9d90-b9ab54d498d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:45.428710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a89ed-9839-41bf-9d90-b9ab54d498d7 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:45.428710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a89ed-9839-41bf-9d90-b9ab54d498d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:45.428710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a89ed-9839-41bf-9d90-b9ab54d498d7 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:45.690809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 588/1177] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:30:45 2022] POST /identity/v3/users => generated 311 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:30:47.878139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e5359-1143-4a2b-a5ec-da9fe214e8e4 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:47.878890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e5359-1143-4a2b-a5ec-da9fe214e8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:47.879106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e5359-1143-4a2b-a5ec-da9fe214e8e4 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:47.881926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 590/1178] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:30:47.888056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b252aa5-3cfa-4844-a97d-d3bcb55c2c90 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:47.888899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b252aa5-3cfa-4844-a97d-d3bcb55c2c90 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:47.888899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b252aa5-3cfa-4844-a97d-d3bcb55c2c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:47.910510 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-3b252aa5-3cfa-4844-a97d-d3bcb55c2c90 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:47.911745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3b252aa5-3cfa-4844-a97d-d3bcb55c2c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:48.014883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 589/1179] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:30:48.366611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e5359-1143-4a2b-a5ec-da9fe214e8e4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:48.592354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e5359-1143-4a2b-a5ec-da9fe214e8e4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:48.641982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b24ba-7ce4-4eeb-8049-4e4e0cb80f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:48.643034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b24ba-7ce4-4eeb-8049-4e4e0cb80f4d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:48.643535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b24ba-7ce4-4eeb-8049-4e4e0cb80f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:48.644023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b24ba-7ce4-4eeb-8049-4e4e0cb80f4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:48.662518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b24ba-7ce4-4eeb-8049-4e4e0cb80f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-7e5b24ba-7ce4-4eeb-8049-4e4e0cb80f4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:30:48.672613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:48.674269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:30:48.675453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 591/1180] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:30:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:30:48.682577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b252aa5-3cfa-4844-a97d-d3bcb55c2c90 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:48.704210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:48.831183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b252aa5-3cfa-4844-a97d-d3bcb55c2c90 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:48.890611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d8b2c-def4-4ca9-ab66-d94e408edfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:48.906572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d8b2c-def4-4ca9-ab66-d94e408edfeb None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:48.906572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d8b2c-def4-4ca9-ab66-d94e408edfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:48.906572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d8b2c-def4-4ca9-ab66-d94e408edfeb None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:48.906572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d8b2c-def4-4ca9-ab66-d94e408edfeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:48.906572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d8b2c-def4-4ca9-ab66-d94e408edfeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:48.906572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d8b2c-def4-4ca9-ab66-d94e408edfeb None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:48.907069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 590/1181] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:30:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:48.911392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b24ba-7ce4-4eeb-8049-4e4e0cb80f4d None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:48.923469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:49.071757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b24ba-7ce4-4eeb-8049-4e4e0cb80f4d None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:49.124963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6f9e7-5059-4ffa-b2d8-7a7339ccb977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:49.126099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f9e7-5059-4ffa-b2d8-7a7339ccb977 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:49.126556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f9e7-5059-4ffa-b2d8-7a7339ccb977 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:49.127007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6f9e7-5059-4ffa-b2d8-7a7339ccb977 None admin] PATH_INFO: `/v3/users/41fac7c0d0ea4b5da4f6ba62dc491b29` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:49.146591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6f9e7-5059-4ffa-b2d8-7a7339ccb977 None admin] RBAC: Authorizing `identity:get_user(user_id=41fac7c0d0ea4b5da4f6ba62dc491b29)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:49.148998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6f9e7-5059-4ffa-b2d8-7a7339ccb977 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:49.151576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 592/1182] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:48 2022] GET /identity/v3/users/41fac7c0d0ea4b5da4f6ba62dc491b29 => generated 311 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:49.159117 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d8b2c-def4-4ca9-ab66-d94e408edfeb None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:49.285571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:49.329929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d8b2c-def4-4ca9-ab66-d94e408edfeb None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:49.386036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dd427-33a7-4580-b1d6-8b288990b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:49.386821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd427-33a7-4580-b1d6-8b288990b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:49.387356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd427-33a7-4580-b1d6-8b288990b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:49.387727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51dd427-33a7-4580-b1d6-8b288990b8d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:49.489893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dd427-33a7-4580-b1d6-8b288990b8d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:49.491273 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51dd427-33a7-4580-b1d6-8b288990b8d4 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:49.595895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:49.630540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 591/1183] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:30:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:30:49.639939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6f9e7-5059-4ffa-b2d8-7a7339ccb977 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:49.724455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:49.778569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6f9e7-5059-4ffa-b2d8-7a7339ccb977 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:49.846860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4eb6c-eb8e-4dea-a351-fbe50a8c1d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:49.848124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4eb6c-eb8e-4dea-a351-fbe50a8c1d6d None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:49.848661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4eb6c-eb8e-4dea-a351-fbe50a8c1d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:49.849154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4eb6c-eb8e-4dea-a351-fbe50a8c1d6d None admin] PATH_INFO: `/v3/projects/8c6d863a462d4405aa7e80efaa895946` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:49.851502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4eb6c-eb8e-4dea-a351-fbe50a8c1d6d None admin] RBAC: Authorizing `identity:get_project(project_id=8c6d863a462d4405aa7e80efaa895946)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:49.854482 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4eb6c-eb8e-4dea-a351-fbe50a8c1d6d None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:49.858492 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 593/1184] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:30:49 2022] GET /identity/v3/projects/8c6d863a462d4405aa7e80efaa895946 => generated 361 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:49.866172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dd427-33a7-4580-b1d6-8b288990b8d4 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:50.023000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51dd427-33a7-4580-b1d6-8b288990b8d4 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:50.066924 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb9270-d086-47d7-9641-6c4f8261166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:50.067620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb9270-d086-47d7-9641-6c4f8261166b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:50.067986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb9270-d086-47d7-9641-6c4f8261166b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:50.068347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb9270-d086-47d7-9641-6c4f8261166b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:50.069458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb9270-d086-47d7-9641-6c4f8261166b None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=8c6d863a462d4405aa7e80efaa895946, user.id=41fac7c0d0ea4b5da4f6ba62dc491b29) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:50.069969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb9270-d086-47d7-9641-6c4f8261166b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:50.071533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb9270-d086-47d7-9641-6c4f8261166b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:50.079816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 592/1185] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:30:49 2022] GET /identity/v3/role_assignments?user.id=41fac7c0d0ea4b5da4f6ba62dc491b29&scope.project.id=8c6d863a462d4405aa7e80efaa895946&role.id=c0316e22a13a4034846c451753b4c14e => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:52.866836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad5fd8-fce8-4468-baed-994cfa4e21a5 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:52.867451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad5fd8-fce8-4468-baed-994cfa4e21a5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:52.867589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad5fd8-fce8-4468-baed-994cfa4e21a5 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:52.869703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 594/1186] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:30:52.875768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c0f7b-59d7-4070-b756-035f332b8dc7 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:52.876340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c0f7b-59d7-4070-b756-035f332b8dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:52.876340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c0f7b-59d7-4070-b756-035f332b8dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:52.900134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-433c0f7b-59d7-4070-b756-035f332b8dc7 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:52.902186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-433c0f7b-59d7-4070-b756-035f332b8dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:52.957451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:53.005015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 593/1187] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:30:53.298560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad5fd8-fce8-4468-baed-994cfa4e21a5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:53.453162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad5fd8-fce8-4468-baed-994cfa4e21a5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:53.515600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:53.524055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d3c4f-a600-41e2-8b5c-11854f1d3df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:53.525967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d3c4f-a600-41e2-8b5c-11854f1d3df8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:53.526479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d3c4f-a600-41e2-8b5c-11854f1d3df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:53.526983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d3c4f-a600-41e2-8b5c-11854f1d3df8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:53.547547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d3c4f-a600-41e2-8b5c-11854f1d3df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-6d5d3c4f-a600-41e2-8b5c-11854f1d3df8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:30:53.557863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:53.559702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:30:53.561474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 595/1188] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:30:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:30:53.568954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c0f7b-59d7-4070-b756-035f332b8dc7 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:53.738357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c0f7b-59d7-4070-b756-035f332b8dc7 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:53.806704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3eb39a-31cf-44fe-afac-780ba741d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:53.807686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eb39a-31cf-44fe-afac-780ba741d6bb None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:53.808200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eb39a-31cf-44fe-afac-780ba741d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:53.808582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eb39a-31cf-44fe-afac-780ba741d6bb None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:53.809649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3eb39a-31cf-44fe-afac-780ba741d6bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:53.810086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3eb39a-31cf-44fe-afac-780ba741d6bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:53.812642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3eb39a-31cf-44fe-afac-780ba741d6bb None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:53.828822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 594/1189] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:30:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:53.839205 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d3c4f-a600-41e2-8b5c-11854f1d3df8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:53.969268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d3c4f-a600-41e2-8b5c-11854f1d3df8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:54.022264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7ff0-cd1a-448d-ac41-d735f2d37d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:54.023016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7ff0-cd1a-448d-ac41-d735f2d37d89 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:54.023397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7ff0-cd1a-448d-ac41-d735f2d37d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:54.023773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a7ff0-cd1a-448d-ac41-d735f2d37d89 None admin] PATH_INFO: `/v3/users/41fac7c0d0ea4b5da4f6ba62dc491b29` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:54.026064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a7ff0-cd1a-448d-ac41-d735f2d37d89 None admin] RBAC: Authorizing `identity:get_user(user_id=41fac7c0d0ea4b5da4f6ba62dc491b29)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:54.027637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a7ff0-cd1a-448d-ac41-d735f2d37d89 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:54.030224 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 596/1190] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:53 2022] GET /identity/v3/users/41fac7c0d0ea4b5da4f6ba62dc491b29 => generated 311 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:54.038022 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3eb39a-31cf-44fe-afac-780ba741d6bb None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:54.085088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:54.187103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3eb39a-31cf-44fe-afac-780ba741d6bb None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:54.237399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120f99ed-13aa-4e07-b7e9-c1a6b93cf9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:54.238351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f99ed-13aa-4e07-b7e9-c1a6b93cf9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:54.238818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f99ed-13aa-4e07-b7e9-c1a6b93cf9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:54.239281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120f99ed-13aa-4e07-b7e9-c1a6b93cf9e1 None admin] PATH_INFO: `/v3/projects/8c6d863a462d4405aa7e80efaa895946` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:54.241339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f99ed-13aa-4e07-b7e9-c1a6b93cf9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=8c6d863a462d4405aa7e80efaa895946)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:54.243884 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120f99ed-13aa-4e07-b7e9-c1a6b93cf9e1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:54.246186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 595/1191] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:30:54 2022] GET /identity/v3/projects/8c6d863a462d4405aa7e80efaa895946 => generated 361 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:30:54.253404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7ff0-cd1a-448d-ac41-d735f2d37d89 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:54.331904 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:54.383406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a7ff0-cd1a-448d-ac41-d735f2d37d89 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:54.426543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6602c2d-89cd-4045-8758-c2067054ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:54.427245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6602c2d-89cd-4045-8758-c2067054ca9e None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:54.427517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6602c2d-89cd-4045-8758-c2067054ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:54.427783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6602c2d-89cd-4045-8758-c2067054ca9e None admin] PATH_INFO: `/v3/projects/8c6d863a462d4405aa7e80efaa895946/users/41fac7c0d0ea4b5da4f6ba62dc491b29/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:54.430047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6602c2d-89cd-4045-8758-c2067054ca9e None admin] RBAC: Authorizing `identity:create_grant(project_id=8c6d863a462d4405aa7e80efaa895946, user_id=41fac7c0d0ea4b5da4f6ba62dc491b29, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:54.431660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6602c2d-89cd-4045-8758-c2067054ca9e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:54.517962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 597/1192] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:30:54 2022] PUT /identity/v3/projects/8c6d863a462d4405aa7e80efaa895946/users/41fac7c0d0ea4b5da4f6ba62dc491b29/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:30:56.596425 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13012057-f8f6-4193-8f83-337b43888b02 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:56.597141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13012057-f8f6-4193-8f83-337b43888b02 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:56.597141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13012057-f8f6-4193-8f83-337b43888b02 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:56.598411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 596/1193] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:30:56.605341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fd5da-505d-49b5-bb0e-fcc8f1d3a174 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:56.606098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fd5da-505d-49b5-bb0e-fcc8f1d3a174 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:56.606356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5fd5da-505d-49b5-bb0e-fcc8f1d3a174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:56.637213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3b5fd5da-505d-49b5-bb0e-fcc8f1d3a174 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:30:56.639159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3b5fd5da-505d-49b5-bb0e-fcc8f1d3a174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:30:56.752424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 598/1194] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:30:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:30:57.083050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13012057-f8f6-4193-8f83-337b43888b02 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:57.222172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:57.226688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13012057-f8f6-4193-8f83-337b43888b02 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:57.268583 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68a699-b80b-40a0-b7fb-893cffcc5cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:57.269157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68a699-b80b-40a0-b7fb-893cffcc5cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:57.269428 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68a699-b80b-40a0-b7fb-893cffcc5cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:57.269694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68a699-b80b-40a0-b7fb-893cffcc5cb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:57.282562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68a699-b80b-40a0-b7fb-893cffcc5cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-0f68a699-b80b-40a0-b7fb-893cffcc5cb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:30:57.287696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:30:57.289441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:30:57.290307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 597/1195] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:30:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:30:57.296379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fd5da-505d-49b5-bb0e-fcc8f1d3a174 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:57.356363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:57.414756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5fd5da-505d-49b5-bb0e-fcc8f1d3a174 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:57.454278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd968d3-5c61-410a-9ce5-b25fbee8dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:57.455048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd968d3-5c61-410a-9ce5-b25fbee8dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:57.455425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd968d3-5c61-410a-9ce5-b25fbee8dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:57.455738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd968d3-5c61-410a-9ce5-b25fbee8dbf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:57.456437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd968d3-5c61-410a-9ce5-b25fbee8dbf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:57.456948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd968d3-5c61-410a-9ce5-b25fbee8dbf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:57.458521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd968d3-5c61-410a-9ce5-b25fbee8dbf0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:57.468568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 599/1196] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:30:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:57.479034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68a699-b80b-40a0-b7fb-893cffcc5cb6 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:57.664901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68a699-b80b-40a0-b7fb-893cffcc5cb6 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:57.726357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd13520-8692-4ca0-b289-55b87d068dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:57.727436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd13520-8692-4ca0-b289-55b87d068dac None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:57.727924 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd13520-8692-4ca0-b289-55b87d068dac None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:57.728925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd13520-8692-4ca0-b289-55b87d068dac None admin] PATH_INFO: `/v3/users/41fac7c0d0ea4b5da4f6ba62dc491b29` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:57.731109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd13520-8692-4ca0-b289-55b87d068dac None admin] RBAC: Authorizing `identity:get_user(user_id=41fac7c0d0ea4b5da4f6ba62dc491b29)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:57.733470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd13520-8692-4ca0-b289-55b87d068dac None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:57.736042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 598/1197] 10.222.0.83 () {56 vars in 1177 bytes} [Mon Aug 29 21:30:57 2022] GET /identity/v3/users/41fac7c0d0ea4b5da4f6ba62dc491b29 => generated 311 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:57.742992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd968d3-5c61-410a-9ce5-b25fbee8dbf0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:57.911119 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd968d3-5c61-410a-9ce5-b25fbee8dbf0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:57.928164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:57.970394 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283610-fff4-4346-bbfd-ed83180990f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:57.971439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283610-fff4-4346-bbfd-ed83180990f8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:57.971901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283610-fff4-4346-bbfd-ed83180990f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:57.972372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283610-fff4-4346-bbfd-ed83180990f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:58.079098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a283610-fff4-4346-bbfd-ed83180990f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:58.081442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a283610-fff4-4346-bbfd-ed83180990f8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:58.203949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 600/1198] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:30:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:30:58.214426 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd13520-8692-4ca0-b289-55b87d068dac None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:58.248766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:58.333560 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd13520-8692-4ca0-b289-55b87d068dac None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:58.374654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25098ab-b159-4648-a152-94649ba00997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:58.375301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25098ab-b159-4648-a152-94649ba00997 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:58.375578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25098ab-b159-4648-a152-94649ba00997 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:58.375928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25098ab-b159-4648-a152-94649ba00997 None admin] PATH_INFO: `/v3/projects/8c6d863a462d4405aa7e80efaa895946` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:58.377317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25098ab-b159-4648-a152-94649ba00997 None admin] RBAC: Authorizing `identity:get_project(project_id=8c6d863a462d4405aa7e80efaa895946)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:58.378783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25098ab-b159-4648-a152-94649ba00997 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:58.380641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 599/1199] 10.222.0.83 () {56 vars in 1186 bytes} [Mon Aug 29 21:30:58 2022] GET /identity/v3/projects/8c6d863a462d4405aa7e80efaa895946 => generated 361 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:30:58.390746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283610-fff4-4346-bbfd-ed83180990f8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:30:58.407022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:30:58.554662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283610-fff4-4346-bbfd-ed83180990f8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:30:58.615915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46c2af-9834-46ca-b421-d2086c3cc36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:30:58.617048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c2af-9834-46ca-b421-d2086c3cc36b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:30:58.617762 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c2af-9834-46ca-b421-d2086c3cc36b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:30:58.618245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c2af-9834-46ca-b421-d2086c3cc36b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:30:58.619567 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46c2af-9834-46ca-b421-d2086c3cc36b None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=8c6d863a462d4405aa7e80efaa895946, user.id=41fac7c0d0ea4b5da4f6ba62dc491b29) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:30:58.620052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46c2af-9834-46ca-b421-d2086c3cc36b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:30:58.622805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46c2af-9834-46ca-b421-d2086c3cc36b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:30:58.632578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 601/1200] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:30:58 2022] GET /identity/v3/role_assignments?user.id=41fac7c0d0ea4b5da4f6ba62dc491b29&scope.project.id=8c6d863a462d4405aa7e80efaa895946&role.id=c0316e22a13a4034846c451753b4c14e => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:31:08.369966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=52 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:31:08.628621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=62 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:22.826131 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c7a6-b11b-4013-a966-fbba79b2e5b1 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:22.827055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c7a6-b11b-4013-a966-fbba79b2e5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:22.827055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45c7a6-b11b-4013-a966-fbba79b2e5b1 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:22.828733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 600/1201] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:22.835190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401242b-4cf8-4013-8054-84ea5b2ca532 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:22.838271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401242b-4cf8-4013-8054-84ea5b2ca532 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:22.838271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f401242b-4cf8-4013-8054-84ea5b2ca532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:22.856208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f401242b-4cf8-4013-8054-84ea5b2ca532 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:22.857521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f401242b-4cf8-4013-8054-84ea5b2ca532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:22.944097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 602/1202] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:32:23.225574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c7a6-b11b-4013-a966-fbba79b2e5b1 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:23.348957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45c7a6-b11b-4013-a966-fbba79b2e5b1 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:23.387735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d26b0a-936c-4f3f-9032-0d3f3178042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:23.388370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26b0a-936c-4f3f-9032-0d3f3178042a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:23.388688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26b0a-936c-4f3f-9032-0d3f3178042a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:23.388959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26b0a-936c-4f3f-9032-0d3f3178042a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:23.402544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d26b0a-936c-4f3f-9032-0d3f3178042a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:23.404400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d26b0a-936c-4f3f-9032-0d3f3178042a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-28d26b0a-936c-4f3f-9032-0d3f3178042a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:23.421009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:23.422642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:23.424553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:23.424553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:23.424553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:23.424553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 601/1203] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:32:23.428634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401242b-4cf8-4013-8054-84ea5b2ca532 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:23.542508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f401242b-4cf8-4013-8054-84ea5b2ca532 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:23.579075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:23.586353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20438559-957b-492b-8f69-a1290340423c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:23.591495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20438559-957b-492b-8f69-a1290340423c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:23.591495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20438559-957b-492b-8f69-a1290340423c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:23.591495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20438559-957b-492b-8f69-a1290340423c None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:23.591495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20438559-957b-492b-8f69-a1290340423c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:23.591495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20438559-957b-492b-8f69-a1290340423c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:23.591495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20438559-957b-492b-8f69-a1290340423c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:23.603211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 603/1204] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:23.609674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d26b0a-936c-4f3f-9032-0d3f3178042a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:23.684400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:23.737462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d26b0a-936c-4f3f-9032-0d3f3178042a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:23.778381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e19d3a-1b1b-4de8-8de9-d117837c5344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:23.779057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e19d3a-1b1b-4de8-8de9-d117837c5344 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:23.779382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e19d3a-1b1b-4de8-8de9-d117837c5344 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:23.779697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e19d3a-1b1b-4de8-8de9-d117837c5344 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:23.780413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e19d3a-1b1b-4de8-8de9-d117837c5344 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:23.781959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e19d3a-1b1b-4de8-8de9-d117837c5344 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:23.914012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 602/1205] 10.222.0.83 () {60 vars in 1132 bytes} [Mon Aug 29 21:32:23 2022] POST /identity/v3/users => generated 251 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:32:25.966116 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6282954-1ae0-4b81-83fd-cd2b302e0f60 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:25.966935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6282954-1ae0-4b81-83fd-cd2b302e0f60 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:25.967146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6282954-1ae0-4b81-83fd-cd2b302e0f60 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:25.968634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 604/1206] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:25.974823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65e5fc-90fe-4245-a496-7a3b4e6e861d None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:25.975666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65e5fc-90fe-4245-a496-7a3b4e6e861d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:25.975841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65e5fc-90fe-4245-a496-7a3b4e6e861d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:25.996289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-3e65e5fc-90fe-4245-a496-7a3b4e6e861d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:25.997708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3e65e5fc-90fe-4245-a496-7a3b4e6e861d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:26.082122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 603/1207] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:32:26.358057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6282954-1ae0-4b81-83fd-cd2b302e0f60 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:26.479405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6282954-1ae0-4b81-83fd-cd2b302e0f60 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:26.518183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3855-f61b-407f-a647-84c1a597ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:26.518823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3855-f61b-407f-a647-84c1a597ff24 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:26.519101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3855-f61b-407f-a647-84c1a597ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:26.519371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb3855-f61b-407f-a647-84c1a597ff24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:26.530706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb3855-f61b-407f-a647-84c1a597ff24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-34fb3855-f61b-407f-a647-84c1a597ff24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:32:26.536025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:26.537980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:26.539969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 605/1208] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:32:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:32:26.543742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65e5fc-90fe-4245-a496-7a3b4e6e861d None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:26.591264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:26.659421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65e5fc-90fe-4245-a496-7a3b4e6e861d None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:26.698518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f6bc-da76-4394-84a6-2f66a9860104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:26.699135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f6bc-da76-4394-84a6-2f66a9860104 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:26.699419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f6bc-da76-4394-84a6-2f66a9860104 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:26.699753 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f6bc-da76-4394-84a6-2f66a9860104 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:26.700429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f6bc-da76-4394-84a6-2f66a9860104 None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:26.705962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f6bc-da76-4394-84a6-2f66a9860104 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:26.705962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f6bc-da76-4394-84a6-2f66a9860104 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:26.711154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 604/1209] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:32:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:26.717154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3855-f61b-407f-a647-84c1a597ff24 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:26.774860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:26.848723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb3855-f61b-407f-a647-84c1a597ff24 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:26.886290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a2446-484e-4ab0-9c17-141a47ccbae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:26.886925 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2446-484e-4ab0-9c17-141a47ccbae8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:26.887200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2446-484e-4ab0-9c17-141a47ccbae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:26.887475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a2446-484e-4ab0-9c17-141a47ccbae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:26.900372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a2446-484e-4ab0-9c17-141a47ccbae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:26.902070 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a2446-484e-4ab0-9c17-141a47ccbae8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-1c1a2446-484e-4ab0-9c17-141a47ccbae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:26.918376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:26.920113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:26.921443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:26.921443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:26.921443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:26.921443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 606/1210] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:26.928695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f6bc-da76-4394-84a6-2f66a9860104 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:27.048605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:27.051975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f6bc-da76-4394-84a6-2f66a9860104 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:27.090805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c58b76-f7a9-4171-86da-9861e6c0bcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:27.091440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c58b76-f7a9-4171-86da-9861e6c0bcaa None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:27.091717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c58b76-f7a9-4171-86da-9861e6c0bcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:27.091986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c58b76-f7a9-4171-86da-9861e6c0bcaa None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:27.092713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c58b76-f7a9-4171-86da-9861e6c0bcaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:27.093022 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c58b76-f7a9-4171-86da-9861e6c0bcaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:27.094684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c58b76-f7a9-4171-86da-9861e6c0bcaa None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:27.109757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 605/1211] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:27.116658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a2446-484e-4ab0-9c17-141a47ccbae8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:27.269392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a2446-484e-4ab0-9c17-141a47ccbae8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:27.271223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:27.312220 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a52c-7762-47d5-b5d1-6582c2bce09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:27.312980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a52c-7762-47d5-b5d1-6582c2bce09b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:27.313301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a52c-7762-47d5-b5d1-6582c2bce09b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:27.313616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a52c-7762-47d5-b5d1-6582c2bce09b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:27.321970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954a52c-7762-47d5-b5d1-6582c2bce09b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:27.323570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954a52c-7762-47d5-b5d1-6582c2bce09b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d954a52c-7762-47d5-b5d1-6582c2bce09b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:32:27.337424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:27.339512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:27.341729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 607/1212] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:27.347353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c58b76-f7a9-4171-86da-9861e6c0bcaa None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:27.487875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c58b76-f7a9-4171-86da-9861e6c0bcaa None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:27.528400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d461cf-7af8-4bd0-aa49-e43a02bf2699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:27.528965 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d461cf-7af8-4bd0-aa49-e43a02bf2699 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:27.529241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d461cf-7af8-4bd0-aa49-e43a02bf2699 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:27.529508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d461cf-7af8-4bd0-aa49-e43a02bf2699 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:27.530255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d461cf-7af8-4bd0-aa49-e43a02bf2699 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:27.530554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d461cf-7af8-4bd0-aa49-e43a02bf2699 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:27.532130 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d461cf-7af8-4bd0-aa49-e43a02bf2699 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:27.552431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 606/1213] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 21:32:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:27.558951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a52c-7762-47d5-b5d1-6582c2bce09b None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:27.677662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a52c-7762-47d5-b5d1-6582c2bce09b None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:27.719040 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513729-ae83-481a-b625-36065c3d318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:27.719699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513729-ae83-481a-b625-36065c3d318f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:27.719981 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513729-ae83-481a-b625-36065c3d318f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:27.720253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513729-ae83-481a-b625-36065c3d318f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:27.756441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:27.801619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513729-ae83-481a-b625-36065c3d318f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:27.803268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513729-ae83-481a-b625-36065c3d318f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:27.912911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 608/1214] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:32:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:32:27.919144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d461cf-7af8-4bd0-aa49-e43a02bf2699 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:27.941197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:28.037501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d461cf-7af8-4bd0-aa49-e43a02bf2699 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:28.078351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51151c-2f08-486d-9d58-4e169184bff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:28.079050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51151c-2f08-486d-9d58-4e169184bff5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:28.079188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51151c-2f08-486d-9d58-4e169184bff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:28.079427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51151c-2f08-486d-9d58-4e169184bff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:28.091530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51151c-2f08-486d-9d58-4e169184bff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:28.093282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb51151c-2f08-486d-9d58-4e169184bff5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-eb51151c-2f08-486d-9d58-4e169184bff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:28.115475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:28.117855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:28.118897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:28.118897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:28.118897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:28.118897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 607/1215] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:28.123840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513729-ae83-481a-b625-36065c3d318f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:28.197252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:28.239246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513729-ae83-481a-b625-36065c3d318f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:28.275210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a16c-b153-4241-a1d7-ba1612824359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:28.275823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a16c-b153-4241-a1d7-ba1612824359 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:28.276166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a16c-b153-4241-a1d7-ba1612824359 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:28.276435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665a16c-b153-4241-a1d7-ba1612824359 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:28.277114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665a16c-b153-4241-a1d7-ba1612824359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:28.277411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665a16c-b153-4241-a1d7-ba1612824359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:28.278798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665a16c-b153-4241-a1d7-ba1612824359 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:28.291826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 609/1216] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:28.298211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51151c-2f08-486d-9d58-4e169184bff5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:28.388781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:28.423394 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb51151c-2f08-486d-9d58-4e169184bff5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:28.460565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513b0ba-703f-43fb-bbe7-b32698d01696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:28.461552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513b0ba-703f-43fb-bbe7-b32698d01696 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:28.461877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513b0ba-703f-43fb-bbe7-b32698d01696 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:28.462190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513b0ba-703f-43fb-bbe7-b32698d01696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:28.469715 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513b0ba-703f-43fb-bbe7-b32698d01696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:28.472368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513b0ba-703f-43fb-bbe7-b32698d01696 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-a513b0ba-703f-43fb-bbe7-b32698d01696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:32:28.483757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:28.485513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:28.487427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:32:28.487427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:32:28.487427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:32:28.487427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:32:28.487427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:32:28.487427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:32:28.487427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:28.487427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:28.487427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 608/1217] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:32:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:28.492373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a16c-b153-4241-a1d7-ba1612824359 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:28.614473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665a16c-b153-4241-a1d7-ba1612824359 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:28.642222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:28.655630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f99b7c-a9e8-4ecb-88fd-c716f600cd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:28.656257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f99b7c-a9e8-4ecb-88fd-c716f600cd9a None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:28.656568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f99b7c-a9e8-4ecb-88fd-c716f600cd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:28.656840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f99b7c-a9e8-4ecb-88fd-c716f600cd9a None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:28.657537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f99b7c-a9e8-4ecb-88fd-c716f600cd9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:28.657844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f99b7c-a9e8-4ecb-88fd-c716f600cd9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:28.659278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f99b7c-a9e8-4ecb-88fd-c716f600cd9a None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:28.672649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 610/1218] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:28.680599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513b0ba-703f-43fb-bbe7-b32698d01696 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:28.799701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513b0ba-703f-43fb-bbe7-b32698d01696 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:28.845065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:28.856300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464c2f0-7a02-4c9b-9e79-29600d373d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:28.857444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c2f0-7a02-4c9b-9e79-29600d373d47 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:28.857923 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c2f0-7a02-4c9b-9e79-29600d373d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:28.858369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c2f0-7a02-4c9b-9e79-29600d373d47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:28.859711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464c2f0-7a02-4c9b-9e79-29600d373d47 None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=dca09f6fe11f4b878dd11c4cb69ca7c6) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:28.860196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464c2f0-7a02-4c9b-9e79-29600d373d47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:28.862118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464c2f0-7a02-4c9b-9e79-29600d373d47 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:28.868702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 609/1219] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:32:28 2022] GET /identity/v3/role_assignments?user.id=dca09f6fe11f4b878dd11c4cb69ca7c6&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:30.854541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a074c-2e35-4607-b890-62fe1d02b9fc None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:30.855393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a074c-2e35-4607-b890-62fe1d02b9fc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:30.855583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a074c-2e35-4607-b890-62fe1d02b9fc None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:30.857242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 611/1220] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:30.867056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6a13f-33ed-476a-9709-0221b7f1579d None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:30.868221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6a13f-33ed-476a-9709-0221b7f1579d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:30.868221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6a13f-33ed-476a-9709-0221b7f1579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:30.888862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-23c6a13f-33ed-476a-9709-0221b7f1579d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:30.890090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-23c6a13f-33ed-476a-9709-0221b7f1579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:30.967410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 610/1221] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:32:31.241345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a074c-2e35-4607-b890-62fe1d02b9fc None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:31.357092 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a074c-2e35-4607-b890-62fe1d02b9fc None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:31.396337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb63a12-7736-46f8-bca6-eee0e866895c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:31.396978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb63a12-7736-46f8-bca6-eee0e866895c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:31.397253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb63a12-7736-46f8-bca6-eee0e866895c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:31.397522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb63a12-7736-46f8-bca6-eee0e866895c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:31.408846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb63a12-7736-46f8-bca6-eee0e866895c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-8eb63a12-7736-46f8-bca6-eee0e866895c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:32:31.413796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:31.415936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:31.417196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 612/1222] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:32:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:31.421971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6a13f-33ed-476a-9709-0221b7f1579d None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:31.535624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6a13f-33ed-476a-9709-0221b7f1579d None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:31.563216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:31.574960 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047ff3d-7a04-4de8-804b-d00b7283257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:31.575603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047ff3d-7a04-4de8-804b-d00b7283257b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:31.575875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047ff3d-7a04-4de8-804b-d00b7283257b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:31.576142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047ff3d-7a04-4de8-804b-d00b7283257b None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:31.576852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047ff3d-7a04-4de8-804b-d00b7283257b None admin] RBAC: Adding query filter params (name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:31.577145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047ff3d-7a04-4de8-804b-d00b7283257b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:31.578522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047ff3d-7a04-4de8-804b-d00b7283257b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:31.587688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 611/1223] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:32:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:31.593783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb63a12-7736-46f8-bca6-eee0e866895c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:31.643853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:31.705685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb63a12-7736-46f8-bca6-eee0e866895c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:31.741667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c4a4d-3a5e-476d-90d2-98fb954c3fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:31.742356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c4a4d-3a5e-476d-90d2-98fb954c3fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:31.742634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c4a4d-3a5e-476d-90d2-98fb954c3fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:31.742903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c4a4d-3a5e-476d-90d2-98fb954c3fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:31.753810 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c4a4d-3a5e-476d-90d2-98fb954c3fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:31.755272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c4a4d-3a5e-476d-90d2-98fb954c3fb2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-6a4c4a4d-3a5e-476d-90d2-98fb954c3fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:31.771972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:31.773454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:31.775964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:31.775964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:31.775964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:31.775964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 613/1224] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:31.780380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047ff3d-7a04-4de8-804b-d00b7283257b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:31.901112 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047ff3d-7a04-4de8-804b-d00b7283257b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:31.941045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bcc59-1688-4d46-a416-a5e4735e17a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:31.941743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bcc59-1688-4d46-a416-a5e4735e17a5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:31.942059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bcc59-1688-4d46-a416-a5e4735e17a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:31.942369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bcc59-1688-4d46-a416-a5e4735e17a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:31.943085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bcc59-1688-4d46-a416-a5e4735e17a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:31.943422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bcc59-1688-4d46-a416-a5e4735e17a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:31.944979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bcc59-1688-4d46-a416-a5e4735e17a5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:31.959202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 612/1225] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:31.965900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c4a4d-3a5e-476d-90d2-98fb954c3fb2 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:32.081080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:32.092999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c4a4d-3a5e-476d-90d2-98fb954c3fb2 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:32.155604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0269d51-3680-4e95-97ec-4615a1306d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:32.156633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0269d51-3680-4e95-97ec-4615a1306d99 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:32.157129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0269d51-3680-4e95-97ec-4615a1306d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:32.157620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0269d51-3680-4e95-97ec-4615a1306d99 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:32.171538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0269d51-3680-4e95-97ec-4615a1306d99 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:32.174311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0269d51-3680-4e95-97ec-4615a1306d99 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-f0269d51-3680-4e95-97ec-4615a1306d99 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:32:32.199565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:32.201386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:32.202681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 614/1226] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:32.207871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bcc59-1688-4d46-a416-a5e4735e17a5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:32.262984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:32.357285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bcc59-1688-4d46-a416-a5e4735e17a5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:32.412709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748983d2-83fa-4d99-bb7e-9081001c559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:32.413232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748983d2-83fa-4d99-bb7e-9081001c559a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:32.413508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748983d2-83fa-4d99-bb7e-9081001c559a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:32.413866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748983d2-83fa-4d99-bb7e-9081001c559a None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:32.414735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748983d2-83fa-4d99-bb7e-9081001c559a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:32.415034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748983d2-83fa-4d99-bb7e-9081001c559a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:32.416565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748983d2-83fa-4d99-bb7e-9081001c559a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:32.438159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 613/1227] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 21:32:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:32.444642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0269d51-3680-4e95-97ec-4615a1306d99 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:32.556981 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0269d51-3680-4e95-97ec-4615a1306d99 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:32.593672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb438ab-fd6f-41c1-b1e2-2825640ceaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:32.594446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb438ab-fd6f-41c1-b1e2-2825640ceaef None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:32.594816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb438ab-fd6f-41c1-b1e2-2825640ceaef None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:32.595186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb438ab-fd6f-41c1-b1e2-2825640ceaef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:32.607889 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb438ab-fd6f-41c1-b1e2-2825640ceaef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:32.609413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb438ab-fd6f-41c1-b1e2-2825640ceaef None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-4fb438ab-fd6f-41c1-b1e2-2825640ceaef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:32.625485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:32.627331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:32.629012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:32.629012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:32.629012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:32.629012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 615/1228] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:32:32.633926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748983d2-83fa-4d99-bb7e-9081001c559a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:32.749438 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748983d2-83fa-4d99-bb7e-9081001c559a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:32.752429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:32.789739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61eef-91fd-444e-8e24-9a136ce8ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:32.790430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61eef-91fd-444e-8e24-9a136ce8ec29 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:32.790780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61eef-91fd-444e-8e24-9a136ce8ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:32.791133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea61eef-91fd-444e-8e24-9a136ce8ec29 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:32.791843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea61eef-91fd-444e-8e24-9a136ce8ec29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:32.792186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea61eef-91fd-444e-8e24-9a136ce8ec29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:32.793807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea61eef-91fd-444e-8e24-9a136ce8ec29 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:32.807562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 614/1229] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:32.816646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb438ab-fd6f-41c1-b1e2-2825640ceaef None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:32.828215 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:32.958835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb438ab-fd6f-41c1-b1e2-2825640ceaef None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:33.022755 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86222-15f6-4b03-b36b-835d90af0592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:33.023912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86222-15f6-4b03-b36b-835d90af0592 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:33.024374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86222-15f6-4b03-b36b-835d90af0592 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:33.024895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b86222-15f6-4b03-b36b-835d90af0592 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:33.038245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86222-15f6-4b03-b36b-835d90af0592 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:33.041087 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b86222-15f6-4b03-b36b-835d90af0592 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-29b86222-15f6-4b03-b36b-835d90af0592 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:32:33.063583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:33.064785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:33.065858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:32:33.065858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:32:33.065858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:32:33.065858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:32:33.065858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:32:33.065858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:32:33.065858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:33.065858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:33.065858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 616/1230] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:32:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:33.075024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61eef-91fd-444e-8e24-9a136ce8ec29 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:33.191921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea61eef-91fd-444e-8e24-9a136ce8ec29 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:33.230551 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87f5f0-d4eb-4c5c-aafd-60f1ad4f202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:33.231231 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87f5f0-d4eb-4c5c-aafd-60f1ad4f202c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:33.231605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87f5f0-d4eb-4c5c-aafd-60f1ad4f202c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:33.231947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87f5f0-d4eb-4c5c-aafd-60f1ad4f202c None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:33.232774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87f5f0-d4eb-4c5c-aafd-60f1ad4f202c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:33.233146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87f5f0-d4eb-4c5c-aafd-60f1ad4f202c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:33.234812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87f5f0-d4eb-4c5c-aafd-60f1ad4f202c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:33.248744 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 615/1231] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:32:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:33.255285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86222-15f6-4b03-b36b-835d90af0592 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:33.358653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:33.397692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b86222-15f6-4b03-b36b-835d90af0592 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:33.436895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8fdc9-1ea9-429a-84ce-8cb118478ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:33.437669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fdc9-1ea9-429a-84ce-8cb118478ff6 None admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:33.437997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fdc9-1ea9-429a-84ce-8cb118478ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:33.438360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8fdc9-1ea9-429a-84ce-8cb118478ff6 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/dca09f6fe11f4b878dd11c4cb69ca7c6/roles/987f120590e04a9aa6b494c08604a0cd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:33.457245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8fdc9-1ea9-429a-84ce-8cb118478ff6 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=dca09f6fe11f4b878dd11c4cb69ca7c6, role_id=987f120590e04a9aa6b494c08604a0cd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:33.458790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8fdc9-1ea9-429a-84ce-8cb118478ff6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:33.536324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 617/1232] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:32:33 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/dca09f6fe11f4b878dd11c4cb69ca7c6/roles/987f120590e04a9aa6b494c08604a0cd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:35.882455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2acd63-57dc-436f-9c48-68de4cd39957 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:35.883559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2acd63-57dc-436f-9c48-68de4cd39957 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:35.883714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2acd63-57dc-436f-9c48-68de4cd39957 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:35.885302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 616/1233] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:35.891519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a9bc8-9e10-4ab1-90dc-c86c04f72a87 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:35.892047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a9bc8-9e10-4ab1-90dc-c86c04f72a87 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:35.892047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a9bc8-9e10-4ab1-90dc-c86c04f72a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:35.911464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9d7a9bc8-9e10-4ab1-90dc-c86c04f72a87 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:35.912709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9d7a9bc8-9e10-4ab1-90dc-c86c04f72a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:35.993385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 618/1234] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:32:36.262295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2acd63-57dc-436f-9c48-68de4cd39957 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:36.291628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:36.376683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2acd63-57dc-436f-9c48-68de4cd39957 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:36.415011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfbc5b-bde7-46a8-aeea-177d3ec8695a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:36.415658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfbc5b-bde7-46a8-aeea-177d3ec8695a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:36.415931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfbc5b-bde7-46a8-aeea-177d3ec8695a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:36.416198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfbc5b-bde7-46a8-aeea-177d3ec8695a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:36.429794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebfbc5b-bde7-46a8-aeea-177d3ec8695a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-6ebfbc5b-bde7-46a8-aeea-177d3ec8695a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:32:36.434829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:36.437003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:36.438662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 617/1235] 10.222.0.83 () {56 vars in 1102 bytes} [Mon Aug 29 21:32:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:36.444290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a9bc8-9e10-4ab1-90dc-c86c04f72a87 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:36.495732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:36.556333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a9bc8-9e10-4ab1-90dc-c86c04f72a87 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:36.595266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7e56-76b7-4f21-a64b-19c2b2f13e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:36.596451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7e56-76b7-4f21-a64b-19c2b2f13e57 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:36.596451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7e56-76b7-4f21-a64b-19c2b2f13e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:36.596756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e7e56-76b7-4f21-a64b-19c2b2f13e57 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:36.597550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e7e56-76b7-4f21-a64b-19c2b2f13e57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:36.598162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e7e56-76b7-4f21-a64b-19c2b2f13e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:36.600022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e7e56-76b7-4f21-a64b-19c2b2f13e57 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:36.610180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 619/1236] 10.222.0.83 () {56 vars in 1103 bytes} [Mon Aug 29 21:32:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:36.616390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfbc5b-bde7-46a8-aeea-177d3ec8695a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:36.718398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:36.735409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfbc5b-bde7-46a8-aeea-177d3ec8695a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:36.774363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdceeb6-e2b4-4d29-b7bd-74dc4e823e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:36.775052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdceeb6-e2b4-4d29-b7bd-74dc4e823e1c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:36.775334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdceeb6-e2b4-4d29-b7bd-74dc4e823e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:36.775615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdceeb6-e2b4-4d29-b7bd-74dc4e823e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:36.788992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdceeb6-e2b4-4d29-b7bd-74dc4e823e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:36.792874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdceeb6-e2b4-4d29-b7bd-74dc4e823e1c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-7cdceeb6-e2b4-4d29-b7bd-74dc4e823e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:36.809381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:36.811221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:36.813185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:36.813185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:36.813185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:36.813185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 618/1237] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:36.818149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7e56-76b7-4f21-a64b-19c2b2f13e57 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:36.939177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e7e56-76b7-4f21-a64b-19c2b2f13e57 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:36.950497 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:36.978833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8be0a0-5a84-403c-a14e-f49cb95d67d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:36.978833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8be0a0-5a84-403c-a14e-f49cb95d67d8 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:36.979234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8be0a0-5a84-403c-a14e-f49cb95d67d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:36.979386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8be0a0-5a84-403c-a14e-f49cb95d67d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:36.979989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8be0a0-5a84-403c-a14e-f49cb95d67d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:36.980301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8be0a0-5a84-403c-a14e-f49cb95d67d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:36.981756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8be0a0-5a84-403c-a14e-f49cb95d67d8 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:36.995156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 620/1238] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:37.004403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdceeb6-e2b4-4d29-b7bd-74dc4e823e1c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:37.131210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdceeb6-e2b4-4d29-b7bd-74dc4e823e1c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:37.172453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbff727-e855-4828-9697-15395ea5b165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:37.173556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff727-e855-4828-9697-15395ea5b165 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:37.174080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff727-e855-4828-9697-15395ea5b165 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:37.174559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbff727-e855-4828-9697-15395ea5b165 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:37.179360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:37.188364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbff727-e855-4828-9697-15395ea5b165 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:37.192536 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbff727-e855-4828-9697-15395ea5b165 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-ddbff727-e855-4828-9697-15395ea5b165 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:32:37.206105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:37.208193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:37.209844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 619/1239] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:37.214886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8be0a0-5a84-403c-a14e-f49cb95d67d8 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:37.362998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8be0a0-5a84-403c-a14e-f49cb95d67d8 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:37.404088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ce3bc-05d4-42c9-ad94-7b673c69ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:37.404661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ce3bc-05d4-42c9-ad94-7b673c69ab89 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:37.404943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ce3bc-05d4-42c9-ad94-7b673c69ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:37.405219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ce3bc-05d4-42c9-ad94-7b673c69ab89 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:37.406019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ce3bc-05d4-42c9-ad94-7b673c69ab89 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:37.406327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ce3bc-05d4-42c9-ad94-7b673c69ab89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:37.407859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ce3bc-05d4-42c9-ad94-7b673c69ab89 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:37.430438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 621/1240] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 21:32:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:37.436820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbff727-e855-4828-9697-15395ea5b165 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:37.564621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbff727-e855-4828-9697-15395ea5b165 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:37.605928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d4ab6-50ce-47ad-8580-645728e766d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:37.606680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d4ab6-50ce-47ad-8580-645728e766d5 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:37.607040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d4ab6-50ce-47ad-8580-645728e766d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:37.607398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d4ab6-50ce-47ad-8580-645728e766d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:37.681871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:37.689274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d4ab6-50ce-47ad-8580-645728e766d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:37.690794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d4ab6-50ce-47ad-8580-645728e766d5 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:37.802223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 620/1241] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:32:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 21:32:37.808823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ce3bc-05d4-42c9-ad94-7b673c69ab89 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:37.847295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:37.943454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ce3bc-05d4-42c9-ad94-7b673c69ab89 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:37.991225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449237d-423b-4825-bd22-f5c696ce855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:37.992360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449237d-423b-4825-bd22-f5c696ce855e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:37.992901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449237d-423b-4825-bd22-f5c696ce855e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:37.993394 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449237d-423b-4825-bd22-f5c696ce855e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:38.014503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449237d-423b-4825-bd22-f5c696ce855e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:38.017344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449237d-423b-4825-bd22-f5c696ce855e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d449237d-423b-4825-bd22-f5c696ce855e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:38.047410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:38.048689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:38.049718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:38.049718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:38.049718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:38.049718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 622/1242] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:38.055914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d4ab6-50ce-47ad-8580-645728e766d5 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:38.171199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:38.178784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d4ab6-50ce-47ad-8580-645728e766d5 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:38.231418 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e2c5b-0e08-4607-a102-d9bd31db0d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:38.231941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e2c5b-0e08-4607-a102-d9bd31db0d46 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:38.232218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e2c5b-0e08-4607-a102-d9bd31db0d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:38.232525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e2c5b-0e08-4607-a102-d9bd31db0d46 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:38.233261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e2c5b-0e08-4607-a102-d9bd31db0d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:38.233564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e2c5b-0e08-4607-a102-d9bd31db0d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:38.235020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e2c5b-0e08-4607-a102-d9bd31db0d46 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:38.248611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 621/1243] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:38.255189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449237d-423b-4825-bd22-f5c696ce855e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:38.345994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:38.371194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449237d-423b-4825-bd22-f5c696ce855e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:38.409167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd36eea-66df-4ea7-b4f7-363a72deceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:38.409877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd36eea-66df-4ea7-b4f7-363a72deceb4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:38.410194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd36eea-66df-4ea7-b4f7-363a72deceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:38.410503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd36eea-66df-4ea7-b4f7-363a72deceb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:38.418261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd36eea-66df-4ea7-b4f7-363a72deceb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:38.419784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd36eea-66df-4ea7-b4f7-363a72deceb4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-fdd36eea-66df-4ea7-b4f7-363a72deceb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:32:38.436216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:38.437457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:38.438452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:32:38.438452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:32:38.438452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:32:38.438452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:32:38.438452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:32:38.438452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:32:38.438452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:38.438452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:38.438452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 623/1244] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:32:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:38.446236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e2c5b-0e08-4607-a102-d9bd31db0d46 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:38.561584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e2c5b-0e08-4607-a102-d9bd31db0d46 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:38.599739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d253e4-0b46-4207-95a8-819bc7ff9c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:38.600417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d253e4-0b46-4207-95a8-819bc7ff9c9b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:38.600759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d253e4-0b46-4207-95a8-819bc7ff9c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:38.601081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d253e4-0b46-4207-95a8-819bc7ff9c9b None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:38.601873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d253e4-0b46-4207-95a8-819bc7ff9c9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:38.602318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d253e4-0b46-4207-95a8-819bc7ff9c9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:38.603900 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d253e4-0b46-4207-95a8-819bc7ff9c9b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:38.618440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 622/1245] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:32:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:38.625071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd36eea-66df-4ea7-b4f7-363a72deceb4 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:38.739073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd36eea-66df-4ea7-b4f7-363a72deceb4 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:38.778348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7702847-7c0c-4954-bac8-2b2ec1f764d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:38.779006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702847-7c0c-4954-bac8-2b2ec1f764d4 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:38.779288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702847-7c0c-4954-bac8-2b2ec1f764d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:38.779564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7702847-7c0c-4954-bac8-2b2ec1f764d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:38.780300 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702847-7c0c-4954-bac8-2b2ec1f764d4 None admin] RBAC: Adding query filter params (role.id=987f120590e04a9aa6b494c08604a0cd, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=dca09f6fe11f4b878dd11c4cb69ca7c6) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:38.780644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702847-7c0c-4954-bac8-2b2ec1f764d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:38.782106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7702847-7c0c-4954-bac8-2b2ec1f764d4 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:38.788854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 624/1246] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:32:38 2022] GET /identity/v3/role_assignments?user.id=dca09f6fe11f4b878dd11c4cb69ca7c6&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=987f120590e04a9aa6b494c08604a0cd => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:40.948366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4883be-d5bc-4575-a379-514b626b9832 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:40.948963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4883be-d5bc-4575-a379-514b626b9832 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:40.948963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4883be-d5bc-4575-a379-514b626b9832 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:40.950272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 623/1247] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:40.956238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2e14-dd84-417a-9ca4-8cc61b750288 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:40.956784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2e14-dd84-417a-9ca4-8cc61b750288 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:40.956923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a2e14-dd84-417a-9ca4-8cc61b750288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:40.963746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:40.976951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-132a2e14-dd84-417a-9ca4-8cc61b750288 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:40.978196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-132a2e14-dd84-417a-9ca4-8cc61b750288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:41.058600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 625/1248] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:32:41.333212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4883be-d5bc-4575-a379-514b626b9832 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:41.366087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:41.527184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4883be-d5bc-4575-a379-514b626b9832 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:41.592060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdff5-a271-4ee0-8c1d-0efbb006725a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:41.593110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdff5-a271-4ee0-8c1d-0efbb006725a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.593595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdff5-a271-4ee0-8c1d-0efbb006725a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.594086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cdff5-a271-4ee0-8c1d-0efbb006725a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.613499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cdff5-a271-4ee0-8c1d-0efbb006725a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-bd6cdff5-a271-4ee0-8c1d-0efbb006725a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:32:41.623368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:41.625196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:41.626420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 624/1249] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:32:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:41.635871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2e14-dd84-417a-9ca4-8cc61b750288 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:41.751922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a2e14-dd84-417a-9ca4-8cc61b750288 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:41.787419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:41.792988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347bf79-f6f4-4906-8d9a-f41454ad81f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:41.793620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347bf79-f6f4-4906-8d9a-f41454ad81f0 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.793901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347bf79-f6f4-4906-8d9a-f41454ad81f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.794172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c347bf79-f6f4-4906-8d9a-f41454ad81f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.794857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347bf79-f6f4-4906-8d9a-f41454ad81f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:41.795160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347bf79-f6f4-4906-8d9a-f41454ad81f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:41.796642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c347bf79-f6f4-4906-8d9a-f41454ad81f0 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:41.806088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 626/1250] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:32:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:41.812597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdff5-a271-4ee0-8c1d-0efbb006725a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:41.912457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:41.937900 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cdff5-a271-4ee0-8c1d-0efbb006725a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:41.985447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a70d03-fa43-4c9e-b474-b594424ab563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:41.986218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a70d03-fa43-4c9e-b474-b594424ab563 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:41.986367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a70d03-fa43-4c9e-b474-b594424ab563 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:41.986624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a70d03-fa43-4c9e-b474-b594424ab563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:41.999944 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a70d03-fa43-4c9e-b474-b594424ab563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:42.002335 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a70d03-fa43-4c9e-b474-b594424ab563 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-61a70d03-fa43-4c9e-b474-b594424ab563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:42.021468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:42.023755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:42.025946 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:42.025946 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:42.025946 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:42.025946 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 625/1251] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:42.029861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347bf79-f6f4-4906-8d9a-f41454ad81f0 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:42.159105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c347bf79-f6f4-4906-8d9a-f41454ad81f0 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:42.200079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd9787-e582-4a75-8fb2-16cd3750b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:42.200650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd9787-e582-4a75-8fb2-16cd3750b08c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:42.200927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd9787-e582-4a75-8fb2-16cd3750b08c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:42.201195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd9787-e582-4a75-8fb2-16cd3750b08c None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:42.201924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd9787-e582-4a75-8fb2-16cd3750b08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:42.202281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd9787-e582-4a75-8fb2-16cd3750b08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:42.203726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd9787-e582-4a75-8fb2-16cd3750b08c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:42.218819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 627/1252] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:42.225140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a70d03-fa43-4c9e-b474-b594424ab563 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:42.350075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a70d03-fa43-4c9e-b474-b594424ab563 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:42.407139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:42.421420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df27e89-9e7a-4b3c-8e91-11e365f8630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:42.422493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df27e89-9e7a-4b3c-8e91-11e365f8630e None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:42.422978 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df27e89-9e7a-4b3c-8e91-11e365f8630e None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:42.423467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df27e89-9e7a-4b3c-8e91-11e365f8630e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:42.438830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df27e89-9e7a-4b3c-8e91-11e365f8630e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:42.441713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df27e89-9e7a-4b3c-8e91-11e365f8630e None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-3df27e89-9e7a-4b3c-8e91-11e365f8630e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:32:42.465195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:42.466448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:42.467699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 626/1253] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:42.473832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd9787-e582-4a75-8fb2-16cd3750b08c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:42.539478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:42.592833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd9787-e582-4a75-8fb2-16cd3750b08c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:42.635322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1006a7-b3a8-43ed-81e7-6bdbb59a0720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:42.636037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1006a7-b3a8-43ed-81e7-6bdbb59a0720 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:42.636364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1006a7-b3a8-43ed-81e7-6bdbb59a0720 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:42.636716 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1006a7-b3a8-43ed-81e7-6bdbb59a0720 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:42.637515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1006a7-b3a8-43ed-81e7-6bdbb59a0720 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:42.637922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1006a7-b3a8-43ed-81e7-6bdbb59a0720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:42.639519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1006a7-b3a8-43ed-81e7-6bdbb59a0720 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:42.659543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 628/1254] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 21:32:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:42.666418 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df27e89-9e7a-4b3c-8e91-11e365f8630e None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:42.831590 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df27e89-9e7a-4b3c-8e91-11e365f8630e None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:42.872528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bffa38-ba4d-4970-872b-93defca2555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:42.873157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bffa38-ba4d-4970-872b-93defca2555a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:42.873435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bffa38-ba4d-4970-872b-93defca2555a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:42.873707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bffa38-ba4d-4970-872b-93defca2555a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:42.947559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:42.962502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bffa38-ba4d-4970-872b-93defca2555a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:42.963967 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bffa38-ba4d-4970-872b-93defca2555a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:43.079967 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 627/1255] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:32:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:32:43.087505 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1006a7-b3a8-43ed-81e7-6bdbb59a0720 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:43.203135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1006a7-b3a8-43ed-81e7-6bdbb59a0720 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:43.219054 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:43.243357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9f79d-6ce5-4054-8a8c-69d5272df613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:43.244126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9f79d-6ce5-4054-8a8c-69d5272df613 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:43.244410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9f79d-6ce5-4054-8a8c-69d5272df613 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:43.244733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9f79d-6ce5-4054-8a8c-69d5272df613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:43.257328 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9f79d-6ce5-4054-8a8c-69d5272df613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:43.259679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9f79d-6ce5-4054-8a8c-69d5272df613 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-47a9f79d-6ce5-4054-8a8c-69d5272df613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:43.277090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:43.278554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:43.279733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:43.279733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:43.279733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:43.279733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 629/1256] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:43.285066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bffa38-ba4d-4970-872b-93defca2555a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:43.405501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:43.419517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bffa38-ba4d-4970-872b-93defca2555a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:43.458763 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae34fca-7009-4e96-a984-9c178c1e59d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:43.459486 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae34fca-7009-4e96-a984-9c178c1e59d3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:43.459833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae34fca-7009-4e96-a984-9c178c1e59d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:43.460155 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae34fca-7009-4e96-a984-9c178c1e59d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:43.460973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae34fca-7009-4e96-a984-9c178c1e59d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:43.461919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae34fca-7009-4e96-a984-9c178c1e59d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:43.463407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae34fca-7009-4e96-a984-9c178c1e59d3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:43.478022 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 628/1257] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:43.484151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9f79d-6ce5-4054-8a8c-69d5272df613 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:43.604638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9f79d-6ce5-4054-8a8c-69d5272df613 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:43.645905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1958e-511c-4d69-8a2d-0d7bd3d55135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:43.646700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1958e-511c-4d69-8a2d-0d7bd3d55135 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:43.647089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1958e-511c-4d69-8a2d-0d7bd3d55135 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:43.647476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1958e-511c-4d69-8a2d-0d7bd3d55135 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:43.655718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1958e-511c-4d69-8a2d-0d7bd3d55135 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:43.657150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1958e-511c-4d69-8a2d-0d7bd3d55135 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-cbf1958e-511c-4d69-8a2d-0d7bd3d55135 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:32:43.669942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:43.671751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:43.673550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:32:43.673550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:32:43.673550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:32:43.673550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:32:43.673550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:32:43.673550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:32:43.673550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:43.673550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:43.673550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 630/1258] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:32:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:32:43.677533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae34fca-7009-4e96-a984-9c178c1e59d3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:43.810479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae34fca-7009-4e96-a984-9c178c1e59d3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:43.857843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8785fdf-d0a7-4c6d-a543-12c1b428b441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:43.858429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8785fdf-d0a7-4c6d-a543-12c1b428b441 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:43.858712 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8785fdf-d0a7-4c6d-a543-12c1b428b441 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:43.859008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8785fdf-d0a7-4c6d-a543-12c1b428b441 None admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:43.859708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8785fdf-d0a7-4c6d-a543-12c1b428b441 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:43.860015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8785fdf-d0a7-4c6d-a543-12c1b428b441 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:43.861539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8785fdf-d0a7-4c6d-a543-12c1b428b441 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:43.877799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 629/1259] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:32:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:43.885187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1958e-511c-4d69-8a2d-0d7bd3d55135 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:43.914834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:44.007885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1958e-511c-4d69-8a2d-0d7bd3d55135 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:44.051165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70071c6-a2e7-4d68-a7d0-f11b9f1409a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:44.051805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70071c6-a2e7-4d68-a7d0-f11b9f1409a5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:44.052082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70071c6-a2e7-4d68-a7d0-f11b9f1409a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:44.052356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70071c6-a2e7-4d68-a7d0-f11b9f1409a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:44.053157 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70071c6-a2e7-4d68-a7d0-f11b9f1409a5 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=dca09f6fe11f4b878dd11c4cb69ca7c6) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:44.053472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70071c6-a2e7-4d68-a7d0-f11b9f1409a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:44.055601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70071c6-a2e7-4d68-a7d0-f11b9f1409a5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:44.061902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 631/1260] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:32:43 2022] GET /identity/v3/role_assignments?user.id=dca09f6fe11f4b878dd11c4cb69ca7c6&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=c0316e22a13a4034846c451753b4c14e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:46.049220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1695-8e13-4ebd-9e90-cbe895f720f4 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:46.049874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1695-8e13-4ebd-9e90-cbe895f720f4 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:46.049874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c1695-8e13-4ebd-9e90-cbe895f720f4 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:46.051499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 630/1261] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:32:46.059417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90781574-0277-4859-83af-0eb14aad965a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:46.060057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90781574-0277-4859-83af-0eb14aad965a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:46.060371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90781574-0277-4859-83af-0eb14aad965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:46.091546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-90781574-0277-4859-83af-0eb14aad965a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:46.093633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-90781574-0277-4859-83af-0eb14aad965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:46.183293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 632/1262] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:32:46.455384 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1695-8e13-4ebd-9e90-cbe895f720f4 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:46.468454 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:46.590428 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4c1695-8e13-4ebd-9e90-cbe895f720f4 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:46.654952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced558d-2f7a-4a3c-9b99-dc09b02e5b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:46.656041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced558d-2f7a-4a3c-9b99-dc09b02e5b30 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:46.656580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced558d-2f7a-4a3c-9b99-dc09b02e5b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:46.657085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced558d-2f7a-4a3c-9b99-dc09b02e5b30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:46.675796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced558d-2f7a-4a3c-9b99-dc09b02e5b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-8ced558d-2f7a-4a3c-9b99-dc09b02e5b30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:32:46.681633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:46.683953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:46.689160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 631/1263] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:46.690350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90781574-0277-4859-83af-0eb14aad965a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:46.712714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:46.808470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90781574-0277-4859-83af-0eb14aad965a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:46.846355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21064986-6e69-4f0f-a94b-a6548fb1cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:46.846983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21064986-6e69-4f0f-a94b-a6548fb1cc8f None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:46.847260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21064986-6e69-4f0f-a94b-a6548fb1cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:46.847528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21064986-6e69-4f0f-a94b-a6548fb1cc8f None admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:46.848210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21064986-6e69-4f0f-a94b-a6548fb1cc8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:46.848558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21064986-6e69-4f0f-a94b-a6548fb1cc8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:46.850043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21064986-6e69-4f0f-a94b-a6548fb1cc8f None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:46.859500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 633/1264] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:46.865956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced558d-2f7a-4a3c-9b99-dc09b02e5b30 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:46.959466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:47.022514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced558d-2f7a-4a3c-9b99-dc09b02e5b30 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:47.065194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caddfe-7778-409a-a426-18e2e124570d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:47.066278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caddfe-7778-409a-a426-18e2e124570d None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:47.066662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caddfe-7778-409a-a426-18e2e124570d None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:47.067010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caddfe-7778-409a-a426-18e2e124570d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:47.079535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caddfe-7778-409a-a426-18e2e124570d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:47.081074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caddfe-7778-409a-a426-18e2e124570d None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-54caddfe-7778-409a-a426-18e2e124570d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:47.098299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:47.100144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:47.101322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:47.101322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:47.101322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:47.101322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 632/1265] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:47.106551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21064986-6e69-4f0f-a94b-a6548fb1cc8f None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:47.218478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:47.241831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21064986-6e69-4f0f-a94b-a6548fb1cc8f None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:47.281436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d072b-77ac-499b-afd5-9bf5ec3098a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:47.281974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d072b-77ac-499b-afd5-9bf5ec3098a3 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:47.282250 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d072b-77ac-499b-afd5-9bf5ec3098a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:47.282519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d072b-77ac-499b-afd5-9bf5ec3098a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:47.283179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d072b-77ac-499b-afd5-9bf5ec3098a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:47.283479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d072b-77ac-499b-afd5-9bf5ec3098a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:47.285060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d072b-77ac-499b-afd5-9bf5ec3098a3 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:47.307167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 634/1266] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:47.313922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caddfe-7778-409a-a426-18e2e124570d None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:47.444656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caddfe-7778-409a-a426-18e2e124570d None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:47.485637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:47.511709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f9ef1-b7be-490b-b811-ab49a4bdea6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:47.512870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f9ef1-b7be-490b-b811-ab49a4bdea6b None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:47.513372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f9ef1-b7be-490b-b811-ab49a4bdea6b None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:47.513874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f9ef1-b7be-490b-b811-ab49a4bdea6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:47.529672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f9ef1-b7be-490b-b811-ab49a4bdea6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:47.532579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f9ef1-b7be-490b-b811-ab49a4bdea6b None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-3f0f9ef1-b7be-490b-b811-ab49a4bdea6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:32:47.556821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:47.558157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:47.559399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 633/1267] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:47.565441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d072b-77ac-499b-afd5-9bf5ec3098a3 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:47.700648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d072b-77ac-499b-afd5-9bf5ec3098a3 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:47.758301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f0924-c9a1-4db2-80aa-541011d40238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:47.759586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f0924-c9a1-4db2-80aa-541011d40238 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:47.760071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f0924-c9a1-4db2-80aa-541011d40238 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:47.760605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f0924-c9a1-4db2-80aa-541011d40238 None admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:47.761962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f0924-c9a1-4db2-80aa-541011d40238 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:47.762517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f0924-c9a1-4db2-80aa-541011d40238 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:47.765426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f0924-c9a1-4db2-80aa-541011d40238 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:47.785448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:47.799610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 635/1268] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 21:32:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:47.805634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f9ef1-b7be-490b-b811-ab49a4bdea6b None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:47.928837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f9ef1-b7be-490b-b811-ab49a4bdea6b None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:47.976630 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d1d8d-08be-4a6d-a438-4c9df6509251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:47.977728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d1d8d-08be-4a6d-a438-4c9df6509251 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:47.978226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d1d8d-08be-4a6d-a438-4c9df6509251 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:47.978720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d1d8d-08be-4a6d-a438-4c9df6509251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:47.998749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d1d8d-08be-4a6d-a438-4c9df6509251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:48.001521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d1d8d-08be-4a6d-a438-4c9df6509251 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-7b1d1d8d-08be-4a6d-a438-4c9df6509251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:48.031246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:48.033047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:48.034953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:48.034953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:48.034953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:48.034953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 634/1269] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:48.039764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f0924-c9a1-4db2-80aa-541011d40238 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:48.166501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f0924-c9a1-4db2-80aa-541011d40238 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:48.205518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d13eb-c249-4baf-b32f-1fbced8cb1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:48.206141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d13eb-c249-4baf-b32f-1fbced8cb1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:48.206420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d13eb-c249-4baf-b32f-1fbced8cb1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:48.206693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d13eb-c249-4baf-b32f-1fbced8cb1f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:48.207345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d13eb-c249-4baf-b32f-1fbced8cb1f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:48.207646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d13eb-c249-4baf-b32f-1fbced8cb1f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:48.209226 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d13eb-c249-4baf-b32f-1fbced8cb1f5 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:48.222805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 636/1270] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:48.231852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d1d8d-08be-4a6d-a438-4c9df6509251 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:48.278014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:48.358376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d1d8d-08be-4a6d-a438-4c9df6509251 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:48.397264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63a013-dec6-4d94-a7c0-d83398230055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:48.397913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a013-dec6-4d94-a7c0-d83398230055 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:48.398192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a013-dec6-4d94-a7c0-d83398230055 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:48.398492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a013-dec6-4d94-a7c0-d83398230055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:48.406131 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63a013-dec6-4d94-a7c0-d83398230055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:48.407601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63a013-dec6-4d94-a7c0-d83398230055 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-9e63a013-dec6-4d94-a7c0-d83398230055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:32:48.420135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:48.426458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:48.431115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:32:48.431115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:32:48.431115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:32:48.431115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:32:48.431115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:32:48.431115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:32:48.431115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:48.431115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:48.431115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 635/1271] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:32:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:48.432096 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d13eb-c249-4baf-b32f-1fbced8cb1f5 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:48.492756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:48.539489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d13eb-c249-4baf-b32f-1fbced8cb1f5 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:48.577551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6a848-8fc3-425f-b043-5d1052acaced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:48.578370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a848-8fc3-425f-b043-5d1052acaced None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:48.578694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a848-8fc3-425f-b043-5d1052acaced None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:48.579005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6a848-8fc3-425f-b043-5d1052acaced None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:48.579747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6a848-8fc3-425f-b043-5d1052acaced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:48.580053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6a848-8fc3-425f-b043-5d1052acaced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:48.581608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6a848-8fc3-425f-b043-5d1052acaced None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:48.595649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 637/1272] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:32:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:48.602973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63a013-dec6-4d94-a7c0-d83398230055 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:48.711234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:48.720366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63a013-dec6-4d94-a7c0-d83398230055 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:48.761059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1c2e3-0106-4c01-bb1a-4eb006bddc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:48.761851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c2e3-0106-4c01-bb1a-4eb006bddc39 None admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:48.762203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c2e3-0106-4c01-bb1a-4eb006bddc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:48.762505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1c2e3-0106-4c01-bb1a-4eb006bddc39 None admin] PATH_INFO: `/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/dca09f6fe11f4b878dd11c4cb69ca7c6/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:48.764903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c2e3-0106-4c01-bb1a-4eb006bddc39 None admin] RBAC: Authorizing `identity:create_grant(project_id=59c475b2231c4f6b8f81b7977c5672cd, user_id=dca09f6fe11f4b878dd11c4cb69ca7c6, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:48.766462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1c2e3-0106-4c01-bb1a-4eb006bddc39 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:48.925584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 636/1273] 10.222.0.83 () {58 vars in 1439 bytes} [Mon Aug 29 21:32:48 2022] PUT /identity/v3/projects/59c475b2231c4f6b8f81b7977c5672cd/users/dca09f6fe11f4b878dd11c4cb69ca7c6/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:32:50.972298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59827de-b064-48d7-b739-87c15b67300a None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:50.972891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59827de-b064-48d7-b739-87c15b67300a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:50.972891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59827de-b064-48d7-b739-87c15b67300a None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:50.974407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 638/1274] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:32:50.980916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd023291-072d-4040-90cc-4259870ed163 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:50.981488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd023291-072d-4040-90cc-4259870ed163 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:50.981488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd023291-072d-4040-90cc-4259870ed163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.002499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-bd023291-072d-4040-90cc-4259870ed163 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:51.003976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bd023291-072d-4040-90cc-4259870ed163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:51.094709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 637/1275] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 21:32:51.390698 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59827de-b064-48d7-b739-87c15b67300a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.516867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59827de-b064-48d7-b739-87c15b67300a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:51.539347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:51.558918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4038f-f1b3-4253-b54c-7e15c053fe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:51.559585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4038f-f1b3-4253-b54c-7e15c053fe22 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.559867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4038f-f1b3-4253-b54c-7e15c053fe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.560141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4038f-f1b3-4253-b54c-7e15c053fe22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.574655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4038f-f1b3-4253-b54c-7e15c053fe22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-d1f4038f-f1b3-4253-b54c-7e15c053fe22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 21:32:51.580283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:51.588381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:51.590110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 639/1276] 10.222.0.83 () {56 vars in 1096 bytes} [Mon Aug 29 21:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:51.591484 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd023291-072d-4040-90cc-4259870ed163 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.687032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:51.708377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd023291-072d-4040-90cc-4259870ed163 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:51.747657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f869ff-abdc-48e9-9aa5-06fcaedda4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:51.748586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f869ff-abdc-48e9-9aa5-06fcaedda4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.748998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f869ff-abdc-48e9-9aa5-06fcaedda4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.749391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f869ff-abdc-48e9-9aa5-06fcaedda4c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.750462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f869ff-abdc-48e9-9aa5-06fcaedda4c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:51.750935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f869ff-abdc-48e9-9aa5-06fcaedda4c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:51.753149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f869ff-abdc-48e9-9aa5-06fcaedda4c1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:51.768796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 638/1277] 10.222.0.83 () {56 vars in 1099 bytes} [Mon Aug 29 21:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:51.775880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4038f-f1b3-4253-b54c-7e15c053fe22 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:51.898726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4038f-f1b3-4253-b54c-7e15c053fe22 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:51.938548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be14d2-e401-455f-9e18-371ea15434ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:51.939103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be14d2-e401-455f-9e18-371ea15434ae None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:51.939480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be14d2-e401-455f-9e18-371ea15434ae None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:51.939754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be14d2-e401-455f-9e18-371ea15434ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:51.952044 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be14d2-e401-455f-9e18-371ea15434ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:51.953581 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be14d2-e401-455f-9e18-371ea15434ae None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-27be14d2-e401-455f-9e18-371ea15434ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:51.969848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:51.971625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:51.973376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:51.973376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:51.973376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:51.973376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 640/1278] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:51.979867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f869ff-abdc-48e9-9aa5-06fcaedda4c1 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:52.099902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f869ff-abdc-48e9-9aa5-06fcaedda4c1 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:52.140385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fdd53-28ce-4d4d-96cb-6c3f9c311f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:52.141046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fdd53-28ce-4d4d-96cb-6c3f9c311f0a None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:52.141327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fdd53-28ce-4d4d-96cb-6c3f9c311f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:52.141600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fdd53-28ce-4d4d-96cb-6c3f9c311f0a None admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:52.142289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fdd53-28ce-4d4d-96cb-6c3f9c311f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:52.142594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fdd53-28ce-4d4d-96cb-6c3f9c311f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:52.144030 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fdd53-28ce-4d4d-96cb-6c3f9c311f0a None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:52.158463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 639/1279] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:52.164949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be14d2-e401-455f-9e18-371ea15434ae None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:52.201455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:52.288347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be14d2-e401-455f-9e18-371ea15434ae None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:52.341820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaedad-d00a-45f0-b18a-37e5a2857fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:52.342488 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaedad-d00a-45f0-b18a-37e5a2857fab None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:52.342765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaedad-d00a-45f0-b18a-37e5a2857fab None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:52.343039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaaedad-d00a-45f0-b18a-37e5a2857fab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:52.351967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaaedad-d00a-45f0-b18a-37e5a2857fab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:52.353630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaaedad-d00a-45f0-b18a-37e5a2857fab None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-deaaedad-d00a-45f0-b18a-37e5a2857fab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 21:32:52.379125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:52.381110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:52.382970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 641/1280] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:32:52.392103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fdd53-28ce-4d4d-96cb-6c3f9c311f0a None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:52.396683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:52.518953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fdd53-28ce-4d4d-96cb-6c3f9c311f0a None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:52.561059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f4a5-7efc-4942-8079-5ec639f059e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:52.561748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f4a5-7efc-4942-8079-5ec639f059e3 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:52.562046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f4a5-7efc-4942-8079-5ec639f059e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:52.562324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f4a5-7efc-4942-8079-5ec639f059e3 None admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:52.563146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f4a5-7efc-4942-8079-5ec639f059e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:52.563452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f4a5-7efc-4942-8079-5ec639f059e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:52.564985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f4a5-7efc-4942-8079-5ec639f059e3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:52.585906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 640/1281] 10.222.0.83 () {56 vars in 1143 bytes} [Mon Aug 29 21:32:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:52.592446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaedad-d00a-45f0-b18a-37e5a2857fab None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:52.742772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:52.759786 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaaedad-d00a-45f0-b18a-37e5a2857fab None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:52.806366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aee70-d50f-4dcf-8cf7-946f4c86fa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:52.807035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aee70-d50f-4dcf-8cf7-946f4c86fa0e None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:52.807374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aee70-d50f-4dcf-8cf7-946f4c86fa0e None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:52.807877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0aee70-d50f-4dcf-8cf7-946f4c86fa0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:52.890820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0aee70-d50f-4dcf-8cf7-946f4c86fa0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:52.892323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0aee70-d50f-4dcf-8cf7-946f4c86fa0e None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:52.998341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:53.012729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 642/1282] 10.222.0.83 () {58 vars in 1282 bytes} [Mon Aug 29 21:32:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 21:32:53.025136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f4a5-7efc-4942-8079-5ec639f059e3 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:53.107252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:53.171000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f4a5-7efc-4942-8079-5ec639f059e3 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:53.230211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5f3e-0906-4e34-8168-50e1ffd509aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:53.231077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5f3e-0906-4e34-8168-50e1ffd509aa None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:53.231409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5f3e-0906-4e34-8168-50e1ffd509aa None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:53.231728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d5f3e-0906-4e34-8168-50e1ffd509aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:53.243501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d5f3e-0906-4e34-8168-50e1ffd509aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:53.245007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d5f3e-0906-4e34-8168-50e1ffd509aa None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-f42d5f3e-0906-4e34-8168-50e1ffd509aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 21:32:53.262663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:53.265047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 21:32:53.266995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 21:32:53.266995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 21:32:53.266995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:53.266995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 641/1283] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:32:53.274019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aee70-d50f-4dcf-8cf7-946f4c86fa0e None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:53.387577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0aee70-d50f-4dcf-8cf7-946f4c86fa0e None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:53.427888 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe16fc1-3f73-42d1-80b9-c20e6321a6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:53.428534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe16fc1-3f73-42d1-80b9-c20e6321a6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:53.428818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe16fc1-3f73-42d1-80b9-c20e6321a6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:53.429093 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe16fc1-3f73-42d1-80b9-c20e6321a6b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:53.430284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe16fc1-3f73-42d1-80b9-c20e6321a6b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:53.430695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe16fc1-3f73-42d1-80b9-c20e6321a6b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:53.432096 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe16fc1-3f73-42d1-80b9-c20e6321a6b9 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:53.446168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 643/1284] 10.222.0.83 () {56 vars in 1109 bytes} [Mon Aug 29 21:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:53.452015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5f3e-0906-4e34-8168-50e1ffd509aa None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:53.567154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d5f3e-0906-4e34-8168-50e1ffd509aa None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:53.583248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:53.609354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92848928-f6fc-4ddd-b5b6-3efab025ce3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:53.610352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92848928-f6fc-4ddd-b5b6-3efab025ce3c None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:53.610746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92848928-f6fc-4ddd-b5b6-3efab025ce3c None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:53.611159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92848928-f6fc-4ddd-b5b6-3efab025ce3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:53.623617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92848928-f6fc-4ddd-b5b6-3efab025ce3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:53.626461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92848928-f6fc-4ddd-b5b6-3efab025ce3c None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application [None req-92848928-f6fc-4ddd-b5b6-3efab025ce3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 21:32:53.648238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:53.650465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:53.652283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 21:32:53.652283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 21:32:53.652283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 21:32:53.652283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 21:32:53.652283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 21:32:53.652283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 21:32:53.652283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 21:32:53.652283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: ERROR keystone.server.flask.application Aug 29 21:32:53.656702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 642/1285] 10.222.0.83 () {56 vars in 1111 bytes} [Mon Aug 29 21:32:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:32:53.659840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe16fc1-3f73-42d1-80b9-c20e6321a6b9 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:53.747245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:53.807674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe16fc1-3f73-42d1-80b9-c20e6321a6b9 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:53.854273 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d5f72-e90e-4519-b6bf-8d78779e7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:53.854893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d5f72-e90e-4519-b6bf-8d78779e7c3b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:53.855173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d5f72-e90e-4519-b6bf-8d78779e7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:53.855447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d5f72-e90e-4519-b6bf-8d78779e7c3b None admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:53.856150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d5f72-e90e-4519-b6bf-8d78779e7c3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:53.856455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d5f72-e90e-4519-b6bf-8d78779e7c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:53.857961 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d5f72-e90e-4519-b6bf-8d78779e7c3b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:53.871815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 644/1286] 10.222.0.83 () {56 vars in 1148 bytes} [Mon Aug 29 21:32:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:53.878426 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92848928-f6fc-4ddd-b5b6-3efab025ce3c None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:53.991783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92848928-f6fc-4ddd-b5b6-3efab025ce3c None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:54.039567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ae22e-2efb-4c14-8b80-24192bdcd866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:54.040283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ae22e-2efb-4c14-8b80-24192bdcd866 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:54.040596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ae22e-2efb-4c14-8b80-24192bdcd866 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:54.040871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ae22e-2efb-4c14-8b80-24192bdcd866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:54.041615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ae22e-2efb-4c14-8b80-24192bdcd866 None admin] RBAC: Adding query filter params (role.id=c0316e22a13a4034846c451753b4c14e, scope.project.id=59c475b2231c4f6b8f81b7977c5672cd, user.id=dca09f6fe11f4b878dd11c4cb69ca7c6) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:54.041922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ae22e-2efb-4c14-8b80-24192bdcd866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:54.043524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ae22e-2efb-4c14-8b80-24192bdcd866 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:54.050331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 643/1287] 10.222.0.83 () {56 vars in 1374 bytes} [Mon Aug 29 21:32:53 2022] GET /identity/v3/role_assignments?user.id=dca09f6fe11f4b878dd11c4cb69ca7c6&scope.project.id=59c475b2231c4f6b8f81b7977c5672cd&role.id=c0316e22a13a4034846c451753b4c14e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:56.088719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11696b6-05ef-41f8-9ae4-8e252334ae64 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:56.089274 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11696b6-05ef-41f8-9ae4-8e252334ae64 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:56.089437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11696b6-05ef-41f8-9ae4-8e252334ae64 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:56.090854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 645/1288] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:56.097500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f9cc4-02e2-401a-8a97-d2d932cce16b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:56.098080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f9cc4-02e2-401a-8a97-d2d932cce16b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:56.103496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f9cc4-02e2-401a-8a97-d2d932cce16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:56.119453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-645f9cc4-02e2-401a-8a97-d2d932cce16b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:56.120758 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-645f9cc4-02e2-401a-8a97-d2d932cce16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:56.159523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:56.200911 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 644/1289] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:32:56.474381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11696b6-05ef-41f8-9ae4-8e252334ae64 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:56.596681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11696b6-05ef-41f8-9ae4-8e252334ae64 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:56.609756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:56.637402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddecc9-b161-4bf9-83aa-3c73854c0b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:56.638116 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddecc9-b161-4bf9-83aa-3c73854c0b57 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:56.638457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddecc9-b161-4bf9-83aa-3c73854c0b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:56.638797 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddecc9-b161-4bf9-83aa-3c73854c0b57 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:56.639445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddecc9-b161-4bf9-83aa-3c73854c0b57 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:56.641022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddecc9-b161-4bf9-83aa-3c73854c0b57 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-49ddecc9-b161-4bf9-83aa-3c73854c0b57 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:32:56.653202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:32:56.655193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:32:56.656339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 646/1290] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 21:32:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 21:32:56.664209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f9cc4-02e2-401a-8a97-d2d932cce16b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:56.827748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f9cc4-02e2-401a-8a97-d2d932cce16b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:56.866185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3cda20-3495-452d-add0-b298027bf0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:56.866802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cda20-3495-452d-add0-b298027bf0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:56.867104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cda20-3495-452d-add0-b298027bf0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:56.868026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3cda20-3495-452d-add0-b298027bf0e1 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:56.868710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cda20-3495-452d-add0-b298027bf0e1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:56.869009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cda20-3495-452d-add0-b298027bf0e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:56.870406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3cda20-3495-452d-add0-b298027bf0e1 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:56.876095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 645/1291] 10.222.0.83 () {56 vars in 1116 bytes} [Mon Aug 29 21:32:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:32:56.885076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddecc9-b161-4bf9-83aa-3c73854c0b57 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:57.043409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddecc9-b161-4bf9-83aa-3c73854c0b57 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:57.086534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dcb70-ebf6-4b64-ae62-faaca02bcee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:57.087138 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dcb70-ebf6-4b64-ae62-faaca02bcee2 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:57.087454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dcb70-ebf6-4b64-ae62-faaca02bcee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:57.087781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dcb70-ebf6-4b64-ae62-faaca02bcee2 None admin] PATH_INFO: `/v3/services` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:57.088471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dcb70-ebf6-4b64-ae62-faaca02bcee2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:32:57.088870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dcb70-ebf6-4b64-ae62-faaca02bcee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:57.090313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dcb70-ebf6-4b64-ae62-faaca02bcee2 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:57.095650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 647/1292] 10.222.0.83 () {56 vars in 1116 bytes} [Mon Aug 29 21:32:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:32:59.102245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47ff41-6c7d-4915-afe0-37a360c69b0f None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:59.102837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47ff41-6c7d-4915-afe0-37a360c69b0f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:59.102837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b47ff41-6c7d-4915-afe0-37a360c69b0f None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:59.104562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 646/1293] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:32:59.110853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be014e-743c-49cc-a1ce-c292a24d1bce None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:59.112672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be014e-743c-49cc-a1ce-c292a24d1bce None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:59.112672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be014e-743c-49cc-a1ce-c292a24d1bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:59.131344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-59be014e-743c-49cc-a1ce-c292a24d1bce None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:32:59.132587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-59be014e-743c-49cc-a1ce-c292a24d1bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:32:59.170579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:59.215226 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 648/1294] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:32:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:32:59.491597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47ff41-6c7d-4915-afe0-37a360c69b0f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:32:59.529863 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:32:59.613994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b47ff41-6c7d-4915-afe0-37a360c69b0f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:32:59.656980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5120e4-15ae-4b2c-ad01-77011636f6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:32:59.657601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5120e4-15ae-4b2c-ad01-77011636f6b3 None admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:32:59.657879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5120e4-15ae-4b2c-ad01-77011636f6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:32:59.658162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5120e4-15ae-4b2c-ad01-77011636f6b3 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:32:59.658837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5120e4-15ae-4b2c-ad01-77011636f6b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:32:59.660239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5120e4-15ae-4b2c-ad01-77011636f6b3 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:32:59.811505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 647/1295] 10.222.0.83 () {60 vars in 1141 bytes} [Mon Aug 29 21:32:59 2022] POST /identity/v3/services => generated 246 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:33:01.834339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2670ff-a04d-4081-bdc8-fff30ca1a0e4 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:01.834931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2670ff-a04d-4081-bdc8-fff30ca1a0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:01.834931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2670ff-a04d-4081-bdc8-fff30ca1a0e4 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:01.837208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 649/1296] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:01.843507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35e6c-d728-4946-97d0-39d1238566eb None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:01.844080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35e6c-d728-4946-97d0-39d1238566eb None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:01.844080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da35e6c-d728-4946-97d0-39d1238566eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:01.866985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7da35e6c-d728-4946-97d0-39d1238566eb None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:01.868283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7da35e6c-d728-4946-97d0-39d1238566eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:01.958458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 648/1297] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:33:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:33:02.229821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2670ff-a04d-4081-bdc8-fff30ca1a0e4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:02.349014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2670ff-a04d-4081-bdc8-fff30ca1a0e4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:02.394368 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cac6c-6cdb-44c7-8cf7-9c65e9db7bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:02.395357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cac6c-6cdb-44c7-8cf7-9c65e9db7bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:02.395830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cac6c-6cdb-44c7-8cf7-9c65e9db7bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:02.396312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cac6c-6cdb-44c7-8cf7-9c65e9db7bc6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:02.397448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cac6c-6cdb-44c7-8cf7-9c65e9db7bc6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:02.399831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cac6c-6cdb-44c7-8cf7-9c65e9db7bc6 None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-074cac6c-6cdb-44c7-8cf7-9c65e9db7bc6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:33:02.410237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:33:02.417306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:33:02.418197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 650/1298] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 21:33:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:33:02.420927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35e6c-d728-4946-97d0-39d1238566eb None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:02.457838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:02.592851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da35e6c-d728-4946-97d0-39d1238566eb None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:02.637634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48541fa-bdce-4f67-a7f6-5331b4aae2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:02.639561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48541fa-bdce-4f67-a7f6-5331b4aae2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:02.639561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48541fa-bdce-4f67-a7f6-5331b4aae2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:02.639561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48541fa-bdce-4f67-a7f6-5331b4aae2b2 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:02.639561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48541fa-bdce-4f67-a7f6-5331b4aae2b2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:33:02.640059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48541fa-bdce-4f67-a7f6-5331b4aae2b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:02.641176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48541fa-bdce-4f67-a7f6-5331b4aae2b2 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:02.648268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 649/1299] 10.222.0.83 () {56 vars in 1116 bytes} [Mon Aug 29 21:33:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:33:02.654675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cac6c-6cdb-44c7-8cf7-9c65e9db7bc6 None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:02.690778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:02.767694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cac6c-6cdb-44c7-8cf7-9c65e9db7bc6 None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:02.807824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67dd6d-0fe5-43ad-9c85-d33f8f719c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:02.808449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67dd6d-0fe5-43ad-9c85-d33f8f719c4b None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:02.808761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67dd6d-0fe5-43ad-9c85-d33f8f719c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:02.809032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67dd6d-0fe5-43ad-9c85-d33f8f719c4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:02.809753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67dd6d-0fe5-43ad-9c85-d33f8f719c4b None admin] RBAC: Adding query filter params (interface=public, service_id=b2ca6056263d4ecb92eaa4f9dd1c5b36, region_id=RegionOne) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:33:02.810061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67dd6d-0fe5-43ad-9c85-d33f8f719c4b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:02.811452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67dd6d-0fe5-43ad-9c85-d33f8f719c4b None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:02.818367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 651/1300] 10.222.0.83 () {56 vars in 1251 bytes} [Mon Aug 29 21:33:02 2022] GET /identity/v3/endpoints?service_id=b2ca6056263d4ecb92eaa4f9dd1c5b36&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:33:02.827603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48541fa-bdce-4f67-a7f6-5331b4aae2b2 None admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:02.922846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:02.943145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48541fa-bdce-4f67-a7f6-5331b4aae2b2 None admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:02.980873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518e72e-6728-4ad7-ac46-98c143ab7912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:02.981493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518e72e-6728-4ad7-ac46-98c143ab7912 None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:02.981768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518e72e-6728-4ad7-ac46-98c143ab7912 None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:02.982039 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518e72e-6728-4ad7-ac46-98c143ab7912 None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:02.982654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518e72e-6728-4ad7-ac46-98c143ab7912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:02.984044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518e72e-6728-4ad7-ac46-98c143ab7912 None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:02.991860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 650/1301] 10.222.0.83 () {56 vars in 1087 bytes} [Mon Aug 29 21:33:02 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:33:05.011253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0172549-ed45-45b8-a693-36ace78d69f9 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:05.011796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0172549-ed45-45b8-a693-36ace78d69f9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:05.012212 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0172549-ed45-45b8-a693-36ace78d69f9 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:05.014149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 652/1302] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:33:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:33:05.022232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dda9c-26e3-4141-a9ec-0987ed502ffc None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:05.023983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dda9c-26e3-4141-a9ec-0987ed502ffc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:05.023983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dda9c-26e3-4141-a9ec-0987ed502ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:05.044014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5c6dda9c-26e3-4141-a9ec-0987ed502ffc None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:33:05.045275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5c6dda9c-26e3-4141-a9ec-0987ed502ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:33:05.123757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 651/1303] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:33:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 21:33:05.398518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0172549-ed45-45b8-a693-36ace78d69f9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:05.521527 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:05.532978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0172549-ed45-45b8-a693-36ace78d69f9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:05.593367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bca49-807f-4429-881f-0933fdaa011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:05.594468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bca49-807f-4429-881f-0933fdaa011c None admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:05.594957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bca49-807f-4429-881f-0933fdaa011c None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:05.595438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bca49-807f-4429-881f-0933fdaa011c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:05.596543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bca49-807f-4429-881f-0933fdaa011c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:05.599175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bca49-807f-4429-881f-0933fdaa011c None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application [None req-825bca49-807f-4429-881f-0933fdaa011c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 21:33:05.610628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 21:33:05.612469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application with Lock( Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self._enter() Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application return self.creator() Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application created_value = creator( Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: ERROR keystone.server.flask.application Aug 29 21:33:05.614118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 653/1304] 10.222.0.83 () {56 vars in 1117 bytes} [Mon Aug 29 21:33:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 21:33:05.622210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dda9c-26e3-4141-a9ec-0987ed502ffc None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:05.724337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:05.766061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dda9c-26e3-4141-a9ec-0987ed502ffc None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:05.829184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f7ba-17c5-4ec6-8cd7-13cc4437f4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:05.829901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f7ba-17c5-4ec6-8cd7-13cc4437f4ba None admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:05.830241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f7ba-17c5-4ec6-8cd7-13cc4437f4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:05.830648 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f7ba-17c5-4ec6-8cd7-13cc4437f4ba None admin] PATH_INFO: `/v3/services` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:05.831485 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f7ba-17c5-4ec6-8cd7-13cc4437f4ba None admin] RBAC: Adding query filter params (name=placement) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:33:05.831960 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f7ba-17c5-4ec6-8cd7-13cc4437f4ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:05.833530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f7ba-17c5-4ec6-8cd7-13cc4437f4ba None admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:05.839896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 652/1305] 10.222.0.83 () {56 vars in 1116 bytes} [Mon Aug 29 21:33:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:33:05.849922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bca49-807f-4429-881f-0933fdaa011c None admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:33:05.968934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bca49-807f-4429-881f-0933fdaa011c None admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:33:06.006384 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70dc7a-4d2f-40ce-b42c-e33d671514ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:33:06.007077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dc7a-4d2f-40ce-b42c-e33d671514ea None admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:33:06.007419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dc7a-4d2f-40ce-b42c-e33d671514ea None admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:33:06.008354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dc7a-4d2f-40ce-b42c-e33d671514ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:33:06.009261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70dc7a-4d2f-40ce-b42c-e33d671514ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:33:06.010688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70dc7a-4d2f-40ce-b42c-e33d671514ea None admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:33:06.120259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 654/1306] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:33:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:33:15.836771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=30 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:33:16.114407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:36.569332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809509e0-2dbd-4aa2-84b4-a4fcb6bb2289 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:36.569950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809509e0-2dbd-4aa2-84b4-a4fcb6bb2289 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:36.569950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809509e0-2dbd-4aa2-84b4-a4fcb6bb2289 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:36.571224 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 653/1307] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:41:36.577614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cc707-aa94-4142-b18c-e1117a11b95e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:36.578936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cc707-aa94-4142-b18c-e1117a11b95e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:36.579383 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cc707-aa94-4142-b18c-e1117a11b95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:36.661018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9a8cc707-aa94-4142-b18c-e1117a11b95e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:36.663182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9a8cc707-aa94-4142-b18c-e1117a11b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:36.831084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 655/1308] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:37.126418 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d667d-977b-457f-ae80-04d926194778 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:37.126709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d667d-977b-457f-ae80-04d926194778 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:37.126982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d667d-977b-457f-ae80-04d926194778 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:37.128747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 654/1309] 10.222.0.83 () {54 vars in 965 bytes} [Mon Aug 29 21:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:41:37.136026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca0c27-91ca-4a04-b7f0-530fecc4c852 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:37.136775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca0c27-91ca-4a04-b7f0-530fecc4c852 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:37.137134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca0c27-91ca-4a04-b7f0-530fecc4c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:37.286964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d1ca0c27-91ca-4a04-b7f0-530fecc4c852 None None] MFA Rules not processed for user `2adcc3ba3bdf4b92bd719f60e0b263ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:37.288220 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d1ca0c27-91ca-4a04-b7f0-530fecc4c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:37.324844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:37.415421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 656/1310] 10.222.0.83 () {58 vars in 1062 bytes} [Mon Aug 29 21:41:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:37.424809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d667d-977b-457f-ae80-04d926194778 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:37.426605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-535d667d-977b-457f-ae80-04d926194778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:37.562356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d667d-977b-457f-ae80-04d926194778 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:37.678982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06520401-3570-402e-abdd-5409b49f1ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:37.679963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06520401-3570-402e-abdd-5409b49f1ede service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:37.681396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06520401-3570-402e-abdd-5409b49f1ede service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:37.681396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06520401-3570-402e-abdd-5409b49f1ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:37.684196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-06520401-3570-402e-abdd-5409b49f1ede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:37.785182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:37.857524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06520401-3570-402e-abdd-5409b49f1ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:37.859073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06520401-3570-402e-abdd-5409b49f1ede service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:37.884937 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 655/1311] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:40.292727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2663da-8952-4b1f-b9b0-6b521722918e None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.293383 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2663da-8952-4b1f-b9b0-6b521722918e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.293383 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2663da-8952-4b1f-b9b0-6b521722918e None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.294714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 657/1312] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:41:40.301274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cf7e7-7803-4521-9c67-abc860bc7a2a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:40.301838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cf7e7-7803-4521-9c67-abc860bc7a2a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:40.301838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0cf7e7-7803-4521-9c67-abc860bc7a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:40.400862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0b0cf7e7-7803-4521-9c67-abc860bc7a2a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:40.402145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0b0cf7e7-7803-4521-9c67-abc860bc7a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:40.520662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 656/1313] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:40.818393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2663da-8952-4b1f-b9b0-6b521722918e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:40.819938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-db2663da-8952-4b1f-b9b0-6b521722918e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:40.951764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2663da-8952-4b1f-b9b0-6b521722918e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:41.065755 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:41.069541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83404df9-45ad-4a5a-8419-307808b6048a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:41.070302 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404df9-45ad-4a5a-8419-307808b6048a service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:41.070729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404df9-45ad-4a5a-8419-307808b6048a service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:41.071092 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83404df9-45ad-4a5a-8419-307808b6048a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:41.073109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-83404df9-45ad-4a5a-8419-307808b6048a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:41.252825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83404df9-45ad-4a5a-8419-307808b6048a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:41.254546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83404df9-45ad-4a5a-8419-307808b6048a service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:41.281718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 658/1314] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:43.910361 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747e85a-3f8a-419e-9e03-354430bdb6af None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:43.910920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747e85a-3f8a-419e-9e03-354430bdb6af None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:43.910920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747e85a-3f8a-419e-9e03-354430bdb6af None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:43.912263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 657/1315] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:41:43.917629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93604ed-11a7-4295-8412-8b8a71ded1cd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:43.918140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93604ed-11a7-4295-8412-8b8a71ded1cd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:43.918239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93604ed-11a7-4295-8412-8b8a71ded1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:43.995649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e93604ed-11a7-4295-8412-8b8a71ded1cd None None] MFA Rules not processed for user `688f54c8b16b4188b4bc42b526a8f4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:43.996954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e93604ed-11a7-4295-8412-8b8a71ded1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:44.056247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:44.105767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 659/1316] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:41:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:44.409459 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747e85a-3f8a-419e-9e03-354430bdb6af None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:44.411015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d747e85a-3f8a-419e-9e03-354430bdb6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:44.420771 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:44.520619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747e85a-3f8a-419e-9e03-354430bdb6af None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:44.597029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5229f7af-8583-4cbb-bf02-72057036013b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:44.597638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229f7af-8583-4cbb-bf02-72057036013b service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:44.597917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229f7af-8583-4cbb-bf02-72057036013b service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:44.598186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5229f7af-8583-4cbb-bf02-72057036013b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:44.599796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5229f7af-8583-4cbb-bf02-72057036013b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:44.666599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:44.717880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229f7af-8583-4cbb-bf02-72057036013b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:44.719717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5229f7af-8583-4cbb-bf02-72057036013b service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:44.741123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 658/1317] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:47.607729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bca471-6c01-4169-8078-c6d9e92571fc None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.608420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bca471-6c01-4169-8078-c6d9e92571fc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.608420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bca471-6c01-4169-8078-c6d9e92571fc None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.609754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 660/1318] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:41:47.616790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f378b9-49b0-41e8-8425-25ff115c12e3 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:47.617307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f378b9-49b0-41e8-8425-25ff115c12e3 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:47.617638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f378b9-49b0-41e8-8425-25ff115c12e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:47.697864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-96f378b9-49b0-41e8-8425-25ff115c12e3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:47.699088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-96f378b9-49b0-41e8-8425-25ff115c12e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:47.800687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 659/1319] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:48.112170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca5d13-3307-417d-9aaa-5ecf592c8d88 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:48.113101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca5d13-3307-417d-9aaa-5ecf592c8d88 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:48.113381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca5d13-3307-417d-9aaa-5ecf592c8d88 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:48.114911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 661/1320] 10.222.0.83 () {54 vars in 965 bytes} [Mon Aug 29 21:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:41:48.121023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fe0a9-75c1-4ac5-ba65-63887f427755 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:48.121334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fe0a9-75c1-4ac5-ba65-63887f427755 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:48.121605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fe0a9-75c1-4ac5-ba65-63887f427755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:48.144013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:48.202016 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0b7fe0a9-75c1-4ac5-ba65-63887f427755 None None] MFA Rules not processed for user `2adcc3ba3bdf4b92bd719f60e0b263ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:48.203285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0b7fe0a9-75c1-4ac5-ba65-63887f427755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:48.285108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 660/1321] 10.222.0.83 () {58 vars in 1062 bytes} [Mon Aug 29 21:41:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:48.294457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca5d13-3307-417d-9aaa-5ecf592c8d88 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:48.296108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e2ca5d13-3307-417d-9aaa-5ecf592c8d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:48.412202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca5d13-3307-417d-9aaa-5ecf592c8d88 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:48.488200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a38c56-fe83-4eec-95dd-8696ea826a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:48.488837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a38c56-fe83-4eec-95dd-8696ea826a3f service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:48.489112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a38c56-fe83-4eec-95dd-8696ea826a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:48.489378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a38c56-fe83-4eec-95dd-8696ea826a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:48.490966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-06a38c56-fe83-4eec-95dd-8696ea826a3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:48.498691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:48.605195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a38c56-fe83-4eec-95dd-8696ea826a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:48.606545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a38c56-fe83-4eec-95dd-8696ea826a3f service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:48.625049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 662/1322] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:52.245276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c84678-d75a-4fac-a1aa-89437bbfd992 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:52.245817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c84678-d75a-4fac-a1aa-89437bbfd992 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:52.245817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c84678-d75a-4fac-a1aa-89437bbfd992 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:52.247173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 661/1323] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:41:52.252947 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ad51-adba-4717-ac8d-aea6115041dd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:52.254222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ad51-adba-4717-ac8d-aea6115041dd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:52.254222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ad51-adba-4717-ac8d-aea6115041dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:52.330376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ee50ad51-adba-4717-ac8d-aea6115041dd None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:52.331584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ee50ad51-adba-4717-ac8d-aea6115041dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:52.400200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:52.456163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 663/1324] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:41:52.765232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c84678-d75a-4fac-a1aa-89437bbfd992 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:52.767341 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b3c84678-d75a-4fac-a1aa-89437bbfd992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:52.906688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c84678-d75a-4fac-a1aa-89437bbfd992 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:52.921535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:52.993294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8982e-f911-4319-bb9d-97e3d3f256b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:52.993903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8982e-f911-4319-bb9d-97e3d3f256b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:52.994188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8982e-f911-4319-bb9d-97e3d3f256b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:52.994459 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8982e-f911-4319-bb9d-97e3d3f256b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:53.000239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fcf8982e-f911-4319-bb9d-97e3d3f256b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:53.159504 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8982e-f911-4319-bb9d-97e3d3f256b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:53.159504 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8982e-f911-4319-bb9d-97e3d3f256b5 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:53.167332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 662/1325] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:41:55.231587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af9950-24cd-4fc3-b349-f73ccc0a5c8a None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.232181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af9950-24cd-4fc3-b349-f73ccc0a5c8a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.232181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af9950-24cd-4fc3-b349-f73ccc0a5c8a None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.233577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 664/1326] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:41:55.240141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50209e-1328-414e-b648-3f15b4786912 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.240752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50209e-1328-414e-b648-3f15b4786912 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.240752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50209e-1328-414e-b648-3f15b4786912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.296963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:55.318467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-bd50209e-1328-414e-b648-3f15b4786912 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:55.319822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bd50209e-1328-414e-b648-3f15b4786912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:55.430332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 663/1327] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:55.719927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af9950-24cd-4fc3-b349-f73ccc0a5c8a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:55.721590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b3af9950-24cd-4fc3-b349-f73ccc0a5c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:55.843656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af9950-24cd-4fc3-b349-f73ccc0a5c8a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:55.930822 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4641232-5213-4926-8cde-e07e1bdb75a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:55.931444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4641232-5213-4926-8cde-e07e1bdb75a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:55.931722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4641232-5213-4926-8cde-e07e1bdb75a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:55.931997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4641232-5213-4926-8cde-e07e1bdb75a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:55.933748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b4641232-5213-4926-8cde-e07e1bdb75a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:55.952043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:56.091046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4641232-5213-4926-8cde-e07e1bdb75a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:56.093758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4641232-5213-4926-8cde-e07e1bdb75a3 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:56.119297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 665/1328] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:41:58.198897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92f89-deed-46df-9479-c8ae23d57b4f None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:58.199437 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92f89-deed-46df-9479-c8ae23d57b4f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:58.199437 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f92f89-deed-46df-9479-c8ae23d57b4f None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:58.200850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 664/1329] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:41:58.207285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760913f4-1627-4ac2-988d-dacaf7c41f0c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:58.207783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760913f4-1627-4ac2-988d-dacaf7c41f0c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:58.207897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760913f4-1627-4ac2-988d-dacaf7c41f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:58.302476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-760913f4-1627-4ac2-988d-dacaf7c41f0c None None] MFA Rules not processed for user `688f54c8b16b4188b4bc42b526a8f4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:41:58.305111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-760913f4-1627-4ac2-988d-dacaf7c41f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:58.384419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:58.423894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 666/1330] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:41:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:41:58.732754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f92f89-deed-46df-9479-c8ae23d57b4f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:41:58.734398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-00f92f89-deed-46df-9479-c8ae23d57b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:58.866120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f92f89-deed-46df-9479-c8ae23d57b4f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:41:58.890390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:41:58.958912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8792e2-ae59-4ae3-b8cc-0d747f6b1de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:41:58.959526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8792e2-ae59-4ae3-b8cc-0d747f6b1de7 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:41:58.959834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8792e2-ae59-4ae3-b8cc-0d747f6b1de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:41:58.960105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8792e2-ae59-4ae3-b8cc-0d747f6b1de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:41:58.962041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-1d8792e2-ae59-4ae3-b8cc-0d747f6b1de7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:41:59.107441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8792e2-ae59-4ae3-b8cc-0d747f6b1de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:41:59.109091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8792e2-ae59-4ae3-b8cc-0d747f6b1de7 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:41:59.131422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 665/1331] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:41:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:01.562390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ea3d3-1089-4503-b6cc-33290735b2b1 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:01.562979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ea3d3-1089-4503-b6cc-33290735b2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:01.562979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ea3d3-1089-4503-b6cc-33290735b2b1 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:01.564329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 667/1332] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:01.570308 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f08a22-c3b4-473f-9fdd-10da3baf9d74 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:01.570844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f08a22-c3b4-473f-9fdd-10da3baf9d74 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:01.570844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f08a22-c3b4-473f-9fdd-10da3baf9d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:01.642441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:01.645997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b3f08a22-c3b4-473f-9fdd-10da3baf9d74 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:01.647222 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b3f08a22-c3b4-473f-9fdd-10da3baf9d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:01.747503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 666/1333] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:02.031824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ea3d3-1089-4503-b6cc-33290735b2b1 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:02.033348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f66ea3d3-1089-4503-b6cc-33290735b2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.137557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ea3d3-1089-4503-b6cc-33290735b2b1 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:02.211308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386c603-b692-4e6c-9caa-7cdbae455faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:02.211913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386c603-b692-4e6c-9caa-7cdbae455faf service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:02.212188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386c603-b692-4e6c-9caa-7cdbae455faf service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:02.212458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386c603-b692-4e6c-9caa-7cdbae455faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:02.214077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6386c603-b692-4e6c-9caa-7cdbae455faf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:02.244173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:02.328808 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386c603-b692-4e6c-9caa-7cdbae455faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:02.330969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386c603-b692-4e6c-9caa-7cdbae455faf service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:02.350083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 668/1334] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:04.359520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6d4b9-5b15-42ed-a059-704cfde36c1c None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:04.360066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6d4b9-5b15-42ed-a059-704cfde36c1c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:04.360066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6d4b9-5b15-42ed-a059-704cfde36c1c None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:04.361398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 667/1335] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:04.367228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6402e-53e6-45a7-a913-f58cfb5c3a78 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:04.368058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6402e-53e6-45a7-a913-f58cfb5c3a78 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:04.368058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6402e-53e6-45a7-a913-f58cfb5c3a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:04.443854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-18f6402e-53e6-45a7-a913-f58cfb5c3a78 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:04.445101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-18f6402e-53e6-45a7-a913-f58cfb5c3a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:04.523079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:04.547633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 669/1336] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:04.854539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6d4b9-5b15-42ed-a059-704cfde36c1c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:04.856069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-50f6d4b9-5b15-42ed-a059-704cfde36c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:04.969717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6d4b9-5b15-42ed-a059-704cfde36c1c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:05.002642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:05.053948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69109fe2-904d-4a11-ae4d-8cd6f3d20de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:05.054595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69109fe2-904d-4a11-ae4d-8cd6f3d20de8 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:05.054888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69109fe2-904d-4a11-ae4d-8cd6f3d20de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:05.055156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69109fe2-904d-4a11-ae4d-8cd6f3d20de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:05.056835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-69109fe2-904d-4a11-ae4d-8cd6f3d20de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:05.172526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69109fe2-904d-4a11-ae4d-8cd6f3d20de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:05.173872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69109fe2-904d-4a11-ae4d-8cd6f3d20de8 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:05.192764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 668/1337] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:42:08.009251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ae8c4-2e03-4fba-b05d-286595ccb1be None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:08.009689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ae8c4-2e03-4fba-b05d-286595ccb1be None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:08.009820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ae8c4-2e03-4fba-b05d-286595ccb1be None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:08.011208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 670/1338] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:08.017588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d560a-590f-429c-b946-3e861f1e53fc None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:08.018325 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d560a-590f-429c-b946-3e861f1e53fc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:08.018325 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d560a-590f-429c-b946-3e861f1e53fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:08.093815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5a3d560a-590f-429c-b946-3e861f1e53fc None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:08.095027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5a3d560a-590f-429c-b946-3e861f1e53fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:08.103843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:08.205456 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 669/1339] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:08.493951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ae8c4-2e03-4fba-b05d-286595ccb1be None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:08.495557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-893ae8c4-2e03-4fba-b05d-286595ccb1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:08.608427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ae8c4-2e03-4fba-b05d-286595ccb1be None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:08.683976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d989c-edad-4f39-9ac8-1303d7ad6ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:08.684511 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d989c-edad-4f39-9ac8-1303d7ad6ebc service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:08.684799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d989c-edad-4f39-9ac8-1303d7ad6ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:08.685071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d989c-edad-4f39-9ac8-1303d7ad6ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:08.686659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fb0d989c-edad-4f39-9ac8-1303d7ad6ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:08.724216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:08.798724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d989c-edad-4f39-9ac8-1303d7ad6ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:08.800155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0d989c-edad-4f39-9ac8-1303d7ad6ebc service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:08.820741 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 671/1340] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:42:13.257790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851ff0-dccb-4305-84bb-824857368221 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:13.258556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851ff0-dccb-4305-84bb-824857368221 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:13.258556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84851ff0-dccb-4305-84bb-824857368221 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:13.259737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 670/1341] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:13.265884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17956c-31f7-4c52-bec3-6e5c0a12ed0f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:13.266464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17956c-31f7-4c52-bec3-6e5c0a12ed0f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:13.266464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17956c-31f7-4c52-bec3-6e5c0a12ed0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:13.339275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9b17956c-31f7-4c52-bec3-6e5c0a12ed0f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:13.340543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9b17956c-31f7-4c52-bec3-6e5c0a12ed0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:13.447361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:13.466059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 672/1342] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:13.745951 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84851ff0-dccb-4305-84bb-824857368221 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:13.747492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-84851ff0-dccb-4305-84bb-824857368221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:13.860335 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84851ff0-dccb-4305-84bb-824857368221 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:13.907282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:13.946366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f1737b-f80a-4b8c-b6df-50e3d882b879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:13.947086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1737b-f80a-4b8c-b6df-50e3d882b879 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:13.947419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1737b-f80a-4b8c-b6df-50e3d882b879 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:13.947693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f1737b-f80a-4b8c-b6df-50e3d882b879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:13.949349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f7f1737b-f80a-4b8c-b6df-50e3d882b879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:14.071794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1737b-f80a-4b8c-b6df-50e3d882b879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:14.072799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f1737b-f80a-4b8c-b6df-50e3d882b879 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:14.093522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 671/1343] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:17.136379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade01919-924e-462b-b26e-5927a40f9cbc None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:17.136992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade01919-924e-462b-b26e-5927a40f9cbc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:17.137525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade01919-924e-462b-b26e-5927a40f9cbc None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:17.140539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 673/1344] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:17.146517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a8a50-e1c0-45cb-87ce-870de2445b4e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:17.147345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a8a50-e1c0-45cb-87ce-870de2445b4e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:17.147345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a8a50-e1c0-45cb-87ce-870de2445b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:17.222970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-bf1a8a50-e1c0-45cb-87ce-870de2445b4e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:17.224048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bf1a8a50-e1c0-45cb-87ce-870de2445b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:17.245458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:17.359353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 672/1345] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:17.656732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade01919-924e-462b-b26e-5927a40f9cbc None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:17.658600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ade01919-924e-462b-b26e-5927a40f9cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:17.810382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade01919-924e-462b-b26e-5927a40f9cbc None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:17.898590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc862a4-1b4e-43c2-94bc-a3606cc30270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:17.899215 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc862a4-1b4e-43c2-94bc-a3606cc30270 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:17.899489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc862a4-1b4e-43c2-94bc-a3606cc30270 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:17.899757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc862a4-1b4e-43c2-94bc-a3606cc30270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:17.901563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3bc862a4-1b4e-43c2-94bc-a3606cc30270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:17.955322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:18.049184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc862a4-1b4e-43c2-94bc-a3606cc30270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:18.050667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc862a4-1b4e-43c2-94bc-a3606cc30270 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:18.071547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 674/1346] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:22.918170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1e3f7-0a68-4bc7-8e87-b42b663d7174 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:22.918688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1e3f7-0a68-4bc7-8e87-b42b663d7174 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:22.918688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1e3f7-0a68-4bc7-8e87-b42b663d7174 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:22.920065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 673/1347] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:22.926989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f7f3c-1e1f-4c11-978d-ac7156440981 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:22.927503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f7f3c-1e1f-4c11-978d-ac7156440981 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:22.927769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f7f3c-1e1f-4c11-978d-ac7156440981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:23.001206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-216f7f3c-1e1f-4c11-978d-ac7156440981 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:23.002449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-216f7f3c-1e1f-4c11-978d-ac7156440981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:23.124323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:23.127400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 675/1348] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:23.420037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1e3f7-0a68-4bc7-8e87-b42b663d7174 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:23.421757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-deb1e3f7-0a68-4bc7-8e87-b42b663d7174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:23.566741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1e3f7-0a68-4bc7-8e87-b42b663d7174 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:23.623016 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:23.652378 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e75f6-2095-4c4c-a349-1387f8f137e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:23.653191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e75f6-2095-4c4c-a349-1387f8f137e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:23.653507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e75f6-2095-4c4c-a349-1387f8f137e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:23.653815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e75f6-2095-4c4c-a349-1387f8f137e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:23.655534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-230e75f6-2095-4c4c-a349-1387f8f137e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:23.773396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e75f6-2095-4c4c-a349-1387f8f137e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:23.774892 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e75f6-2095-4c4c-a349-1387f8f137e5 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:23.793947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 674/1349] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:29.031558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3b26-5c83-4092-8c1a-6bce69fb93ae None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:29.032128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3b26-5c83-4092-8c1a-6bce69fb93ae None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:29.032551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd3b26-5c83-4092-8c1a-6bce69fb93ae None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:29.035767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 676/1350] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:42:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:29.042983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce877a-b442-4c81-a813-b216ec09ffb0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:29.043789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce877a-b442-4c81-a813-b216ec09ffb0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:29.043789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce877a-b442-4c81-a813-b216ec09ffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:29.155052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b4ce877a-b442-4c81-a813-b216ec09ffb0 None None] MFA Rules not processed for user `dca09f6fe11f4b878dd11c4cb69ca7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:29.157019 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b4ce877a-b442-4c81-a813-b216ec09ffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:29.192743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:29.309697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 675/1351] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:42:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:33.929180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f22286-e91d-442f-9e37-f20e3e447e07 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:33.929694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f22286-e91d-442f-9e37-f20e3e447e07 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:33.929694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f22286-e91d-442f-9e37-f20e3e447e07 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:33.931004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 677/1352] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:33.936868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46357c-6a7e-41b8-b8bb-6c2163b2700f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:33.937631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46357c-6a7e-41b8-b8bb-6c2163b2700f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:33.937804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46357c-6a7e-41b8-b8bb-6c2163b2700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:34.039623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9e46357c-6a7e-41b8-b8bb-6c2163b2700f None None] MFA Rules not processed for user `dca09f6fe11f4b878dd11c4cb69ca7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:34.041307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9e46357c-6a7e-41b8-b8bb-6c2163b2700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:34.149859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:34.200856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 676/1353] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:42:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:35.588615 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c4af-e2bc-4744-8225-47a836ddd710 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:35.589201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c4af-e2bc-4744-8225-47a836ddd710 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:35.589366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7c4af-e2bc-4744-8225-47a836ddd710 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:35.590773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 678/1354] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:35.596299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d2552-fec2-4492-b2c1-41a2d735800d None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:35.596792 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d2552-fec2-4492-b2c1-41a2d735800d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:35.596909 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d2552-fec2-4492-b2c1-41a2d735800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:35.685026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-404d2552-fec2-4492-b2c1-41a2d735800d None None] MFA Rules not processed for user `dca09f6fe11f4b878dd11c4cb69ca7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:35.686258 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-404d2552-fec2-4492-b2c1-41a2d735800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:35.811319 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 677/1355] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:42:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:39.199378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64046910-49a4-4d6e-b574-2ea79411c12d None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:39.199879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64046910-49a4-4d6e-b574-2ea79411c12d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:39.199879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64046910-49a4-4d6e-b574-2ea79411c12d None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:39.201335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 679/1356] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:39.206770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042edbc5-7341-4051-a3f4-a6984214b513 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:39.207256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042edbc5-7341-4051-a3f4-a6984214b513 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:39.207461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042edbc5-7341-4051-a3f4-a6984214b513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:39.245313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:39.280205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-042edbc5-7341-4051-a3f4-a6984214b513 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:39.281668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-042edbc5-7341-4051-a3f4-a6984214b513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:39.393798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 678/1357] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:39.713385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ab338-1d5f-4b17-8523-f2023c4033bb None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:39.714022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ab338-1d5f-4b17-8523-f2023c4033bb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:39.714672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ab338-1d5f-4b17-8523-f2023c4033bb None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:39.718164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 680/1358] 10.222.0.83 () {54 vars in 962 bytes} [Mon Aug 29 21:42:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:39.727834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043abaa2-f513-4fcb-8ccc-2704d28a41b2 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:39.730122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043abaa2-f513-4fcb-8ccc-2704d28a41b2 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:39.730122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043abaa2-f513-4fcb-8ccc-2704d28a41b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:39.824419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-043abaa2-f513-4fcb-8ccc-2704d28a41b2 None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:39.826054 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-043abaa2-f513-4fcb-8ccc-2704d28a41b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:39.893314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:39.991243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 679/1359] 10.222.0.83 () {58 vars in 1059 bytes} [Mon Aug 29 21:42:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:39.999275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ab338-1d5f-4b17-8523-f2023c4033bb None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:40.001117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e86ab338-1d5f-4b17-8523-f2023c4033bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:40.179755 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ab338-1d5f-4b17-8523-f2023c4033bb None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:40.263969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:40.318833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6cc5b-8e86-4da9-9d0a-0412d4518eb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:40.319634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6cc5b-8e86-4da9-9d0a-0412d4518eb0 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:40.320012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6cc5b-8e86-4da9-9d0a-0412d4518eb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:40.320386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6cc5b-8e86-4da9-9d0a-0412d4518eb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:40.322268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-22e6cc5b-8e86-4da9-9d0a-0412d4518eb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:40.427032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6cc5b-8e86-4da9-9d0a-0412d4518eb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:40.429080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6cc5b-8e86-4da9-9d0a-0412d4518eb0 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:40.457672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 681/1360] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:42.655443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197b94a-7d45-40ec-aac3-04626742c69e None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:42.656281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197b94a-7d45-40ec-aac3-04626742c69e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:42.656281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197b94a-7d45-40ec-aac3-04626742c69e None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:42.657685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 680/1361] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:42.663834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668cf01-dea0-4d8f-91c0-5cd0a1828909 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:42.664331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668cf01-dea0-4d8f-91c0-5cd0a1828909 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:42.664428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668cf01-dea0-4d8f-91c0-5cd0a1828909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:42.745307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5668cf01-dea0-4d8f-91c0-5cd0a1828909 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:42.746576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5668cf01-dea0-4d8f-91c0-5cd0a1828909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:42.813039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:42.921957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 682/1362] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:43.398198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197b94a-7d45-40ec-aac3-04626742c69e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:43.399649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c197b94a-7d45-40ec-aac3-04626742c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:43.584624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197b94a-7d45-40ec-aac3-04626742c69e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:43.598277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:43.737069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488bc52-b75e-4b0a-bd51-a7dbac4b6d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:43.738011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488bc52-b75e-4b0a-bd51-a7dbac4b6d4b service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:43.738011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488bc52-b75e-4b0a-bd51-a7dbac4b6d4b service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:43.738996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488bc52-b75e-4b0a-bd51-a7dbac4b6d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:43.740538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9488bc52-b75e-4b0a-bd51-a7dbac4b6d4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:43.877063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488bc52-b75e-4b0a-bd51-a7dbac4b6d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:43.878789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488bc52-b75e-4b0a-bd51-a7dbac4b6d4b service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:43.902873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 681/1363] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:46.446637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c21c50-143d-460c-a66f-dbf0c4f8033b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.447427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c21c50-143d-460c-a66f-dbf0c4f8033b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.447427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c21c50-143d-460c-a66f-dbf0c4f8033b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.448440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 683/1364] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:42:46.454496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8b400-8321-4a12-9cc8-ce0b3048b813 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.455253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8b400-8321-4a12-9cc8-ce0b3048b813 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.455253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8b400-8321-4a12-9cc8-ce0b3048b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.472029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:46.545703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-a8d8b400-8321-4a12-9cc8-ce0b3048b813 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:46.548198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a8d8b400-8321-4a12-9cc8-ce0b3048b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:46.680823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 682/1365] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:46.981423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a52fbc-9e3b-4069-809c-081a90c16327 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.981704 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a52fbc-9e3b-4069-809c-081a90c16327 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.981976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a52fbc-9e3b-4069-809c-081a90c16327 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:46.983473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 684/1366] 10.222.0.83 () {54 vars in 962 bytes} [Mon Aug 29 21:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:46.990616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389761e-d935-4274-8790-7ad410836c49 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:46.990898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389761e-d935-4274-8790-7ad410836c49 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:46.991164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389761e-d935-4274-8790-7ad410836c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:47.087555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e389761e-d935-4274-8790-7ad410836c49 None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:47.088980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e389761e-d935-4274-8790-7ad410836c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:47.142594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:47.248108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 683/1367] 10.222.0.83 () {58 vars in 1059 bytes} [Mon Aug 29 21:42:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:42:47.263417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a52fbc-9e3b-4069-809c-081a90c16327 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:47.265026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-50a52fbc-9e3b-4069-809c-081a90c16327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:47.463422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a52fbc-9e3b-4069-809c-081a90c16327 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:47.491329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:47.625325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90278ed-7b31-4f72-9d7c-cafc5f04894d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:47.625874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90278ed-7b31-4f72-9d7c-cafc5f04894d service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:47.626138 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90278ed-7b31-4f72-9d7c-cafc5f04894d service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:47.626440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90278ed-7b31-4f72-9d7c-cafc5f04894d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:47.628165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f90278ed-7b31-4f72-9d7c-cafc5f04894d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:47.777892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90278ed-7b31-4f72-9d7c-cafc5f04894d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:47.781137 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90278ed-7b31-4f72-9d7c-cafc5f04894d service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:47.812340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 685/1368] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:48.244234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd177408-6535-4e31-bba8-7119c1b9aecd None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:48.244986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd177408-6535-4e31-bba8-7119c1b9aecd None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:48.244986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd177408-6535-4e31-bba8-7119c1b9aecd None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:48.246611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 684/1369] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:48.252545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c2828-b06e-406e-a168-a09fa39f4f83 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:48.252833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c2828-b06e-406e-a168-a09fa39f4f83 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:48.253110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c2828-b06e-406e-a168-a09fa39f4f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:48.299487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:48.352926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-842c2828-b06e-406e-a168-a09fa39f4f83 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:48.354325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-842c2828-b06e-406e-a168-a09fa39f4f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:48.474893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 686/1370] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:49.055907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a6de1-2a17-48fb-ae56-d4380fb14cc8 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:49.056401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a6de1-2a17-48fb-ae56-d4380fb14cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:49.056848 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a6de1-2a17-48fb-ae56-d4380fb14cc8 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:49.058923 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 685/1371] 10.222.0.83 () {54 vars in 964 bytes} [Mon Aug 29 21:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:49.065462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f93a9-7f2c-493a-afe2-fd91f1d20faf None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:49.065912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f93a9-7f2c-493a-afe2-fd91f1d20faf None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:49.066353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f93a9-7f2c-493a-afe2-fd91f1d20faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:49.159319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-958f93a9-7f2c-493a-afe2-fd91f1d20faf None None] MFA Rules not processed for user `edf63df08ae14d09b5cbdb102d6609ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:49.161454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-958f93a9-7f2c-493a-afe2-fd91f1d20faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:49.218850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:49.255642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 687/1372] 10.222.0.83 () {58 vars in 1061 bytes} [Mon Aug 29 21:42:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:49.265303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a6de1-2a17-48fb-ae56-d4380fb14cc8 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:49.268129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ab2a6de1-2a17-48fb-ae56-d4380fb14cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:49.392087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a6de1-2a17-48fb-ae56-d4380fb14cc8 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:49.435566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:49.478853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83802028-57c5-452d-b09d-8b54a5ab8049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:49.479466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802028-57c5-452d-b09d-8b54a5ab8049 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:49.479822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802028-57c5-452d-b09d-8b54a5ab8049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:49.480002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83802028-57c5-452d-b09d-8b54a5ab8049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:49.486471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-83802028-57c5-452d-b09d-8b54a5ab8049 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:49.611854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83802028-57c5-452d-b09d-8b54a5ab8049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:49.616820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83802028-57c5-452d-b09d-8b54a5ab8049 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:49.638492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 686/1373] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:42:50.040474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2b626-761e-4ff1-922b-9f5d78248922 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:50.041183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2b626-761e-4ff1-922b-9f5d78248922 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:50.041183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2b626-761e-4ff1-922b-9f5d78248922 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:50.042416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 688/1374] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:50.049683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0e199-38b1-4915-bd09-eaff926d2b67 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:50.050149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0e199-38b1-4915-bd09-eaff926d2b67 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:50.050355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0e199-38b1-4915-bd09-eaff926d2b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:50.133042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-74c0e199-38b1-4915-bd09-eaff926d2b67 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:50.134349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-74c0e199-38b1-4915-bd09-eaff926d2b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:50.159153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:50.259457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 687/1375] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:50.562813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2b626-761e-4ff1-922b-9f5d78248922 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:50.564680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bfb2b626-761e-4ff1-922b-9f5d78248922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:50.732716 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2b626-761e-4ff1-922b-9f5d78248922 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:50.784419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:50.867199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794440f0-2d9b-435b-84ae-23413ce79fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:50.867718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794440f0-2d9b-435b-84ae-23413ce79fc1 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:50.868000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794440f0-2d9b-435b-84ae-23413ce79fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:50.868268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794440f0-2d9b-435b-84ae-23413ce79fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:50.869930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-794440f0-2d9b-435b-84ae-23413ce79fc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:50.986437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794440f0-2d9b-435b-84ae-23413ce79fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:50.988043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794440f0-2d9b-435b-84ae-23413ce79fc1 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:51.008573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 689/1376] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:42:53.629528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9d18d-d734-4589-98a5-b8bfc5b707e7 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:53.630060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9d18d-d734-4589-98a5-b8bfc5b707e7 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:53.630265 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9d18d-d734-4589-98a5-b8bfc5b707e7 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:53.632259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 688/1377] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:53.637996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b208-c5da-4268-b795-72decfc5ac2a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:53.638533 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b208-c5da-4268-b795-72decfc5ac2a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:53.638763 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332b208-c5da-4268-b795-72decfc5ac2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:53.763037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e332b208-c5da-4268-b795-72decfc5ac2a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:53.764360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e332b208-c5da-4268-b795-72decfc5ac2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:53.772894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:53.937301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 690/1378] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:54.236324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9d18d-d734-4589-98a5-b8bfc5b707e7 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:54.238012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-68b9d18d-d734-4589-98a5-b8bfc5b707e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:54.486809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9d18d-d734-4589-98a5-b8bfc5b707e7 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:54.492157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:54.638876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5b02d-f35d-4a8b-9e50-2ab95d1c1490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:54.639666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5b02d-f35d-4a8b-9e50-2ab95d1c1490 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:54.639920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5b02d-f35d-4a8b-9e50-2ab95d1c1490 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:54.640170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5b02d-f35d-4a8b-9e50-2ab95d1c1490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:54.641882 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-50c5b02d-f35d-4a8b-9e50-2ab95d1c1490 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:54.772025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5b02d-f35d-4a8b-9e50-2ab95d1c1490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:54.772025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5b02d-f35d-4a8b-9e50-2ab95d1c1490 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:54.774091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 689/1379] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:42:57.255762 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76cb93-8ce9-4793-bb5f-858802c55d46 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:57.256949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76cb93-8ce9-4793-bb5f-858802c55d46 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:57.256949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76cb93-8ce9-4793-bb5f-858802c55d46 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:57.259322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 691/1380] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:42:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:42:57.265910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b569277-1735-4d52-a767-8fe1e11dfa27 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:57.266710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b569277-1735-4d52-a767-8fe1e11dfa27 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:57.266710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b569277-1735-4d52-a767-8fe1e11dfa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:57.282079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:57.395736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-3b569277-1735-4d52-a767-8fe1e11dfa27 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:42:57.397787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3b569277-1735-4d52-a767-8fe1e11dfa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:57.600904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 690/1381] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:42:57.924760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76cb93-8ce9-4793-bb5f-858802c55d46 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:42:57.927501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9f76cb93-8ce9-4793-bb5f-858802c55d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:58.174028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:58.186700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76cb93-8ce9-4793-bb5f-858802c55d46 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:42:58.360061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b8f25-8c2e-4236-b639-7e087a6d062e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:42:58.361129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8f25-8c2e-4236-b639-7e087a6d062e service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:42:58.361600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8f25-8c2e-4236-b639-7e087a6d062e service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:42:58.362051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b8f25-8c2e-4236-b639-7e087a6d062e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:42:58.365567 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-674b8f25-8c2e-4236-b639-7e087a6d062e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:42:58.551760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b8f25-8c2e-4236-b639-7e087a6d062e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:42:58.555982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b8f25-8c2e-4236-b639-7e087a6d062e service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:42:58.578123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:42:58.592260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 692/1382] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:42:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:00.884027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc5d5e-a2fe-44c1-9243-4030bcb5faab None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:00.884736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc5d5e-a2fe-44c1-9243-4030bcb5faab None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:00.884736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc5d5e-a2fe-44c1-9243-4030bcb5faab None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:00.886047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 691/1383] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:43:00.892150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e186dba-8be6-4452-b6d7-5542d03558a2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:00.892848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e186dba-8be6-4452-b6d7-5542d03558a2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:00.892848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e186dba-8be6-4452-b6d7-5542d03558a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:00.971356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4e186dba-8be6-4452-b6d7-5542d03558a2 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:00.972672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4e186dba-8be6-4452-b6d7-5542d03558a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:01.123887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 693/1384] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:01.639962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc5d5e-a2fe-44c1-9243-4030bcb5faab None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:01.641844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6afc5d5e-a2fe-44c1-9243-4030bcb5faab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:01.749065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:01.838002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc5d5e-a2fe-44c1-9243-4030bcb5faab None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:02.044935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7915b-c820-417d-ac3e-bb5570372de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:02.046520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7915b-c820-417d-ac3e-bb5570372de3 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:02.046520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7915b-c820-417d-ac3e-bb5570372de3 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:02.047038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7915b-c820-417d-ac3e-bb5570372de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:02.049148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-51e7915b-c820-417d-ac3e-bb5570372de3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:02.131894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:02.196223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7915b-c820-417d-ac3e-bb5570372de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:02.198375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7915b-c820-417d-ac3e-bb5570372de3 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:02.226665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 692/1385] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:04.242261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e728-b17a-43c9-b6ce-a545bf00272b None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:04.247102 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e728-b17a-43c9-b6ce-a545bf00272b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:04.247102 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041e728-b17a-43c9-b6ce-a545bf00272b None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:04.247102 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 694/1386] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:04.250988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3059-a54d-41fe-8b63-a3bbf7b5e3b4 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:04.251577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3059-a54d-41fe-8b63-a3bbf7b5e3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:04.251577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf3059-a54d-41fe-8b63-a3bbf7b5e3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:04.330027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5cdf3059-a54d-41fe-8b63-a3bbf7b5e3b4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:04.331203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5cdf3059-a54d-41fe-8b63-a3bbf7b5e3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:04.448096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 693/1387] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:43:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:04.742437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041e728-b17a-43c9-b6ce-a545bf00272b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:04.745155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f041e728-b17a-43c9-b6ce-a545bf00272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:04.896520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:05.026242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041e728-b17a-43c9-b6ce-a545bf00272b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:05.224530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5090d4fb-06e7-49bd-93b0-801751515596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:05.225255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d4fb-06e7-49bd-93b0-801751515596 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:05.225631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d4fb-06e7-49bd-93b0-801751515596 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:05.226032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5090d4fb-06e7-49bd-93b0-801751515596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:05.228175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5090d4fb-06e7-49bd-93b0-801751515596 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:05.280582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:05.353031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d4fb-06e7-49bd-93b0-801751515596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:05.354760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5090d4fb-06e7-49bd-93b0-801751515596 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:05.377311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 695/1388] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:06.236983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c66a6c-ed73-4162-984b-a8ff426520a4 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:06.237709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c66a6c-ed73-4162-984b-a8ff426520a4 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:06.238045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c66a6c-ed73-4162-984b-a8ff426520a4 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:06.240100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 694/1389] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:06.246330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08707bee-d0a1-4a54-b9b5-8056e914c88b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:06.246611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08707bee-d0a1-4a54-b9b5-8056e914c88b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:06.246886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08707bee-d0a1-4a54-b9b5-8056e914c88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:06.329144 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-08707bee-d0a1-4a54-b9b5-8056e914c88b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:06.330309 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-08707bee-d0a1-4a54-b9b5-8056e914c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:06.444154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 696/1390] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:06.750599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e2f43-88fb-49b7-aa57-683960913ee0 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:06.751036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e2f43-88fb-49b7-aa57-683960913ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:06.751497 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e2f43-88fb-49b7-aa57-683960913ee0 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:06.753238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 695/1391] 10.222.0.83 () {54 vars in 967 bytes} [Mon Aug 29 21:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:06.759557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275573fd-514c-4ad0-a7fa-b04d522d5f49 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:06.759890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275573fd-514c-4ad0-a7fa-b04d522d5f49 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:06.760204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275573fd-514c-4ad0-a7fa-b04d522d5f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:06.778375 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:06.850552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-275573fd-514c-4ad0-a7fa-b04d522d5f49 None None] MFA Rules not processed for user `07be3fbf45dc407ba3b6ad4d1e6ea042`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:06.851793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-275573fd-514c-4ad0-a7fa-b04d522d5f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:06.957162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 697/1392] 10.222.0.83 () {58 vars in 1064 bytes} [Mon Aug 29 21:43:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:06.965594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e2f43-88fb-49b7-aa57-683960913ee0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:06.967107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fa0e2f43-88fb-49b7-aa57-683960913ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:07.016570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:07.121934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e2f43-88fb-49b7-aa57-683960913ee0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:07.234666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2d8cb-08a4-40f2-95a1-0ee082627605 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07be3fbf45dc407ba3b6ad4d1e6ea042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:07.235459 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2d8cb-08a4-40f2-95a1-0ee082627605 service glance] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:07.235820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2d8cb-08a4-40f2-95a1-0ee082627605 service glance] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:07.236182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2d8cb-08a4-40f2-95a1-0ee082627605 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:07.238199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ffd2d8cb-08a4-40f2-95a1-0ee082627605 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:07.336268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:07.373928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2d8cb-08a4-40f2-95a1-0ee082627605 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:07.375409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2d8cb-08a4-40f2-95a1-0ee082627605 service glance] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:07.398843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 696/1393] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:08.052311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dedc0-fb55-4c9c-9ddf-601faf8f7ac8 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:08.053024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dedc0-fb55-4c9c-9ddf-601faf8f7ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:08.053319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09dedc0-fb55-4c9c-9ddf-601faf8f7ac8 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:08.055847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 698/1394] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:43:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:08.064962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4045e8-81bd-4867-a478-07a3d63908ee None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:08.065448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4045e8-81bd-4867-a478-07a3d63908ee None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:08.065862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4045e8-81bd-4867-a478-07a3d63908ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:08.149591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5d4045e8-81bd-4867-a478-07a3d63908ee None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:08.151098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5d4045e8-81bd-4867-a478-07a3d63908ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:08.308747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 697/1395] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:08.502386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87444f-6785-4525-be75-4e0e558ae355 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:08.502386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87444f-6785-4525-be75-4e0e558ae355 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:08.502386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87444f-6785-4525-be75-4e0e558ae355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:08.594809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1e87444f-6785-4525-be75-4e0e558ae355 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:08.596217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1e87444f-6785-4525-be75-4e0e558ae355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:08.644841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4045e8-81bd-4867-a478-07a3d63908ee None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:08.646934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5d4045e8-81bd-4867-a478-07a3d63908ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:08.681626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:08.701748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:08.731689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 699/1396] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:43:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:08.796565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4672c-3b4f-4994-b876-b879b4aa3320 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:08.797067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4672c-3b4f-4994-b876-b879b4aa3320 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:08.797565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4672c-3b4f-4994-b876-b879b4aa3320 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:08.800082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 700/1397] 10.222.0.83 () {54 vars in 943 bytes} [Mon Aug 29 21:43:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:43:08.810189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6822e1d-389c-4c0f-8b48-a0754591a94f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:08.810668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6822e1d-389c-4c0f-8b48-a0754591a94f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:08.811124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6822e1d-389c-4c0f-8b48-a0754591a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:08.826824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4045e8-81bd-4867-a478-07a3d63908ee None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:08.921407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b6822e1d-389c-4c0f-8b48-a0754591a94f None None] MFA Rules not processed for user `87128016ec014aa8b8f2fcc8ecf1037d`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:08.922905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b6822e1d-389c-4c0f-8b48-a0754591a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:08.992907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0396564-3e73-4f89-968f-d5c79b9282c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:08.993809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0396564-3e73-4f89-968f-d5c79b9282c4 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:08.994263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0396564-3e73-4f89-968f-d5c79b9282c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:08.994602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0396564-3e73-4f89-968f-d5c79b9282c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:08.996792 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b0396564-3e73-4f89-968f-d5c79b9282c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:09.049044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:09.092975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 701/1398] 10.222.0.83 () {58 vars in 1040 bytes} [Mon Aug 29 21:43:08 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:09.103366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6822e1d-389c-4c0f-8b48-a0754591a94f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:09.114049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6822e1d-389c-4c0f-8b48-a0754591a94f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:09.146719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:09.161764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0396564-3e73-4f89-968f-d5c79b9282c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:09.165357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0396564-3e73-4f89-968f-d5c79b9282c4 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:09.196005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 698/1399] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:09.280548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790a701-c288-49c9-aa30-589c23a55968 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:09.281529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790a701-c288-49c9-aa30-589c23a55968 service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:09.281966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790a701-c288-49c9-aa30-589c23a55968 service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:09.282393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790a701-c288-49c9-aa30-589c23a55968 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:09.285502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6790a701-c288-49c9-aa30-589c23a55968 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:09.391410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790a701-c288-49c9-aa30-589c23a55968 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:09.393446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790a701-c288-49c9-aa30-589c23a55968 service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:09.403623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 702/1400] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:43:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:43:11.500844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c844f69-a1dc-44a1-9541-b6e3ae99e19e None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:11.501803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c844f69-a1dc-44a1-9541-b6e3ae99e19e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:11.501803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c844f69-a1dc-44a1-9541-b6e3ae99e19e None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:11.503103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 699/1401] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:43:11.508971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabbea7-ff2d-4338-afdf-0858d93a3dfa None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:11.509807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabbea7-ff2d-4338-afdf-0858d93a3dfa None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:11.509807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabbea7-ff2d-4338-afdf-0858d93a3dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:11.619638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ccabbea7-ff2d-4338-afdf-0858d93a3dfa None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:11.622575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ccabbea7-ff2d-4338-afdf-0858d93a3dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:11.636621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:11.773221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 703/1402] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:12.161335 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c844f69-a1dc-44a1-9541-b6e3ae99e19e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:12.163255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5c844f69-a1dc-44a1-9541-b6e3ae99e19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:12.414068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c844f69-a1dc-44a1-9541-b6e3ae99e19e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:12.443686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:12.637370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a110e-f147-487b-9494-2a7a0e83d2b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:12.638444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a110e-f147-487b-9494-2a7a0e83d2b5 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:12.639103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a110e-f147-487b-9494-2a7a0e83d2b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:12.640837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a110e-f147-487b-9494-2a7a0e83d2b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:12.647353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-506a110e-f147-487b-9494-2a7a0e83d2b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:12.853342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a110e-f147-487b-9494-2a7a0e83d2b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:12.856521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a110e-f147-487b-9494-2a7a0e83d2b5 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:12.893687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 700/1403] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:15.234989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e049-a5b8-4108-8c45-1861a5dca3c7 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:15.234989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e049-a5b8-4108-8c45-1861a5dca3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:15.234989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e049-a5b8-4108-8c45-1861a5dca3c7 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:15.238337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 704/1404] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:43:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:15.243874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d406a23-82c0-4f04-a659-49aacd55bd5f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:15.243874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d406a23-82c0-4f04-a659-49aacd55bd5f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:15.243874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d406a23-82c0-4f04-a659-49aacd55bd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:15.262942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:15.330403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0d406a23-82c0-4f04-a659-49aacd55bd5f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:15.331682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0d406a23-82c0-4f04-a659-49aacd55bd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:15.491520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 701/1405] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:15.890856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e049-a5b8-4108-8c45-1861a5dca3c7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:15.893764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2dc7e049-a5b8-4108-8c45-1861a5dca3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:16.093573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:16.115899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e049-a5b8-4108-8c45-1861a5dca3c7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:16.326449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149b017-3726-4ad1-bf61-ead8291ea4b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:16.327151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149b017-3726-4ad1-bf61-ead8291ea4b4 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:16.327597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149b017-3726-4ad1-bf61-ead8291ea4b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:16.328025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149b017-3726-4ad1-bf61-ead8291ea4b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:16.330633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1149b017-3726-4ad1-bf61-ead8291ea4b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:16.467892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149b017-3726-4ad1-bf61-ead8291ea4b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:16.470467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149b017-3726-4ad1-bf61-ead8291ea4b4 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:16.489708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:16.504142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 705/1406] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:19.088513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf38cc0-7021-4030-a49f-b86f7576247a None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:19.089080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf38cc0-7021-4030-a49f-b86f7576247a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:19.090028 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf38cc0-7021-4030-a49f-b86f7576247a None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:19.092779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 702/1407] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:43:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:19.098741 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d57890-5f16-49ff-8c71-fb3013e08047 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:19.099564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d57890-5f16-49ff-8c71-fb3013e08047 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:19.099564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d57890-5f16-49ff-8c71-fb3013e08047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:19.177081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-46d57890-5f16-49ff-8c71-fb3013e08047 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:19.179115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-46d57890-5f16-49ff-8c71-fb3013e08047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:19.320836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 706/1408] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:19.632724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf38cc0-7021-4030-a49f-b86f7576247a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:19.636205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-baf38cc0-7021-4030-a49f-b86f7576247a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:19.789495 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:19.863572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf38cc0-7021-4030-a49f-b86f7576247a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:20.043969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f834d-9e27-4ddc-9ba3-8ea9be9fab5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:20.047888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f834d-9e27-4ddc-9ba3-8ea9be9fab5e service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:20.048610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f834d-9e27-4ddc-9ba3-8ea9be9fab5e service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:20.048975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f834d-9e27-4ddc-9ba3-8ea9be9fab5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:20.050824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-840f834d-9e27-4ddc-9ba3-8ea9be9fab5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:20.124456 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:20.161891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f834d-9e27-4ddc-9ba3-8ea9be9fab5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:20.161891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f834d-9e27-4ddc-9ba3-8ea9be9fab5e service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:20.185423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 703/1409] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:29.314862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=67 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:30.182841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=20 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:34.765229 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40a1d-699d-457a-b51b-f126ea0be8ed None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:34.765809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40a1d-699d-457a-b51b-f126ea0be8ed None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:34.765809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40a1d-699d-457a-b51b-f126ea0be8ed None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:34.767143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 707/1410] 10.222.0.83 () {54 vars in 918 bytes} [Mon Aug 29 21:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:34.773651 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13a1bd-8c0b-450b-8ae5-175a14b80e6a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:34.774460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13a1bd-8c0b-450b-8ae5-175a14b80e6a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:34.774460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13a1bd-8c0b-450b-8ae5-175a14b80e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:34.868754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0d13a1bd-8c0b-450b-8ae5-175a14b80e6a None None] MFA Rules not processed for user `dca09f6fe11f4b878dd11c4cb69ca7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:34.870027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0d13a1bd-8c0b-450b-8ae5-175a14b80e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:34.989931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 704/1411] 10.222.0.83 () {58 vars in 1015 bytes} [Mon Aug 29 21:43:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:35.005701 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89ab8-2aa3-47d3-82f9-0f8a33daa431 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:35.006010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89ab8-2aa3-47d3-82f9-0f8a33daa431 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:35.010645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89ab8-2aa3-47d3-82f9-0f8a33daa431 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:35.010645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 708/1412] 10.222.0.83 () {54 vars in 918 bytes} [Mon Aug 29 21:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:35.014468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520712ab-843d-4118-99a0-63bff88c5000 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:35.014741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520712ab-843d-4118-99a0-63bff88c5000 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:35.015015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520712ab-843d-4118-99a0-63bff88c5000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:35.097544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:35.101199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-520712ab-843d-4118-99a0-63bff88c5000 None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:35.102411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-520712ab-843d-4118-99a0-63bff88c5000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:35.229355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 705/1413] 10.222.0.83 () {58 vars in 1015 bytes} [Mon Aug 29 21:43:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:37.688430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75129577-9810-4942-bb1a-c2ab5f49d045 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:37.689168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75129577-9810-4942-bb1a-c2ab5f49d045 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:37.689168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75129577-9810-4942-bb1a-c2ab5f49d045 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:37.690353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:43:37.696643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ec1e5-0d9f-427f-9ab8-304f13f31fbc None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:37.697181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ec1e5-0d9f-427f-9ab8-304f13f31fbc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:37.697339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ec1e5-0d9f-427f-9ab8-304f13f31fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:37.797407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-f48ec1e5-0d9f-427f-9ab8-304f13f31fbc None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:37.798636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f48ec1e5-0d9f-427f-9ab8-304f13f31fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:37.862466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:37.921015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:38.212938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75129577-9810-4942-bb1a-c2ab5f49d045 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:38.214462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-75129577-9810-4942-bb1a-c2ab5f49d045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:38.393905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75129577-9810-4942-bb1a-c2ab5f49d045 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:38.485483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:38.532890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fe49f-8797-402b-affe-6aed78e18388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:38.533575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fe49f-8797-402b-affe-6aed78e18388 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:38.533833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fe49f-8797-402b-affe-6aed78e18388 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:38.534103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fe49f-8797-402b-affe-6aed78e18388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:38.535859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ec6fe49f-8797-402b-affe-6aed78e18388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:38.637510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fe49f-8797-402b-affe-6aed78e18388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:38.639289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fe49f-8797-402b-affe-6aed78e18388 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:38.658678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 710/1416] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:39.573127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc73a7-a5f8-431a-83c4-0b2fcd8c372c None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:39.573749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc73a7-a5f8-431a-83c4-0b2fcd8c372c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:39.573970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc73a7-a5f8-431a-83c4-0b2fcd8c372c None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:39.575876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:39.581462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe802a-4ea8-43b3-9a59-0ad805f31385 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:39.581985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe802a-4ea8-43b3-9a59-0ad805f31385 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:39.582108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe802a-4ea8-43b3-9a59-0ad805f31385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:39.666049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3cfe802a-4ea8-43b3-9a59-0ad805f31385 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:39.667281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3cfe802a-4ea8-43b3-9a59-0ad805f31385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:39.696929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:39.770977 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:39.928609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc73a7-a5f8-431a-83c4-0b2fcd8c372c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:39.930429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-89cc73a7-a5f8-431a-83c4-0b2fcd8c372c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:40.102206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc73a7-a5f8-431a-83c4-0b2fcd8c372c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:40.148197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:40.231776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639ccaf3-e061-4c15-9a2a-c97f4e52d29e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:40.232402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ccaf3-e061-4c15-9a2a-c97f4e52d29e service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:40.232713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ccaf3-e061-4c15-9a2a-c97f4e52d29e service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:40.232991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639ccaf3-e061-4c15-9a2a-c97f4e52d29e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:40.234729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-639ccaf3-e061-4c15-9a2a-c97f4e52d29e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:40.345533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ccaf3-e061-4c15-9a2a-c97f4e52d29e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:40.347230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639ccaf3-e061-4c15-9a2a-c97f4e52d29e service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:40.369314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 708/1419] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:41.296307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aee5ce-f314-4a3a-b681-59a893c42222 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:41.297155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aee5ce-f314-4a3a-b681-59a893c42222 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:41.297155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aee5ce-f314-4a3a-b681-59a893c42222 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:41.298200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:41.303965 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e968d-71b0-4c51-bd92-190b0081f87c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:41.304629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e968d-71b0-4c51-bd92-190b0081f87c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:41.304629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e968d-71b0-4c51-bd92-190b0081f87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:41.371665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:41.399269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-cc7e968d-71b0-4c51-bd92-190b0081f87c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:41.400578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-cc7e968d-71b0-4c51-bd92-190b0081f87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:41.519154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:41.674170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aee5ce-f314-4a3a-b681-59a893c42222 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:41.675680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f2aee5ce-f314-4a3a-b681-59a893c42222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:41.851900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aee5ce-f314-4a3a-b681-59a893c42222 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:41.866991 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:41.985188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df6d64-8fd2-4352-9067-fe0248276c23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:41.985876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df6d64-8fd2-4352-9067-fe0248276c23 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:41.986327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df6d64-8fd2-4352-9067-fe0248276c23 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:41.986704 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df6d64-8fd2-4352-9067-fe0248276c23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:41.988520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d2df6d64-8fd2-4352-9067-fe0248276c23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:42.103083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df6d64-8fd2-4352-9067-fe0248276c23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:42.104965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df6d64-8fd2-4352-9067-fe0248276c23 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:42.128270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 713/1422] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:43.048678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe950e7-4c77-4ff7-9ed4-52ba4df39790 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:43.049254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe950e7-4c77-4ff7-9ed4-52ba4df39790 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:43.049254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe950e7-4c77-4ff7-9ed4-52ba4df39790 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:43.050591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:43.056293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a920c-1eea-422f-b197-6c530f61c230 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:43.056829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a920c-1eea-422f-b197-6c530f61c230 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:43.056954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a920c-1eea-422f-b197-6c530f61c230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:43.078499 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:43.140065 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-410a920c-1eea-422f-b197-6c530f61c230 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:43.141316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-410a920c-1eea-422f-b197-6c530f61c230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:43.258829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:43.414252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe950e7-4c77-4ff7-9ed4-52ba4df39790 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:43.416052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bbe950e7-4c77-4ff7-9ed4-52ba4df39790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:43.559085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:43.600829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe950e7-4c77-4ff7-9ed4-52ba4df39790 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:43.734409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f67b757-e7ec-4c7a-8091-a275e3c42860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:43.735025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b757-e7ec-4c7a-8091-a275e3c42860 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:43.735335 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b757-e7ec-4c7a-8091-a275e3c42860 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:43.735601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f67b757-e7ec-4c7a-8091-a275e3c42860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:43.737305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5f67b757-e7ec-4c7a-8091-a275e3c42860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:43.834142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:43.849221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67b757-e7ec-4c7a-8091-a275e3c42860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:43.850937 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f67b757-e7ec-4c7a-8091-a275e3c42860 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:43.873352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 711/1425] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:44.811528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f745f-de31-43a4-b9b3-3878ca0844e7 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:44.812206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f745f-de31-43a4-b9b3-3878ca0844e7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:44.812206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f745f-de31-43a4-b9b3-3878ca0844e7 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:44.813795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:43:44.820984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abd9b9-0a4b-46c2-9652-5f515e75207e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:44.821864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abd9b9-0a4b-46c2-9652-5f515e75207e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:44.821864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abd9b9-0a4b-46c2-9652-5f515e75207e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:44.916500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-55abd9b9-0a4b-46c2-9652-5f515e75207e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:44.917974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-55abd9b9-0a4b-46c2-9652-5f515e75207e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:45.042957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:45.199654 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f745f-de31-43a4-b9b3-3878ca0844e7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:45.201360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f70f745f-de31-43a4-b9b3-3878ca0844e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:45.307303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:45.379737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f745f-de31-43a4-b9b3-3878ca0844e7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:45.514566 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ef6d79-e45b-4e0f-a703-29453f039b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:45.515195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef6d79-e45b-4e0f-a703-29453f039b97 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:45.515479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef6d79-e45b-4e0f-a703-29453f039b97 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:45.515754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ef6d79-e45b-4e0f-a703-29453f039b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:45.517533 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-35ef6d79-e45b-4e0f-a703-29453f039b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:45.576953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:45.627855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef6d79-e45b-4e0f-a703-29453f039b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:45.630090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ef6d79-e45b-4e0f-a703-29453f039b97 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:45.653486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 716/1428] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:46.592123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b87e2d-e9c2-49ac-aff4-0d90ccdc2eb1 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:46.592775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b87e2d-e9c2-49ac-aff4-0d90ccdc2eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:46.592775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b87e2d-e9c2-49ac-aff4-0d90ccdc2eb1 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:46.594100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:46.600049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f932-b326-4617-b5e5-a4866f44c932 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:46.600682 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f932-b326-4617-b5e5-a4866f44c932 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:46.600682 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f932-b326-4617-b5e5-a4866f44c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:46.690160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c921f932-b326-4617-b5e5-a4866f44c932 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:46.691534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c921f932-b326-4617-b5e5-a4866f44c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:46.821589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:46.988213 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b87e2d-e9c2-49ac-aff4-0d90ccdc2eb1 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:46.990490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-64b87e2d-e9c2-49ac-aff4-0d90ccdc2eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:47.084807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:47.258691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b87e2d-e9c2-49ac-aff4-0d90ccdc2eb1 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:47.384042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927e4d18-3955-4d6a-b102-bdf5dc7a3c1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:47.384696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e4d18-3955-4d6a-b102-bdf5dc7a3c1f service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:47.384977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e4d18-3955-4d6a-b102-bdf5dc7a3c1f service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:47.385250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927e4d18-3955-4d6a-b102-bdf5dc7a3c1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:47.386962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-927e4d18-3955-4d6a-b102-bdf5dc7a3c1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:47.395101 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:47.509497 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e4d18-3955-4d6a-b102-bdf5dc7a3c1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:47.511031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927e4d18-3955-4d6a-b102-bdf5dc7a3c1f service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:47.531737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 714/1431] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:48.459422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3c5e-9949-4ba1-a7eb-aabd7756cd12 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:48.460243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3c5e-9949-4ba1-a7eb-aabd7756cd12 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:48.460432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f3c5e-9949-4ba1-a7eb-aabd7756cd12 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:48.462030 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:43:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:48.468121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830749f3-eb9e-4121-9d00-1635725fd62a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:48.468856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830749f3-eb9e-4121-9d00-1635725fd62a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:48.468856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830749f3-eb9e-4121-9d00-1635725fd62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:48.568068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-830749f3-eb9e-4121-9d00-1635725fd62a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:48.569479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-830749f3-eb9e-4121-9d00-1635725fd62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:48.656654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:48.715800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:48.869490 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f3c5e-9949-4ba1-a7eb-aabd7756cd12 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:48.871310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-145f3c5e-9949-4ba1-a7eb-aabd7756cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:48.891937 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:49.044593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f3c5e-9949-4ba1-a7eb-aabd7756cd12 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:49.182278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:49.213824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04c023-6a56-4c4e-91ca-9f58513a7592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:49.214581 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04c023-6a56-4c4e-91ca-9f58513a7592 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:49.214860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04c023-6a56-4c4e-91ca-9f58513a7592 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:49.215136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04c023-6a56-4c4e-91ca-9f58513a7592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:49.216980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1c04c023-6a56-4c4e-91ca-9f58513a7592 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:49.322618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04c023-6a56-4c4e-91ca-9f58513a7592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:49.324209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04c023-6a56-4c4e-91ca-9f58513a7592 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:49.344554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 719/1434] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:50.270146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e956a-ac62-4c4d-b6d3-e28a63e00b51 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:50.270734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e956a-ac62-4c4d-b6d3-e28a63e00b51 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:50.270734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e956a-ac62-4c4d-b6d3-e28a63e00b51 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:50.272786 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:50.279131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af568d-66c9-4d7b-b284-d061dbc68be6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:50.279753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af568d-66c9-4d7b-b284-d061dbc68be6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:50.279753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af568d-66c9-4d7b-b284-d061dbc68be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:50.383170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b0af568d-66c9-4d7b-b284-d061dbc68be6 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:50.384449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b0af568d-66c9-4d7b-b284-d061dbc68be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:50.434850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:50.496263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:43:50.649477 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e956a-ac62-4c4d-b6d3-e28a63e00b51 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:50.650918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ea6e956a-ac62-4c4d-b6d3-e28a63e00b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:50.825461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e956a-ac62-4c4d-b6d3-e28a63e00b51 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:50.884818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:50.952625 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6775ab-1734-4a3d-bfd7-603c16a5bd78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:50.953149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6775ab-1734-4a3d-bfd7-603c16a5bd78 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:50.953424 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6775ab-1734-4a3d-bfd7-603c16a5bd78 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:50.953693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6775ab-1734-4a3d-bfd7-603c16a5bd78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:50.955478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ea6775ab-1734-4a3d-bfd7-603c16a5bd78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:51.065343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6775ab-1734-4a3d-bfd7-603c16a5bd78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:51.066952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6775ab-1734-4a3d-bfd7-603c16a5bd78 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:51.086936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 717/1437] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:43:51.980177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0699fc-ac5c-476c-8161-c58a5d7c96d9 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:51.980793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0699fc-ac5c-476c-8161-c58a5d7c96d9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:51.980902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0699fc-ac5c-476c-8161-c58a5d7c96d9 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:51.982281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:51.987772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa171bad-5770-42f3-8e4f-e8ec55a0b3d4 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:51.988230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa171bad-5770-42f3-8e4f-e8ec55a0b3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:51.988347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa171bad-5770-42f3-8e4f-e8ec55a0b3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:52.073642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-aa171bad-5770-42f3-8e4f-e8ec55a0b3d4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:52.075049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-aa171bad-5770-42f3-8e4f-e8ec55a0b3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:52.077435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:52.180451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:52.332709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0699fc-ac5c-476c-8161-c58a5d7c96d9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:52.334954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5a0699fc-ac5c-476c-8161-c58a5d7c96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:52.492173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0699fc-ac5c-476c-8161-c58a5d7c96d9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:52.522481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:52.623209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33342028-ba96-48ea-9f90-9fcb596e48b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:52.623994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33342028-ba96-48ea-9f90-9fcb596e48b5 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:52.624297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33342028-ba96-48ea-9f90-9fcb596e48b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:52.624616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33342028-ba96-48ea-9f90-9fcb596e48b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:52.627017 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-33342028-ba96-48ea-9f90-9fcb596e48b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:52.730483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33342028-ba96-48ea-9f90-9fcb596e48b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:52.732091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33342028-ba96-48ea-9f90-9fcb596e48b5 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:52.750952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 722/1440] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:54.635576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df378a5-d2e9-4ec7-8046-cc0fa30b83e5 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:54.636176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df378a5-d2e9-4ec7-8046-cc0fa30b83e5 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:54.636176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df378a5-d2e9-4ec7-8046-cc0fa30b83e5 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:54.637544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:54.643547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cc43f-cd5b-414b-81c2-fe56b80a12a1 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:54.644314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cc43f-cd5b-414b-81c2-fe56b80a12a1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:54.644314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cc43f-cd5b-414b-81c2-fe56b80a12a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:54.689992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:54.718263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-858cc43f-cd5b-414b-81c2-fe56b80a12a1 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:54.719502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-858cc43f-cd5b-414b-81c2-fe56b80a12a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:54.826695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:55.114218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df378a5-d2e9-4ec7-8046-cc0fa30b83e5 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:55.115785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5df378a5-d2e9-4ec7-8046-cc0fa30b83e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:55.247768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df378a5-d2e9-4ec7-8046-cc0fa30b83e5 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:55.283770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:55.331052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8256d-69a8-4b90-bb0f-fe829a1d4e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:55.331665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8256d-69a8-4b90-bb0f-fe829a1d4e32 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:55.331944 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8256d-69a8-4b90-bb0f-fe829a1d4e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:55.332235 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8256d-69a8-4b90-bb0f-fe829a1d4e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:55.334411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bfc8256d-69a8-4b90-bb0f-fe829a1d4e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:55.466539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8256d-69a8-4b90-bb0f-fe829a1d4e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:55.469126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc8256d-69a8-4b90-bb0f-fe829a1d4e32 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:55.498554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 720/1443] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:43:57.659597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3dc6b-e98d-4d85-814c-976a3cd4cf83 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:57.660161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3dc6b-e98d-4d85-814c-976a3cd4cf83 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:57.660161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3dc6b-e98d-4d85-814c-976a3cd4cf83 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:57.661567 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:43:57.668165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55903c-f5b7-48f0-a3c6-632024136fb7 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:57.668742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55903c-f5b7-48f0-a3c6-632024136fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:57.668878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55903c-f5b7-48f0-a3c6-632024136fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:57.746145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-1e55903c-f5b7-48f0-a3c6-632024136fb7 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:43:57.747374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-1e55903c-f5b7-48f0-a3c6-632024136fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:57.761788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:57.877452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:43:58.191921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3dc6b-e98d-4d85-814c-976a3cd4cf83 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:43:58.193819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5bc3dc6b-e98d-4d85-814c-976a3cd4cf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:58.312626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3dc6b-e98d-4d85-814c-976a3cd4cf83 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:43:58.325964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:43:58.399036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d6cfb-5ac6-4ccc-af8e-973bedcf9366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:43:58.399659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d6cfb-5ac6-4ccc-af8e-973bedcf9366 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:43:58.399940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d6cfb-5ac6-4ccc-af8e-973bedcf9366 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:43:58.400380 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d6cfb-5ac6-4ccc-af8e-973bedcf9366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:43:58.402082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-420d6cfb-5ac6-4ccc-af8e-973bedcf9366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:43:58.585116 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d6cfb-5ac6-4ccc-af8e-973bedcf9366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:43:58.587659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d6cfb-5ac6-4ccc-af8e-973bedcf9366 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:43:58.624854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 725/1446] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:01.039678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475f193-5d93-4677-9c0b-cd5a492c060b None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:01.040582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475f193-5d93-4677-9c0b-cd5a492c060b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:01.040848 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475f193-5d93-4677-9c0b-cd5a492c060b None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:01.043079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:44:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:01.049191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85f7ce-ee71-45fd-a2de-fa05f3739c19 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:01.049718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85f7ce-ee71-45fd-a2de-fa05f3739c19 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:01.049718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85f7ce-ee71-45fd-a2de-fa05f3739c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:01.106527 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:01.128026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-8d85f7ce-ee71-45fd-a2de-fa05f3739c19 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:01.129294 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8d85f7ce-ee71-45fd-a2de-fa05f3739c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:01.232283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:01.535205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475f193-5d93-4677-9c0b-cd5a492c060b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:01.537288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c475f193-5d93-4677-9c0b-cd5a492c060b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:01.649097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475f193-5d93-4677-9c0b-cd5a492c060b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:01.692000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:01.729903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb169a0-aa32-44c1-a114-65f1a2eca259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:01.730524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb169a0-aa32-44c1-a114-65f1a2eca259 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:01.730793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb169a0-aa32-44c1-a114-65f1a2eca259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:01.731060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb169a0-aa32-44c1-a114-65f1a2eca259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:01.733286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-acb169a0-aa32-44c1-a114-65f1a2eca259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:01.854620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb169a0-aa32-44c1-a114-65f1a2eca259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:01.855964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb169a0-aa32-44c1-a114-65f1a2eca259 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:01.876260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 723/1449] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:44:04.027548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82db0b-c92e-4522-8005-b13eb4546496 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:04.028128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82db0b-c92e-4522-8005-b13eb4546496 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:04.028128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82db0b-c92e-4522-8005-b13eb4546496 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:04.029621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:44:04.037645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a18c61-d19f-4122-adc2-a6c43ea5495f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:04.038207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a18c61-d19f-4122-adc2-a6c43ea5495f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:04.038582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a18c61-d19f-4122-adc2-a6c43ea5495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:04.117872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-46a18c61-d19f-4122-adc2-a6c43ea5495f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:04.119179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-46a18c61-d19f-4122-adc2-a6c43ea5495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:04.141803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:04.227143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:04.541622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82db0b-c92e-4522-8005-b13eb4546496 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:04.542980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fd82db0b-c92e-4522-8005-b13eb4546496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:04.672113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82db0b-c92e-4522-8005-b13eb4546496 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:04.696343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:04.756249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4674368-27f4-4c8b-8790-e546eb6578fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:04.756902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674368-27f4-4c8b-8790-e546eb6578fa service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:04.757187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674368-27f4-4c8b-8790-e546eb6578fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:04.757455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4674368-27f4-4c8b-8790-e546eb6578fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:04.759107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a4674368-27f4-4c8b-8790-e546eb6578fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:04.887422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4674368-27f4-4c8b-8790-e546eb6578fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:04.888823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4674368-27f4-4c8b-8790-e546eb6578fa service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:04.908024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 728/1452] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:06.927081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdabda8-e684-47e3-959e-ed53aaafd4e9 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:06.928339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdabda8-e684-47e3-959e-ed53aaafd4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:06.928339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdabda8-e684-47e3-959e-ed53aaafd4e9 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:06.929628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:44:06.936376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8b2e4-8f80-48a8-a8a4-c332d05d2b68 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:06.937001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8b2e4-8f80-48a8-a8a4-c332d05d2b68 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:06.937097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8b2e4-8f80-48a8-a8a4-c332d05d2b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:07.013362 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:07.016172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bae8b2e4-8f80-48a8-a8a4-c332d05d2b68 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:07.017408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bae8b2e4-8f80-48a8-a8a4-c332d05d2b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:07.120402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:07.413759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdabda8-e684-47e3-959e-ed53aaafd4e9 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:07.415642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3bdabda8-e684-47e3-959e-ed53aaafd4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:07.529392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdabda8-e684-47e3-959e-ed53aaafd4e9 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:07.583309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:07.610360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498c8d-25fe-40d2-b510-d1dfc8d77d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:07.610969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498c8d-25fe-40d2-b510-d1dfc8d77d0d service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:07.611242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498c8d-25fe-40d2-b510-d1dfc8d77d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:07.611504 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498c8d-25fe-40d2-b510-d1dfc8d77d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:07.613285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d8498c8d-25fe-40d2-b510-d1dfc8d77d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:07.741664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498c8d-25fe-40d2-b510-d1dfc8d77d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:07.743020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498c8d-25fe-40d2-b510-d1dfc8d77d0d service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:07.763402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 726/1455] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:44:09.823620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208b32b-5ffd-4b43-90b6-a8a283f61c96 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:09.824196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208b32b-5ffd-4b43-90b6-a8a283f61c96 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:09.824624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208b32b-5ffd-4b43-90b6-a8a283f61c96 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:09.827208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:44:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:09.833315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e70bc-c261-447c-a8e9-a9d9568c6e1b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:09.833921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e70bc-c261-447c-a8e9-a9d9568c6e1b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:09.834018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e70bc-c261-447c-a8e9-a9d9568c6e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:09.913790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-383e70bc-c261-447c-a8e9-a9d9568c6e1b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:09.915249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-383e70bc-c261-447c-a8e9-a9d9568c6e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:09.955455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:10.047027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:10.345371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208b32b-5ffd-4b43-90b6-a8a283f61c96 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:10.347059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c208b32b-5ffd-4b43-90b6-a8a283f61c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:10.470412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208b32b-5ffd-4b43-90b6-a8a283f61c96 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:10.507635 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:10.562504 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388815c8-8b6a-41f8-b40f-d3946ef90201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:10.563167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388815c8-8b6a-41f8-b40f-d3946ef90201 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:10.563506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388815c8-8b6a-41f8-b40f-d3946ef90201 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:10.563830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388815c8-8b6a-41f8-b40f-d3946ef90201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:10.565637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-388815c8-8b6a-41f8-b40f-d3946ef90201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:10.807625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388815c8-8b6a-41f8-b40f-d3946ef90201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:10.809230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388815c8-8b6a-41f8-b40f-d3946ef90201 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:10.829355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 731/1458] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:44:12.933373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475af32-3d72-405e-880f-61ead0eb461b None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:12.933949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475af32-3d72-405e-880f-61ead0eb461b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:12.933949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475af32-3d72-405e-880f-61ead0eb461b None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:12.935187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:44:12.944772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c25e94-b0a9-4d57-b0e2-18ac3de502c8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:12.945392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c25e94-b0a9-4d57-b0e2-18ac3de502c8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:12.945483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c25e94-b0a9-4d57-b0e2-18ac3de502c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:13.026652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-40c25e94-b0a9-4d57-b0e2-18ac3de502c8 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:13.027902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-40c25e94-b0a9-4d57-b0e2-18ac3de502c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:13.037780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:13.137627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:44:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:44:13.424762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475af32-3d72-405e-880f-61ead0eb461b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:13.426327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a475af32-3d72-405e-880f-61ead0eb461b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:13.543333 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475af32-3d72-405e-880f-61ead0eb461b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:13.605345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:13.626191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f6f1a-1d4a-473d-b889-9202b0990072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:13.628508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6f1a-1d4a-473d-b889-9202b0990072 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:13.628508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6f1a-1d4a-473d-b889-9202b0990072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:13.628508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f6f1a-1d4a-473d-b889-9202b0990072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:13.629010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4f3f6f1a-1d4a-473d-b889-9202b0990072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:13.752327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f6f1a-1d4a-473d-b889-9202b0990072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:13.753814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f6f1a-1d4a-473d-b889-9202b0990072 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:13.773874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 729/1461] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:44:15.864381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5aaa8-9063-4bf9-8a1a-7412503e99f5 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:15.864993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5aaa8-9063-4bf9-8a1a-7412503e99f5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:15.864993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5aaa8-9063-4bf9-8a1a-7412503e99f5 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:15.866390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:15.872030 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65c9c-21f4-4055-9a5e-5028432b95ce None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:15.872547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65c9c-21f4-4055-9a5e-5028432b95ce None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:15.872667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65c9c-21f4-4055-9a5e-5028432b95ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:15.945828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-bdc65c9c-21f4-4055-9a5e-5028432b95ce None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:15.947055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bdc65c9c-21f4-4055-9a5e-5028432b95ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:16.002535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:16.196671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:16.481490 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5aaa8-9063-4bf9-8a1a-7412503e99f5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:16.483112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-82f5aaa8-9063-4bf9-8a1a-7412503e99f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:16.633707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5aaa8-9063-4bf9-8a1a-7412503e99f5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:16.685364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:16.723670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0c442-2c09-4603-9cdc-122e37d3830b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:16.724289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0c442-2c09-4603-9cdc-122e37d3830b service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:16.725143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0c442-2c09-4603-9cdc-122e37d3830b service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:16.725357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0c442-2c09-4603-9cdc-122e37d3830b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:16.727115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b9f0c442-2c09-4603-9cdc-122e37d3830b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:16.847722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0c442-2c09-4603-9cdc-122e37d3830b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:16.849254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0c442-2c09-4603-9cdc-122e37d3830b service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:16.869324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 734/1464] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:18.870012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211865d-3dc7-4448-bcee-a26edab9fec0 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:18.870578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211865d-3dc7-4448-bcee-a26edab9fec0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:18.870578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f211865d-3dc7-4448-bcee-a26edab9fec0 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:18.871885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:18.877390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133711a9-53c1-4d3e-b952-5139d7cad629 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:18.877866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133711a9-53c1-4d3e-b952-5139d7cad629 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:18.877976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133711a9-53c1-4d3e-b952-5139d7cad629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:18.952038 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-133711a9-53c1-4d3e-b952-5139d7cad629 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:18.953287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-133711a9-53c1-4d3e-b952-5139d7cad629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:18.973404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:19.056418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:19.336954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211865d-3dc7-4448-bcee-a26edab9fec0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:19.338615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f211865d-3dc7-4448-bcee-a26edab9fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:19.451434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f211865d-3dc7-4448-bcee-a26edab9fec0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:19.523762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:19.530901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c98f7-3155-4f6a-a50d-fafb0795e699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:19.535270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c98f7-3155-4f6a-a50d-fafb0795e699 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:19.535270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c98f7-3155-4f6a-a50d-fafb0795e699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:19.535270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c98f7-3155-4f6a-a50d-fafb0795e699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:19.535270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2b2c98f7-3155-4f6a-a50d-fafb0795e699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:19.655993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c98f7-3155-4f6a-a50d-fafb0795e699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:19.657373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c98f7-3155-4f6a-a50d-fafb0795e699 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:19.677443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 732/1467] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:21.635813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f25cef-3e4e-4193-b0ef-c5b159aa5d74 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:21.636398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f25cef-3e4e-4193-b0ef-c5b159aa5d74 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:21.637125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f25cef-3e4e-4193-b0ef-c5b159aa5d74 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:21.639833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:44:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:21.650531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30382424-3d46-482f-a18a-15248588f96c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:21.651327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30382424-3d46-482f-a18a-15248588f96c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:21.651593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30382424-3d46-482f-a18a-15248588f96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:21.738507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-30382424-3d46-482f-a18a-15248588f96c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:21.739742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-30382424-3d46-482f-a18a-15248588f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:21.790317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:21.842851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:22.130522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f25cef-3e4e-4193-b0ef-c5b159aa5d74 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:22.132874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-54f25cef-3e4e-4193-b0ef-c5b159aa5d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:22.238420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f25cef-3e4e-4193-b0ef-c5b159aa5d74 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:22.288021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:22.317168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2349c6a-d1d0-45e2-810e-966117192e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:22.317779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349c6a-d1d0-45e2-810e-966117192e14 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:22.318051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349c6a-d1d0-45e2-810e-966117192e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:22.318316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2349c6a-d1d0-45e2-810e-966117192e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:22.320692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d2349c6a-d1d0-45e2-810e-966117192e14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:22.438237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2349c6a-d1d0-45e2-810e-966117192e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:22.439676 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2349c6a-d1d0-45e2-810e-966117192e14 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:22.459238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 737/1470] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:31.840859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=22 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:32.456868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=66 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:43.045844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86394a64-2160-42e6-beda-b9eefa08cfc5 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:43.046562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86394a64-2160-42e6-beda-b9eefa08cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:43.046562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86394a64-2160-42e6-beda-b9eefa08cfc5 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:43.048334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 734/1471] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:43.054740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780578fa-8218-487c-9e9b-a6109fbcc7a0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:43.055246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780578fa-8218-487c-9e9b-a6109fbcc7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:43.055430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780578fa-8218-487c-9e9b-a6109fbcc7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:43.134918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-780578fa-8218-487c-9e9b-a6109fbcc7a0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:43.136188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-780578fa-8218-487c-9e9b-a6109fbcc7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:43.246669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 738/1472] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:43.548621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e06382-e501-4e29-98e8-5a26ff007f0b None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:43.549038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e06382-e501-4e29-98e8-5a26ff007f0b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:43.549415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e06382-e501-4e29-98e8-5a26ff007f0b None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:43.550875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 735/1473] 10.222.0.83 () {54 vars in 967 bytes} [Mon Aug 29 21:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:43.556282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5399a0-920f-402f-a760-bf9e50ba4f8c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:43.556604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5399a0-920f-402f-a760-bf9e50ba4f8c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:43.556885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5399a0-920f-402f-a760-bf9e50ba4f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:43.640111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ea5399a0-920f-402f-a760-bf9e50ba4f8c None None] MFA Rules not processed for user `07be3fbf45dc407ba3b6ad4d1e6ea042`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:43.641370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ea5399a0-920f-402f-a760-bf9e50ba4f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:43.664662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:43.737566 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 739/1474] 10.222.0.83 () {58 vars in 1064 bytes} [Mon Aug 29 21:44:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:44:43.746201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e06382-e501-4e29-98e8-5a26ff007f0b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:43.747791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-13e06382-e501-4e29-98e8-5a26ff007f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:43.869465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e06382-e501-4e29-98e8-5a26ff007f0b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:43.950216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2223a75-382c-4482-8bcb-57c130f997a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07be3fbf45dc407ba3b6ad4d1e6ea042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:43.950823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223a75-382c-4482-8bcb-57c130f997a2 service glance] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:43.951097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223a75-382c-4482-8bcb-57c130f997a2 service glance] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:43.951359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2223a75-382c-4482-8bcb-57c130f997a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:43.953044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d2223a75-382c-4482-8bcb-57c130f997a2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:44.024279 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:44.086464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2223a75-382c-4482-8bcb-57c130f997a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:44.087935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2223a75-382c-4482-8bcb-57c130f997a2 service glance] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:44.109111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 736/1475] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:46.208355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ce3e7-8113-4376-b229-4580504d8378 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:46.208989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ce3e7-8113-4376-b229-4580504d8378 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:46.208989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ce3e7-8113-4376-b229-4580504d8378 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:46.210887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 740/1476] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:46.216716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46277c1-c543-468d-b852-21a90d978ead None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:46.217462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46277c1-c543-468d-b852-21a90d978ead None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:46.217652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46277c1-c543-468d-b852-21a90d978ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:46.289118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b46277c1-c543-468d-b852-21a90d978ead None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:46.290251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b46277c1-c543-468d-b852-21a90d978ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:46.396709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 737/1477] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:46.673009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ce3e7-8113-4376-b229-4580504d8378 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:46.674507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-170ce3e7-8113-4376-b229-4580504d8378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:46.813009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ce3e7-8113-4376-b229-4580504d8378 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:46.869068 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:46.917387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed17ff6e-da4b-49e7-94a3-4005e59bfffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:46.918255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ff6e-da4b-49e7-94a3-4005e59bfffd admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:46.918534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ff6e-da4b-49e7-94a3-4005e59bfffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:46.918820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed17ff6e-da4b-49e7-94a3-4005e59bfffd admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:46.919455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17ff6e-da4b-49e7-94a3-4005e59bfffd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:46.921254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-ed17ff6e-da4b-49e7-94a3-4005e59bfffd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:44:46.921254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 21:44:46.921254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: Aug 29 21:44:46.922398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed17ff6e-da4b-49e7-94a3-4005e59bfffd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:46.943241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 741/1478] 10.222.0.83 () {56 vars in 1108 bytes} [Mon Aug 29 21:44:46 2022] GET /identity/v3/projects => generated 2553 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:44:48.938011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977144f-1824-4910-a032-585da2c6d532 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:48.938586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977144f-1824-4910-a032-585da2c6d532 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:48.938586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977144f-1824-4910-a032-585da2c6d532 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:48.939949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 738/1479] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:48.945824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bb00d-0059-4bc9-923e-8cceaf049b3b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:48.946256 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bb00d-0059-4bc9-923e-8cceaf049b3b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:48.946367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bb00d-0059-4bc9-923e-8cceaf049b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:49.032843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5b1bb00d-0059-4bc9-923e-8cceaf049b3b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:49.034103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5b1bb00d-0059-4bc9-923e-8cceaf049b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:49.142849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 742/1480] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:49.436268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977144f-1824-4910-a032-585da2c6d532 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:49.438135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9977144f-1824-4910-a032-585da2c6d532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:49.448291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:49.597157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977144f-1824-4910-a032-585da2c6d532 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:49.684335 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:49.719599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6c1495-f3f9-4175-b21c-60e45df0a035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:49.720211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c1495-f3f9-4175-b21c-60e45df0a035 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:49.720508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c1495-f3f9-4175-b21c-60e45df0a035 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:49.720775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c1495-f3f9-4175-b21c-60e45df0a035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:49.722374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7e6c1495-f3f9-4175-b21c-60e45df0a035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:49.819814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c1495-f3f9-4175-b21c-60e45df0a035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:49.821439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6c1495-f3f9-4175-b21c-60e45df0a035 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:49.840343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 739/1481] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:51.985838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454402-7164-4cd8-bd34-9d820f3c7bf7 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:51.986426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454402-7164-4cd8-bd34-9d820f3c7bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:51.986426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57454402-7164-4cd8-bd34-9d820f3c7bf7 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:51.987779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 743/1482] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:44:51.994047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29e5de-b6c9-4b70-86a6-d7e5d50911fd None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:51.994549 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29e5de-b6c9-4b70-86a6-d7e5d50911fd None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:51.994687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29e5de-b6c9-4b70-86a6-d7e5d50911fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:52.068658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-2b29e5de-b6c9-4b70-86a6-d7e5d50911fd None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:52.070556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2b29e5de-b6c9-4b70-86a6-d7e5d50911fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:52.120814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:52.175574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 740/1483] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:52.470530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454402-7164-4cd8-bd34-9d820f3c7bf7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:52.472136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-57454402-7164-4cd8-bd34-9d820f3c7bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:52.498371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:52.599820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57454402-7164-4cd8-bd34-9d820f3c7bf7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:52.698635 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f692463-adc3-475a-a884-aacc4c31d111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:52.699255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f692463-adc3-475a-a884-aacc4c31d111 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:52.699531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f692463-adc3-475a-a884-aacc4c31d111 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:52.700354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f692463-adc3-475a-a884-aacc4c31d111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:52.701683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5f692463-adc3-475a-a884-aacc4c31d111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:52.782288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:52.821001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f692463-adc3-475a-a884-aacc4c31d111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:52.823243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f692463-adc3-475a-a884-aacc4c31d111 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:52.844662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 744/1484] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:54.850370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196502c-3fe1-45e0-836f-cf34efc80dcf None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:54.850988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196502c-3fe1-45e0-836f-cf34efc80dcf None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:54.850988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196502c-3fe1-45e0-836f-cf34efc80dcf None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:54.852318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 741/1485] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:44:54.858906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9828b2b-02c7-43e3-be0d-8570ea8e064b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:54.859474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9828b2b-02c7-43e3-be0d-8570ea8e064b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:54.859474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9828b2b-02c7-43e3-be0d-8570ea8e064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:54.933918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f9828b2b-02c7-43e3-be0d-8570ea8e064b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:54.935230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f9828b2b-02c7-43e3-be0d-8570ea8e064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:55.045674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 745/1486] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:55.339916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196502c-3fe1-45e0-836f-cf34efc80dcf None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:55.341688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a196502c-3fe1-45e0-836f-cf34efc80dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:55.474689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196502c-3fe1-45e0-836f-cf34efc80dcf None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:55.562368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:55.564822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721a8d7-b86e-45a0-ba0f-b36ddc8492b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:55.565442 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721a8d7-b86e-45a0-ba0f-b36ddc8492b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:55.565713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721a8d7-b86e-45a0-ba0f-b36ddc8492b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:55.565980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721a8d7-b86e-45a0-ba0f-b36ddc8492b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:55.567791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5721a8d7-b86e-45a0-ba0f-b36ddc8492b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:55.688573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721a8d7-b86e-45a0-ba0f-b36ddc8492b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:55.690017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721a8d7-b86e-45a0-ba0f-b36ddc8492b8 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:55.709721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 742/1487] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:44:57.775654 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a2f3-61a2-41da-a4e4-010e3bc9c14f None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:57.776248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a2f3-61a2-41da-a4e4-010e3bc9c14f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:57.776248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e1a2f3-61a2-41da-a4e4-010e3bc9c14f None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:57.777623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 746/1488] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:44:57.783439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f20e14-6492-476c-a91f-5e04d5a03988 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:57.784178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f20e14-6492-476c-a91f-5e04d5a03988 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:57.784178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f20e14-6492-476c-a91f-5e04d5a03988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:57.860085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-10f20e14-6492-476c-a91f-5e04d5a03988 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:44:57.861386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-10f20e14-6492-476c-a91f-5e04d5a03988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:57.925882 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:57.968402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 743/1489] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:44:58.260072 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1a2f3-61a2-41da-a4e4-010e3bc9c14f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:44:58.261647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b2e1a2f3-61a2-41da-a4e4-010e3bc9c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:58.299408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:58.402257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e1a2f3-61a2-41da-a4e4-010e3bc9c14f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:44:58.507828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae39b56-bd85-4cee-bbb9-e5278828f8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:44:58.508356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae39b56-bd85-4cee-bbb9-e5278828f8fb service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:44:58.508655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae39b56-bd85-4cee-bbb9-e5278828f8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:44:58.508920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae39b56-bd85-4cee-bbb9-e5278828f8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:44:58.510547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9ae39b56-bd85-4cee-bbb9-e5278828f8fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:44:58.598738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:44:58.631060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae39b56-bd85-4cee-bbb9-e5278828f8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:44:58.633112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae39b56-bd85-4cee-bbb9-e5278828f8fb service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:44:58.652675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 747/1490] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:01.122122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac32d9-6f63-410b-bc8d-f49a7beaf0e0 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:01.122703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac32d9-6f63-410b-bc8d-f49a7beaf0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:01.122703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac32d9-6f63-410b-bc8d-f49a7beaf0e0 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:01.124014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 744/1491] 10.222.0.83 () {54 vars in 927 bytes} [Mon Aug 29 21:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:45:01.132767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157d37e-0dd4-40bc-95be-309a3341f8bb None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:01.133537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157d37e-0dd4-40bc-95be-309a3341f8bb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:01.133537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157d37e-0dd4-40bc-95be-309a3341f8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:01.207106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1157d37e-0dd4-40bc-95be-309a3341f8bb None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:45:01.208394 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1157d37e-0dd4-40bc-95be-309a3341f8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:01.325424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 748/1492] 10.222.0.83 () {58 vars in 1024 bytes} [Mon Aug 29 21:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:45:01.621200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac32d9-6f63-410b-bc8d-f49a7beaf0e0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:45:01.622756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d9ac32d9-6f63-410b-bc8d-f49a7beaf0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:01.747004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac32d9-6f63-410b-bc8d-f49a7beaf0e0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:45:01.851712 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb91e89-5fde-4c31-bb26-e6ed6a79eee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:45:01.852667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb91e89-5fde-4c31-bb26-e6ed6a79eee9 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:45:01.853161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb91e89-5fde-4c31-bb26-e6ed6a79eee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:45:01.853654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb91e89-5fde-4c31-bb26-e6ed6a79eee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:45:01.857055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-abb91e89-5fde-4c31-bb26-e6ed6a79eee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:45:01.876185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:01.986952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb91e89-5fde-4c31-bb26-e6ed6a79eee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:45:01.988382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb91e89-5fde-4c31-bb26-e6ed6a79eee9 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:45:02.010247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 745/1493] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:45:11.323002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=82 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:45:12.005874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=50 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:37.261629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cefc91-531f-456e-9f39-25ec1f837105 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:37.262227 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cefc91-531f-456e-9f39-25ec1f837105 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:37.262227 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cefc91-531f-456e-9f39-25ec1f837105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:37.349267 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-84cefc91-531f-456e-9f39-25ec1f837105 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:46:37.350494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-84cefc91-531f-456e-9f39-25ec1f837105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:37.457552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 749/1494] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:46:37.465676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3233a-df68-4eec-a772-6b791700a8fc None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:37.466244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3233a-df68-4eec-a772-6b791700a8fc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:37.466244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3233a-df68-4eec-a772-6b791700a8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:37.487376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-ced3233a-df68-4eec-a772-6b791700a8fc None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:46:37.488621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ced3233a-df68-4eec-a772-6b791700a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:37.507881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 746/1495] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:46:37.512972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cefc91-531f-456e-9f39-25ec1f837105 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:37.522733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cefc91-531f-456e-9f39-25ec1f837105 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:37.527482 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2f6b8-c49b-4f66-92c9-2454b4b57b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:37.528096 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f6b8-c49b-4f66-92c9-2454b4b57b24 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:37.528402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f6b8-c49b-4f66-92c9-2454b4b57b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:37.528707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2f6b8-c49b-4f66-92c9-2454b4b57b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:37.529357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2f6b8-c49b-4f66-92c9-2454b4b57b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:46:37.529659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2f6b8-c49b-4f66-92c9-2454b4b57b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:37.530669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-2ae2f6b8-c49b-4f66-92c9-2454b4b57b24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:46:37.530669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 21:46:37.530669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: Aug 29 21:46:37.531557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae2f6b8-c49b-4f66-92c9-2454b4b57b24 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:37.544219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 750/1496] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:46:37.553068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3233a-df68-4eec-a772-6b791700a8fc None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:37.563052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3233a-df68-4eec-a772-6b791700a8fc None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:37.568075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf01ba-55b3-40df-8bbe-cc9404828e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:37.568717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf01ba-55b3-40df-8bbe-cc9404828e3a admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:37.568997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf01ba-55b3-40df-8bbe-cc9404828e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:37.569268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf01ba-55b3-40df-8bbe-cc9404828e3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:37.569907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf01ba-55b3-40df-8bbe-cc9404828e3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:37.571693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: WARNING py.warnings [None req-9ddf01ba-55b3-40df-8bbe-cc9404828e3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:46:37.571693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: warnings.warn(msg) Aug 29 21:46:37.571693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: Aug 29 21:46:37.572973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf01ba-55b3-40df-8bbe-cc9404828e3a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:37.680350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 747/1497] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:46:37 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:46:37.685541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2f6b8-c49b-4f66-92c9-2454b4b57b24 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:37.695637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2f6b8-c49b-4f66-92c9-2454b4b57b24 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:37.745210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:37.752306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764221b-c015-4cf8-8d03-14d3afd3f118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:37.752950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764221b-c015-4cf8-8d03-14d3afd3f118 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:37.753280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764221b-c015-4cf8-8d03-14d3afd3f118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:37.753562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764221b-c015-4cf8-8d03-14d3afd3f118 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:37.754205 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764221b-c015-4cf8-8d03-14d3afd3f118 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:37.755261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-1764221b-c015-4cf8-8d03-14d3afd3f118 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:46:37.755261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 21:46:37.755261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: Aug 29 21:46:37.756513 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1764221b-c015-4cf8-8d03-14d3afd3f118 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:37.877013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 751/1498] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:46:37 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:46:37.881482 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf01ba-55b3-40df-8bbe-cc9404828e3a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:37.892440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf01ba-55b3-40df-8bbe-cc9404828e3a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:37.897448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28946c89-ea08-4f7c-bbcc-3af062ac7804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:37.898063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28946c89-ea08-4f7c-bbcc-3af062ac7804 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:37.898367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28946c89-ea08-4f7c-bbcc-3af062ac7804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:37.898637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28946c89-ea08-4f7c-bbcc-3af062ac7804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:37.899292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28946c89-ea08-4f7c-bbcc-3af062ac7804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:37.900828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: WARNING py.warnings [None req-28946c89-ea08-4f7c-bbcc-3af062ac7804 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:46:37.900828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: warnings.warn(msg) Aug 29 21:46:37.900828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: Aug 29 21:46:37.901720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28946c89-ea08-4f7c-bbcc-3af062ac7804 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:37.915603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 748/1499] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:46:37.920645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764221b-c015-4cf8-8d03-14d3afd3f118 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:37.931476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764221b-c015-4cf8-8d03-14d3afd3f118 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:37.936180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4e8d-cdcb-4799-bded-1306e6ebeb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:37.936820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4e8d-cdcb-4799-bded-1306e6ebeb7d admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:37.937122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4e8d-cdcb-4799-bded-1306e6ebeb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:37.937392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4e8d-cdcb-4799-bded-1306e6ebeb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:37.938025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c4e8d-cdcb-4799-bded-1306e6ebeb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:37.939031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-118c4e8d-cdcb-4799-bded-1306e6ebeb7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:46:37.939031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 21:46:37.939031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: Aug 29 21:46:37.939912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c4e8d-cdcb-4799-bded-1306e6ebeb7d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:37.954650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 752/1500] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:46:37.959002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28946c89-ea08-4f7c-bbcc-3af062ac7804 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:37.969899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28946c89-ea08-4f7c-bbcc-3af062ac7804 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:37.974730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7531f1d-83e3-4a81-a030-ba08da27e56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:37.975406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531f1d-83e3-4a81-a030-ba08da27e56b admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:37.975681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531f1d-83e3-4a81-a030-ba08da27e56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:37.975951 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7531f1d-83e3-4a81-a030-ba08da27e56b admin admin] PATH_INFO: `/v3/projects/8a970b4883c745d5aaaf372a011b9d31/users/35972e0446b94789b0238e43c55fea0e/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:37.992388 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7531f1d-83e3-4a81-a030-ba08da27e56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a970b4883c745d5aaaf372a011b9d31, user_id=35972e0446b94789b0238e43c55fea0e, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:37.993473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: WARNING py.warnings [None req-a7531f1d-83e3-4a81-a030-ba08da27e56b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:46:37.993473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: warnings.warn(msg) Aug 29 21:46:37.993473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: Aug 29 21:46:37.995436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7531f1d-83e3-4a81-a030-ba08da27e56b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:38.073315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 749/1501] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:46:37 2022] PUT /identity/v3/projects/8a970b4883c745d5aaaf372a011b9d31/users/35972e0446b94789b0238e43c55fea0e/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:46:38.086437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2dda94-7374-41d7-bd59-55bd9f685e5c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:38.086755 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2dda94-7374-41d7-bd59-55bd9f685e5c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:38.087037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2dda94-7374-41d7-bd59-55bd9f685e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:38.119591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-cf2dda94-7374-41d7-bd59-55bd9f685e5c None None] MFA Rules not processed for user `35972e0446b94789b0238e43c55fea0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:46:38.120866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cf2dda94-7374-41d7-bd59-55bd9f685e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:38.197370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 753/1502] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:46:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:46:38.211500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b0867-39e4-484a-83fb-4771c4633e2b None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:38.211788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b0867-39e4-484a-83fb-4771c4633e2b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:38.212058 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b0867-39e4-484a-83fb-4771c4633e2b None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:38.214145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 750/1503] 10.222.0.83 () {54 vars in 964 bytes} [Mon Aug 29 21:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:46:38.219727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac29b9d-636c-47fc-9424-9f870455d41f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:38.220063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac29b9d-636c-47fc-9424-9f870455d41f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:38.220379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac29b9d-636c-47fc-9424-9f870455d41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:38.294505 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5ac29b9d-636c-47fc-9424-9f870455d41f None None] MFA Rules not processed for user `edf63df08ae14d09b5cbdb102d6609ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:46:38.295826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5ac29b9d-636c-47fc-9424-9f870455d41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:38.377812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 754/1504] 10.222.0.83 () {58 vars in 1061 bytes} [Mon Aug 29 21:46:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:46:38.386421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b0867-39e4-484a-83fb-4771c4633e2b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:38.397309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b0867-39e4-484a-83fb-4771c4633e2b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:38.401564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfad44-ae09-4016-b472-64ed907bd075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:38.402169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfad44-ae09-4016-b472-64ed907bd075 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:38.402456 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfad44-ae09-4016-b472-64ed907bd075 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:38.402725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfad44-ae09-4016-b472-64ed907bd075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:38.411795 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfad44-ae09-4016-b472-64ed907bd075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:38.413297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfad44-ae09-4016-b472-64ed907bd075 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:38.422709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 751/1505] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:46:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:46:38.477408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fed4-a2bb-4a9a-a8a5-e46610ea83d1 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:38.477851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fed4-a2bb-4a9a-a8a5-e46610ea83d1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:38.478243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5fed4-a2bb-4a9a-a8a5-e46610ea83d1 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:38.479806 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 755/1506] 10.222.0.83 () {52 vars in 830 bytes} [Mon Aug 29 21:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:46:38.485612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfad44-ae09-4016-b472-64ed907bd075 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:38.559505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfad44-ae09-4016-b472-64ed907bd075 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:38.564414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:38.565107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:38.565387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:38.565662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] PATH_INFO: `/v3/users/35972e0446b94789b0238e43c55fea0e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:38.566916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=35972e0446b94789b0238e43c55fea0e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:38.567959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: WARNING py.warnings [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:46:38.567959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: warnings.warn(msg) Aug 29 21:46:38.567959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: Aug 29 21:46:38.569260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:38.821226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35972e0446b94789b0238e43c55fea0e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:46:38.837665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35972e0446b94789b0238e43c55fea0e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:46:38.838521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35972e0446b94789b0238e43c55fea0e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:46:38.964103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35972e0446b94789b0238e43c55fea0e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:46:38.975076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:38.991860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35972e0446b94789b0238e43c55fea0e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:46:38.998999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 752/1507] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:46:38 2022] DELETE /identity/v3/users/35972e0446b94789b0238e43c55fea0e => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:46:39.003953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c10b-5092-4f13-972b-34b72732c91d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:39.004258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c10b-5092-4f13-972b-34b72732c91d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:39.004555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c10b-5092-4f13-972b-34b72732c91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:39.025568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-59a8c10b-5092-4f13-972b-34b72732c91d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:46:39.030365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-59a8c10b-5092-4f13-972b-34b72732c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:39.039292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:39.123086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 756/1508] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:46:39.133669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:39.139146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:39.230834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6b67d-bc1e-4a07-9ab1-52b9338737bb admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:39.234742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7251e-6007-421f-9784-6eccd2182e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:39.235360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7251e-6007-421f-9784-6eccd2182e08 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:39.235635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7251e-6007-421f-9784-6eccd2182e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:39.235901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7251e-6007-421f-9784-6eccd2182e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:39.246258 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7251e-6007-421f-9784-6eccd2182e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:39.247694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b7251e-6007-421f-9784-6eccd2182e08 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:39.258982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 753/1509] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:46:39.795655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c10b-5092-4f13-972b-34b72732c91d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:46:39.797602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-59a8c10b-5092-4f13-972b-34b72732c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:46:39.813649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c10b-5092-4f13-972b-34b72732c91d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:46:39.820536 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:46:39.821239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:46:39.821547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:46:39.822475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] PATH_INFO: `/v3/projects/8a970b4883c745d5aaaf372a011b9d31` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:46:39.823679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a970b4883c745d5aaaf372a011b9d31)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:46:39.824828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:46:39.824828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 21:46:39.824828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: Aug 29 21:46:39.826026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:46:39.987926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a970b4883c745d5aaaf372a011b9d31', 'request_id': 'req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:46:39.999401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a970b4883c745d5aaaf372a011b9d31', 'request_id': 'req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:46:40.110845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a970b4883c745d5aaaf372a011b9d31', 'request_id': 'req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:46:40.133618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] The token cache is being invalidate because project 8a970b4883c745d5aaaf372a011b9d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:46:40.133986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:46:40.135477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-873a83a5-7d77-4a80-9eb1-88622b6fbb9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:46:40.137155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 757/1510] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:46:39 2022] DELETE /identity/v3/projects/8a970b4883c745d5aaaf372a011b9d31 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:46:49.253753 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:DELETE=2,keystone:SELECT=40 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:46:50.129772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:18.446858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a4c7e-5ca6-4db7-a324-9f5220f54589 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.447465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a4c7e-5ca6-4db7-a324-9f5220f54589 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.447465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a4c7e-5ca6-4db7-a324-9f5220f54589 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.450048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:48:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:48:18.456830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f104c1-81ed-4884-a8ae-f180d7a77f03 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.457524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f104c1-81ed-4884-a8ae-f180d7a77f03 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.457524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f104c1-81ed-4884-a8ae-f180d7a77f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.478842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a0f104c1-81ed-4884-a8ae-f180d7a77f03 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:18.480091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a0f104c1-81ed-4884-a8ae-f180d7a77f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:18.549134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:48:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:18.717162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a4c7e-5ca6-4db7-a324-9f5220f54589 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:18.719079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b03a4c7e-5ca6-4db7-a324-9f5220f54589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:18.843810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a4c7e-5ca6-4db7-a324-9f5220f54589 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:18.852166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7420ee9-cf73-4681-a5a7-a401014c6940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:18.853299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7420ee9-cf73-4681-a5a7-a401014c6940 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:18.853782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7420ee9-cf73-4681-a5a7-a401014c6940 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:18.854279 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7420ee9-cf73-4681-a5a7-a401014c6940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:18.870048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7420ee9-cf73-4681-a5a7-a401014c6940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:18.872282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7420ee9-cf73-4681-a5a7-a401014c6940 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:18.889833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 755/1513] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:48:19.771221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2420-becd-482b-bccc-f5ea54ed3c29 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:19.771863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2420-becd-482b-bccc-f5ea54ed3c29 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:19.771863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab2420-becd-482b-bccc-f5ea54ed3c29 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:19.773519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:48:19.780941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34cc67-f86c-4f2c-9a9c-017af38cbdbe None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:19.781528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34cc67-f86c-4f2c-9a9c-017af38cbdbe None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:19.781528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34cc67-f86c-4f2c-9a9c-017af38cbdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:19.804241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-3c34cc67-f86c-4f2c-9a9c-017af38cbdbe None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:19.805692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3c34cc67-f86c-4f2c-9a9c-017af38cbdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:19.814306 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:19.976189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab2420-becd-482b-bccc-f5ea54ed3c29 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:19.992696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab2420-becd-482b-bccc-f5ea54ed3c29 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:20.001836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c6c79-7238-4e17-b1ec-353a31399d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:20.001836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c6c79-7238-4e17-b1ec-353a31399d75 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:20.001836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c6c79-7238-4e17-b1ec-353a31399d75 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:20.001836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c6c79-7238-4e17-b1ec-353a31399d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:20.011109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c6c79-7238-4e17-b1ec-353a31399d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:20.012906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c6c79-7238-4e17-b1ec-353a31399d75 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:20.024049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 760/1516] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:20.156411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93637f3-670e-43b2-b803-408c39f9c777 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:20.156920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93637f3-670e-43b2-b803-408c39f9c777 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:20.157403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93637f3-670e-43b2-b803-408c39f9c777 None None] PATH_INFO: `/v3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:20.158861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 757/1517] 10.222.0.121 () {54 vars in 926 bytes} [Mon Aug 29 21:48:20 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:48:20.165472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b2add-748b-4135-b2a9-0be7ce17e487 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:20.165791 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b2add-748b-4135-b2a9-0be7ce17e487 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:20.166064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b2add-748b-4135-b2a9-0be7ce17e487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:20.227253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-524b2add-748b-4135-b2a9-0be7ce17e487 None None] MFA Rules not processed for user `dca09f6fe11f4b878dd11c4cb69ca7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:20.228473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-524b2add-748b-4135-b2a9-0be7ce17e487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:20.316467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 761/1518] 10.222.0.121 () {58 vars in 1016 bytes} [Mon Aug 29 21:48:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:29.797471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=49 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:30.313257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=77 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:31.069181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ae824-bda1-4f1a-812d-d9c3335c6207 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:31.070003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ae824-bda1-4f1a-812d-d9c3335c6207 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:31.070269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ae824-bda1-4f1a-812d-d9c3335c6207 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:31.071910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 758/1519] 10.222.0.83 () {54 vars in 961 bytes} [Mon Aug 29 21:48:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:48:31.078733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d2e6-b555-4bcc-a1d2-a4aa35cc4bd0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:31.079246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d2e6-b555-4bcc-a1d2-a4aa35cc4bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:31.079725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896d2e6-b555-4bcc-a1d2-a4aa35cc4bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:31.113619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b896d2e6-b555-4bcc-a1d2-a4aa35cc4bd0 None None] MFA Rules not processed for user `dca09f6fe11f4b878dd11c4cb69ca7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:31.115777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b896d2e6-b555-4bcc-a1d2-a4aa35cc4bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:31.131567 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 762/1520] 10.222.0.83 () {58 vars in 1058 bytes} [Mon Aug 29 21:48:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:31.140353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ae824-bda1-4f1a-812d-d9c3335c6207 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:31.155072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ae824-bda1-4f1a-812d-d9c3335c6207 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:31.160250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937b085-93d1-4a1f-b8b2-37bb293f904b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca09f6fe11f4b878dd11c4cb69ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:31.160955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b085-93d1-4a1f-b8b2-37bb293f904b service placement] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:31.161794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b085-93d1-4a1f-b8b2-37bb293f904b service placement] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:31.162067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937b085-93d1-4a1f-b8b2-37bb293f904b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:31.171487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937b085-93d1-4a1f-b8b2-37bb293f904b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:31.173457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937b085-93d1-4a1f-b8b2-37bb293f904b service placement] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:31.185412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 759/1521] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:48:31.315121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da76b3-07ba-492f-8118-785495bfb71f None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:31.319443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da76b3-07ba-492f-8118-785495bfb71f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:31.319443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da76b3-07ba-492f-8118-785495bfb71f None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:31.319443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:48:31.323408 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2742251-260f-4b49-ba6d-6ad58432e6e6 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:31.323765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2742251-260f-4b49-ba6d-6ad58432e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:31.324041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2742251-260f-4b49-ba6d-6ad58432e6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:31.345492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e2742251-260f-4b49-ba6d-6ad58432e6e6 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:31.346783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e2742251-260f-4b49-ba6d-6ad58432e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:31.355496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:31.521993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da76b3-07ba-492f-8118-785495bfb71f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:31.538031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da76b3-07ba-492f-8118-785495bfb71f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:31.544606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23009df3-ccc0-4db0-b55c-6e46633d50e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:31.545552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009df3-ccc0-4db0-b55c-6e46633d50e4 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:31.545877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009df3-ccc0-4db0-b55c-6e46633d50e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:31.546193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009df3-ccc0-4db0-b55c-6e46633d50e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:31.556229 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23009df3-ccc0-4db0-b55c-6e46633d50e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:31.557869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23009df3-ccc0-4db0-b55c-6e46633d50e4 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:31.568348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 764/1524] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:32.430333 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd15b6d-592b-4986-87cd-d25ff3cb0c8c None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.431100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd15b6d-592b-4986-87cd-d25ff3cb0c8c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.431100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd15b6d-592b-4986-87cd-d25ff3cb0c8c None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.432380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 21:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:48:32.438390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d368b-d393-4d3e-b6dc-04624305a412 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.438969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d368b-d393-4d3e-b6dc-04624305a412 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.439089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d368b-d393-4d3e-b6dc-04624305a412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.461747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0e7d368b-d393-4d3e-b6dc-04624305a412 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:32.463048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0e7d368b-d393-4d3e-b6dc-04624305a412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:32.471312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:32.688873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd15b6d-592b-4986-87cd-d25ff3cb0c8c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:32.704181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd15b6d-592b-4986-87cd-d25ff3cb0c8c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:32.710619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9d3dc-2870-45a0-992a-54bb178240d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:32.711286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d3dc-2870-45a0-992a-54bb178240d4 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:32.711563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d3dc-2870-45a0-992a-54bb178240d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:32.711833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9d3dc-2870-45a0-992a-54bb178240d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:32.721778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9d3dc-2870-45a0-992a-54bb178240d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:32.723449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9d3dc-2870-45a0-992a-54bb178240d4 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:32.734773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 762/1527] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:36.749629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd1348-5048-4dc9-8cf7-1a1918f8fd38 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:36.750376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd1348-5048-4dc9-8cf7-1a1918f8fd38 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:36.750376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd1348-5048-4dc9-8cf7-1a1918f8fd38 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:36.751601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:48:36.757450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de842e9-df70-4597-ac66-6dda62e0bda1 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:36.757955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de842e9-df70-4597-ac66-6dda62e0bda1 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:36.757955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de842e9-df70-4597-ac66-6dda62e0bda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:36.777915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7de842e9-df70-4597-ac66-6dda62e0bda1 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:36.779128 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7de842e9-df70-4597-ac66-6dda62e0bda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:36.788031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:37.080029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd1348-5048-4dc9-8cf7-1a1918f8fd38 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:37.081775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f5fd1348-5048-4dc9-8cf7-1a1918f8fd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:37.161466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd1348-5048-4dc9-8cf7-1a1918f8fd38 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:37.167495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf537d-25a7-4573-8471-d331d3f0155d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:37.168329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf537d-25a7-4573-8471-d331d3f0155d service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:37.168636 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf537d-25a7-4573-8471-d331d3f0155d service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:37.168907 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf537d-25a7-4573-8471-d331d3f0155d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:37.179069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf537d-25a7-4573-8471-d331d3f0155d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:37.180521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf537d-25a7-4573-8471-d331d3f0155d service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:37.190921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 767/1530] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:39.179113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd698008-147a-4a40-8eef-a62746ee5e30 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:39.180043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd698008-147a-4a40-8eef-a62746ee5e30 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:39.180043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd698008-147a-4a40-8eef-a62746ee5e30 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:39.181195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:48:39.187207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dc113-9b7a-4df4-be1b-bcdbcce34c5a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:39.187207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dc113-9b7a-4df4-be1b-bcdbcce34c5a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:39.187805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dc113-9b7a-4df4-be1b-bcdbcce34c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:39.210671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-166dc113-9b7a-4df4-be1b-bcdbcce34c5a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:39.211946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-166dc113-9b7a-4df4-be1b-bcdbcce34c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:39.221719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:48:39.519453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd698008-147a-4a40-8eef-a62746ee5e30 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:39.521242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fd698008-147a-4a40-8eef-a62746ee5e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:39.534864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd698008-147a-4a40-8eef-a62746ee5e30 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:39.538407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23cfae-fced-478b-9e80-e51fce3b30aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:39.539011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23cfae-fced-478b-9e80-e51fce3b30aa service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:39.539286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23cfae-fced-478b-9e80-e51fce3b30aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:39.539562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23cfae-fced-478b-9e80-e51fce3b30aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:39.549738 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23cfae-fced-478b-9e80-e51fce3b30aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:39.551711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23cfae-fced-478b-9e80-e51fce3b30aa service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:39.561822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 765/1533] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:48:43.353771 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc944b1a-3ee1-4efe-bb32-c95fb2299768 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:43.354382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc944b1a-3ee1-4efe-bb32-c95fb2299768 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:43.354382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc944b1a-3ee1-4efe-bb32-c95fb2299768 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:43.355940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:48:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:48:43.362212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f05ae9-6323-46a8-8ca7-91751a32fe75 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:43.362985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f05ae9-6323-46a8-8ca7-91751a32fe75 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:43.362985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f05ae9-6323-46a8-8ca7-91751a32fe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:43.388559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-d6f05ae9-6323-46a8-8ca7-91751a32fe75 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:43.389825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d6f05ae9-6323-46a8-8ca7-91751a32fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:43.398201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:43.974947 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc944b1a-3ee1-4efe-bb32-c95fb2299768 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:43.976725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fc944b1a-3ee1-4efe-bb32-c95fb2299768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:44.056278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc944b1a-3ee1-4efe-bb32-c95fb2299768 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:44.060431 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f27a78-175c-4a84-93c2-8679e5f5a6a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:44.061089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f27a78-175c-4a84-93c2-8679e5f5a6a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:44.061372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f27a78-175c-4a84-93c2-8679e5f5a6a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:44.061676 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f27a78-175c-4a84-93c2-8679e5f5a6a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:44.073328 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f27a78-175c-4a84-93c2-8679e5f5a6a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:44.075108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f27a78-175c-4a84-93c2-8679e5f5a6a4 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:44.087151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 770/1536] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:48:46.100857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215039f-594d-45ff-969c-b331e44b4fb9 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:46.101485 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215039f-594d-45ff-969c-b331e44b4fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:46.101485 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215039f-594d-45ff-969c-b331e44b4fb9 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:46.102777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 21:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:48:46.108648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb118fc2-76f1-4977-93ee-c092822309cd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:46.109446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb118fc2-76f1-4977-93ee-c092822309cd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:46.109605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb118fc2-76f1-4977-93ee-c092822309cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:46.132080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bb118fc2-76f1-4977-93ee-c092822309cd None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:48:46.133341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bb118fc2-76f1-4977-93ee-c092822309cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:46.141359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 21:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:48:46.711211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215039f-594d-45ff-969c-b331e44b4fb9 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:48:46.713163 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3215039f-594d-45ff-969c-b331e44b4fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:48:46.728317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215039f-594d-45ff-969c-b331e44b4fb9 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:48:46.732784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432b262-d4e5-49a3-9c4b-86be45432fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:48:46.733612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b262-d4e5-49a3-9c4b-86be45432fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:48:46.733994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b262-d4e5-49a3-9c4b-86be45432fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:48:46.734369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432b262-d4e5-49a3-9c4b-86be45432fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:48:46.745396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432b262-d4e5-49a3-9c4b-86be45432fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:48:46.747332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432b262-d4e5-49a3-9c4b-86be45432fe9 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:48:46.758109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 768/1539] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:48:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:48:56.125290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=70 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:48:56.752927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=33 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:20.788009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507765ec-8801-4888-9e8b-7423ad6cec08 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:20.794847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507765ec-8801-4888-9e8b-7423ad6cec08 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:20.794847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507765ec-8801-4888-9e8b-7423ad6cec08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:20.829723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-507765ec-8801-4888-9e8b-7423ad6cec08 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:20.836009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-507765ec-8801-4888-9e8b-7423ad6cec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:20.844840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 772/1540] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:20.854834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7004879-6e93-44f8-bdde-d543179b4985 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:20.855954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7004879-6e93-44f8-bdde-d543179b4985 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:20.855954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7004879-6e93-44f8-bdde-d543179b4985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:20.887254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b7004879-6e93-44f8-bdde-d543179b4985 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:20.888517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b7004879-6e93-44f8-bdde-d543179b4985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:20.901083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864bac7-29cf-4d65-84ca-beb83c36bfed None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:20.902616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864bac7-29cf-4d65-84ca-beb83c36bfed None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:20.903949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864bac7-29cf-4d65-84ca-beb83c36bfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:20.911436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 769/1541] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:20.932028 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7004879-6e93-44f8-bdde-d543179b4985 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:20.946555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4864bac7-29cf-4d65-84ca-beb83c36bfed None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:20.946828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7004879-6e93-44f8-bdde-d543179b4985 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:20.948713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4864bac7-29cf-4d65-84ca-beb83c36bfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:20.960310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfaa2c1-9691-4de0-868f-12e98e255550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:20.960999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaa2c1-9691-4de0-868f-12e98e255550 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:20.961284 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaa2c1-9691-4de0-868f-12e98e255550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:20.961563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfaa2c1-9691-4de0-868f-12e98e255550 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:20.962259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfaa2c1-9691-4de0-868f-12e98e255550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:20.962664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfaa2c1-9691-4de0-868f-12e98e255550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:20.963752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: WARNING py.warnings [None req-0dfaa2c1-9691-4de0-868f-12e98e255550 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:50:20.963752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: warnings.warn(msg) Aug 29 21:50:20.963752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: Aug 29 21:50:20.964673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfaa2c1-9691-4de0-868f-12e98e255550 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:20.968031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 773/1542] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:20.970555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81c2a9-8375-4c60-8fa5-ac375aa5572c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:20.971175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81c2a9-8375-4c60-8fa5-ac375aa5572c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:20.971680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81c2a9-8375-4c60-8fa5-ac375aa5572c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:20.983457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 770/1543] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:20.987851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc4ca4-5e8c-4202-957c-ae8a7ab96c03 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:20.988203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc4ca4-5e8c-4202-957c-ae8a7ab96c03 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:20.988437 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc4ca4-5e8c-4202-957c-ae8a7ab96c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.009278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5d81c2a9-8375-4c60-8fa5-ac375aa5572c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.011287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5d81c2a9-8375-4c60-8fa5-ac375aa5572c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.023462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 774/1544] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.025443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81c2a9-8375-4c60-8fa5-ac375aa5572c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:21.030411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c1bc4ca4-5e8c-4202-957c-ae8a7ab96c03 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.036263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c1bc4ca4-5e8c-4202-957c-ae8a7ab96c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.043969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81c2a9-8375-4c60-8fa5-ac375aa5572c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:21.050866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb99cc1-7402-4550-8a1c-3e776ee686a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:21.052135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb99cc1-7402-4550-8a1c-3e776ee686a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.057242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb99cc1-7402-4550-8a1c-3e776ee686a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.058280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb99cc1-7402-4550-8a1c-3e776ee686a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.059202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb99cc1-7402-4550-8a1c-3e776ee686a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:21.060733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-cbb99cc1-7402-4550-8a1c-3e776ee686a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:50:21.060733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 21:50:21.060733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: Aug 29 21:50:21.063275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb99cc1-7402-4550-8a1c-3e776ee686a0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:21.078135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 771/1545] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.079582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75395-ef8c-4768-88b4-b058de7ae85b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.079867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75395-ef8c-4768-88b4-b058de7ae85b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.080141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db75395-ef8c-4768-88b4-b058de7ae85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.122603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7db75395-ef8c-4768-88b4-b058de7ae85b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.124766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7db75395-ef8c-4768-88b4-b058de7ae85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.141531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 772/1546] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.143078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db75395-ef8c-4768-88b4-b058de7ae85b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:21.159921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db75395-ef8c-4768-88b4-b058de7ae85b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:21.167928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb788cd-07bb-4161-b871-02f038041138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:21.169429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb788cd-07bb-4161-b871-02f038041138 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.170103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb788cd-07bb-4161-b871-02f038041138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.170906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb788cd-07bb-4161-b871-02f038041138 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.172576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb788cd-07bb-4161-b871-02f038041138 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:21.173296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb788cd-07bb-4161-b871-02f038041138 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:21.175530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb788cd-07bb-4161-b871-02f038041138 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:21.195766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 773/1547] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:21.197440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb788cd-07bb-4161-b871-02f038041138 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:21.215871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb788cd-07bb-4161-b871-02f038041138 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:21.229824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 775/1548] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/projects => generated 367 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:21.235652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcbb0b-818a-4860-af59-f50d02a5355c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.236942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcbb0b-818a-4860-af59-f50d02a5355c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.238200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fcbb0b-818a-4860-af59-f50d02a5355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.246203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0c345-8461-4c49-944c-d3667aa9df29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:21.247166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c345-8461-4c49-944c-d3667aa9df29 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.247910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c345-8461-4c49-944c-d3667aa9df29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.248579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0c345-8461-4c49-944c-d3667aa9df29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.249551 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c345-8461-4c49-944c-d3667aa9df29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:21.250087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c345-8461-4c49-944c-d3667aa9df29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:21.252340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0c345-8461-4c49-944c-d3667aa9df29 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:21.272189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 774/1549] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:21.274306 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0c345-8461-4c49-944c-d3667aa9df29 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:21.284945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a1fcbb0b-818a-4860-af59-f50d02a5355c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.286294 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a1fcbb0b-818a-4860-af59-f50d02a5355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.305806 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0c345-8461-4c49-944c-d3667aa9df29 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:21.404561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 776/1550] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.404561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcbb0b-818a-4860-af59-f50d02a5355c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:21.413807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90dc7d-6eb1-4507-833f-03f004a36675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:21.415207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90dc7d-6eb1-4507-833f-03f004a36675 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.415670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90dc7d-6eb1-4507-833f-03f004a36675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.416101 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90dc7d-6eb1-4507-833f-03f004a36675 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.416960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fcbb0b-818a-4860-af59-f50d02a5355c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:21.417136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90dc7d-6eb1-4507-833f-03f004a36675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:21.419422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90dc7d-6eb1-4507-833f-03f004a36675 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:21.426068 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1db2d-8730-41ba-9276-d80c1998e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:21.427158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1db2d-8730-41ba-9276-d80c1998e3f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.427442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1db2d-8730-41ba-9276-d80c1998e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.427716 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1db2d-8730-41ba-9276-d80c1998e3f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.428385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1db2d-8730-41ba-9276-d80c1998e3f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:21.430414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1db2d-8730-41ba-9276-d80c1998e3f2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:21.594954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 777/1551] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:21.598670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 775/1552] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/projects => generated 367 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:21.598670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90dc7d-6eb1-4507-833f-03f004a36675 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:21.598921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94364e-2e70-43f8-bc79-4f4232678db1 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.598921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94364e-2e70-43f8-bc79-4f4232678db1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.598921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94364e-2e70-43f8-bc79-4f4232678db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.618132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1f94364e-2e70-43f8-bc79-4f4232678db1 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.619375 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1f94364e-2e70-43f8-bc79-4f4232678db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.677596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90dc7d-6eb1-4507-833f-03f004a36675 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:21.683322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624d5b6-a97c-4d3e-a545-537128196c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:21.683944 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624d5b6-a97c-4d3e-a545-537128196c4d admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.684221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624d5b6-a97c-4d3e-a545-537128196c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.684508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624d5b6-a97c-4d3e-a545-537128196c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.685164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624d5b6-a97c-4d3e-a545-537128196c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:21.686083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 778/1553] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.692625 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624d5b6-a97c-4d3e-a545-537128196c4d admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:21.692844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75fd6-24a2-4d5e-bbc3-4752ed6151d9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.692844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75fd6-24a2-4d5e-bbc3-4752ed6151d9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.692844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75fd6-24a2-4d5e-bbc3-4752ed6151d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.711771 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-01f75fd6-24a2-4d5e-bbc3-4752ed6151d9 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.716807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-01f75fd6-24a2-4d5e-bbc3-4752ed6151d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.721317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 779/1554] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.722760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c4f61-74ba-4cad-9622-7635e3d8a3ad None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.723143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c4f61-74ba-4cad-9622-7635e3d8a3ad None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.723426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c4f61-74ba-4cad-9622-7635e3d8a3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.743728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-601c4f61-74ba-4cad-9622-7635e3d8a3ad None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.744983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-601c4f61-74ba-4cad-9622-7635e3d8a3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.753903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 780/1555] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.756980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb361ff-ae80-473f-8c22-2a8e100d5cab None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.756980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb361ff-ae80-473f-8c22-2a8e100d5cab None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.756980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb361ff-ae80-473f-8c22-2a8e100d5cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.775637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1fb361ff-ae80-473f-8c22-2a8e100d5cab None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.776882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1fb361ff-ae80-473f-8c22-2a8e100d5cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.783905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 776/1556] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:21.792624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 781/1557] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.793147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351256f-2460-48e8-b25b-50ab795fd516 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.793147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351256f-2460-48e8-b25b-50ab795fd516 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.793345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb361ff-ae80-473f-8c22-2a8e100d5cab None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:21.793451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351256f-2460-48e8-b25b-50ab795fd516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.797315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb361ff-ae80-473f-8c22-2a8e100d5cab None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:21.808620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7351256f-2460-48e8-b25b-50ab795fd516 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.809944 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7351256f-2460-48e8-b25b-50ab795fd516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.816504 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:21.818166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:21.858788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413fde5-a258-4301-a7d9-d915686c62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:21.859852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413fde5-a258-4301-a7d9-d915686c62f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.860115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413fde5-a258-4301-a7d9-d915686c62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.860392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413fde5-a258-4301-a7d9-d915686c62f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.861087 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413fde5-a258-4301-a7d9-d915686c62f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:21.862715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413fde5-a258-4301-a7d9-d915686c62f7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:21.873567 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 782/1558] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:21.874521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413fde5-a258-4301-a7d9-d915686c62f7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:21.879906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 777/1559] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.881302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650a6aa-d01b-449b-b54d-3b65fe013c05 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.881600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650a6aa-d01b-449b-b54d-3b65fe013c05 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.881874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650a6aa-d01b-449b-b54d-3b65fe013c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.888220 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413fde5-a258-4301-a7d9-d915686c62f7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:21.893451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1f6de-3d1b-43c8-9093-1d4bb88dcabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:21.894233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1f6de-3d1b-43c8-9093-1d4bb88dcabe admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.894581 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1f6de-3d1b-43c8-9093-1d4bb88dcabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.894859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1f6de-3d1b-43c8-9093-1d4bb88dcabe admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.895495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1f6de-3d1b-43c8-9093-1d4bb88dcabe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:21.897602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c1f6de-3d1b-43c8-9093-1d4bb88dcabe admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:21.902165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0650a6aa-d01b-449b-b54d-3b65fe013c05 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.903381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0650a6aa-d01b-449b-b54d-3b65fe013c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.913393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 778/1560] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.923687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053ac99-38d2-4cda-aa08-9726995bfb13 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.923687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053ac99-38d2-4cda-aa08-9726995bfb13 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.923687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053ac99-38d2-4cda-aa08-9726995bfb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.936906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0053ac99-38d2-4cda-aa08-9726995bfb13 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.938684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0053ac99-38d2-4cda-aa08-9726995bfb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.947879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 779/1561] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.949383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e14f0-a50c-41d4-b330-1a3a86462612 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.949719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e14f0-a50c-41d4-b330-1a3a86462612 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.949990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e14f0-a50c-41d4-b330-1a3a86462612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.969986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b24e14f0-a50c-41d4-b330-1a3a86462612 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:21.971179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b24e14f0-a50c-41d4-b330-1a3a86462612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:21.979482 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 780/1562] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:21.986932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e14f0-a50c-41d4-b330-1a3a86462612 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:21.991150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e14f0-a50c-41d4-b330-1a3a86462612 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:21.995996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed846d1-1b03-4be8-9acd-385cb3500ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:21.996652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed846d1-1b03-4be8-9acd-385cb3500ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:21.996972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed846d1-1b03-4be8-9acd-385cb3500ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:21.997250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed846d1-1b03-4be8-9acd-385cb3500ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:21.997925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed846d1-1b03-4be8-9acd-385cb3500ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:21.998936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: WARNING py.warnings [None req-2ed846d1-1b03-4be8-9acd-385cb3500ba4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:50:21.998936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: warnings.warn(msg) Aug 29 21:50:21.998936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: Aug 29 21:50:22.000197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed846d1-1b03-4be8-9acd-385cb3500ba4 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.020033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 783/1563] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/users => generated 284 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:22.020033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1f6de-3d1b-43c8-9093-1d4bb88dcabe admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.029115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1f6de-3d1b-43c8-9093-1d4bb88dcabe admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.042128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39208b-e840-4e7a-9cd5-06dd7fd1f2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.043025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39208b-e840-4e7a-9cd5-06dd7fd1f2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.043185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39208b-e840-4e7a-9cd5-06dd7fd1f2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.043377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39208b-e840-4e7a-9cd5-06dd7fd1f2d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.044046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39208b-e840-4e7a-9cd5-06dd7fd1f2d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:22.044347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39208b-e840-4e7a-9cd5-06dd7fd1f2d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.046265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39208b-e840-4e7a-9cd5-06dd7fd1f2d6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.064635 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 784/1564] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:22.064635 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39208b-e840-4e7a-9cd5-06dd7fd1f2d6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.074448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39208b-e840-4e7a-9cd5-06dd7fd1f2d6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.079264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c499a06-bf04-477f-b0c5-94c38e0ab4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.079877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c499a06-bf04-477f-b0c5-94c38e0ab4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.080150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c499a06-bf04-477f-b0c5-94c38e0ab4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.080418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c499a06-bf04-477f-b0c5-94c38e0ab4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.081101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c499a06-bf04-477f-b0c5-94c38e0ab4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.082689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c499a06-bf04-477f-b0c5-94c38e0ab4a9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.093373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 785/1565] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:22.095194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ac8f2-7e0f-4794-a00a-86c38c70f432 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.095474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ac8f2-7e0f-4794-a00a-86c38c70f432 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.095742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ac8f2-7e0f-4794-a00a-86c38c70f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.113047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 781/1566] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:21 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:22.113887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed846d1-1b03-4be8-9acd-385cb3500ba4 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.119982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-731ac8f2-7e0f-4794-a00a-86c38c70f432 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:22.124743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-731ac8f2-7e0f-4794-a00a-86c38c70f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:22.125098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed846d1-1b03-4be8-9acd-385cb3500ba4 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.129711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 786/1567] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:22.130713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ac8f2-7e0f-4794-a00a-86c38c70f432 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.132659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971578b6-adb8-4cf6-9d5e-89e09b77c8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.133690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971578b6-adb8-4cf6-9d5e-89e09b77c8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.134254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971578b6-adb8-4cf6-9d5e-89e09b77c8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.134670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971578b6-adb8-4cf6-9d5e-89e09b77c8fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.135616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971578b6-adb8-4cf6-9d5e-89e09b77c8fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:22.136063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971578b6-adb8-4cf6-9d5e-89e09b77c8fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.137915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971578b6-adb8-4cf6-9d5e-89e09b77c8fc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.140697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ac8f2-7e0f-4794-a00a-86c38c70f432 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.150616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb098b-8053-4a02-9242-e36e39273827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.151336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb098b-8053-4a02-9242-e36e39273827 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.151615 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb098b-8053-4a02-9242-e36e39273827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.151892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb098b-8053-4a02-9242-e36e39273827 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.152144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 782/1568] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:22.152588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb098b-8053-4a02-9242-e36e39273827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:22.152901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb098b-8053-4a02-9242-e36e39273827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.153276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971578b6-adb8-4cf6-9d5e-89e09b77c8fc admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.154948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb098b-8053-4a02-9242-e36e39273827 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.164668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971578b6-adb8-4cf6-9d5e-89e09b77c8fc admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.168816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 787/1569] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:22.169675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb098b-8053-4a02-9242-e36e39273827 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.169807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d833cd-20b7-4a41-aec5-2697d07d47f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.170910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d833cd-20b7-4a41-aec5-2697d07d47f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.171193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d833cd-20b7-4a41-aec5-2697d07d47f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.171462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d833cd-20b7-4a41-aec5-2697d07d47f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.172698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d833cd-20b7-4a41-aec5-2697d07d47f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:22.172999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d833cd-20b7-4a41-aec5-2697d07d47f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.174716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d833cd-20b7-4a41-aec5-2697d07d47f3 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.183689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb098b-8053-4a02-9242-e36e39273827 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.187300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 783/1570] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:22.196506 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d833cd-20b7-4a41-aec5-2697d07d47f3 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.196697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3a43-f21d-4858-b160-2d3791a89c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.196697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3a43-f21d-4858-b160-2d3791a89c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.196697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3a43-f21d-4858-b160-2d3791a89c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.196697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3a43-f21d-4858-b160-2d3791a89c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.197060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a3a43-f21d-4858-b160-2d3791a89c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.197060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a3a43-f21d-4858-b160-2d3791a89c8f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.198094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d833cd-20b7-4a41-aec5-2697d07d47f3 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.203242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca51a79-b924-41ec-acae-7c9c51adf82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.203859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca51a79-b924-41ec-acae-7c9c51adf82a admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.204137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca51a79-b924-41ec-acae-7c9c51adf82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.204407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca51a79-b924-41ec-acae-7c9c51adf82a admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.205078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca51a79-b924-41ec-acae-7c9c51adf82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.206998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca51a79-b924-41ec-acae-7c9c51adf82a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.208808 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 788/1571] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:22.209850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3a43-f21d-4858-b160-2d3791a89c8f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.220928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3a43-f21d-4858-b160-2d3791a89c8f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.226648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327807-5ccb-42c1-ad44-9092c847b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.226856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327807-5ccb-42c1-ad44-9092c847b17b admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.227101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327807-5ccb-42c1-ad44-9092c847b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.227444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71327807-5ccb-42c1-ad44-9092c847b17b admin admin] PATH_INFO: `/v3/projects/27b8b6c731c54b37b3d0ea39ebcbd088/users/2781d93982944a65a835387bf8fcebe0/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.244995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71327807-5ccb-42c1-ad44-9092c847b17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b8b6c731c54b37b3d0ea39ebcbd088, user_id=2781d93982944a65a835387bf8fcebe0, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.246048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-71327807-5ccb-42c1-ad44-9092c847b17b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:50:22.246048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 21:50:22.246048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: Aug 29 21:50:22.248076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71327807-5ccb-42c1-ad44-9092c847b17b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.333033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 784/1572] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:22 2022] POST /identity/v3/projects => generated 389 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:22.334197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca51a79-b924-41ec-acae-7c9c51adf82a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.349185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 789/1573] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:22 2022] PUT /identity/v3/projects/27b8b6c731c54b37b3d0ea39ebcbd088/users/2781d93982944a65a835387bf8fcebe0/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:22.359363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327807-5ccb-42c1-ad44-9092c847b17b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.400650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca51a79-b924-41ec-acae-7c9c51adf82a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.424927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71327807-5ccb-42c1-ad44-9092c847b17b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.430049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bf56b-0540-43b9-91a4-18ae99f06c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.430664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bf56b-0540-43b9-91a4-18ae99f06c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.431066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bf56b-0540-43b9-91a4-18ae99f06c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.431341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238bf56b-0540-43b9-91a4-18ae99f06c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.432043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bf56b-0540-43b9-91a4-18ae99f06c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:22.432226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:22.432381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bf56b-0540-43b9-91a4-18ae99f06c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.434033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238bf56b-0540-43b9-91a4-18ae99f06c9b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.446827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 790/1574] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:22.447710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bf56b-0540-43b9-91a4-18ae99f06c9b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.459189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238bf56b-0540-43b9-91a4-18ae99f06c9b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.461711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1799b-76f1-4467-8161-29c8d137a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.462338 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1799b-76f1-4467-8161-29c8d137a965 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.462619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1799b-76f1-4467-8161-29c8d137a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.462900 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1799b-76f1-4467-8161-29c8d137a965 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.463595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1799b-76f1-4467-8161-29c8d137a965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.464148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e10be-d2e1-4b94-9a4b-5bc63b33bcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.464801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e10be-d2e1-4b94-9a4b-5bc63b33bcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.465084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e10be-d2e1-4b94-9a4b-5bc63b33bcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.465359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e10be-d2e1-4b94-9a4b-5bc63b33bcf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.465479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1799b-76f1-4467-8161-29c8d137a965 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.466127 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e10be-d2e1-4b94-9a4b-5bc63b33bcf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.467942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e10be-d2e1-4b94-9a4b-5bc63b33bcf7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.478804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 785/1575] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:22.479699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1799b-76f1-4467-8161-29c8d137a965 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.486825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:22.491194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1799b-76f1-4467-8161-29c8d137a965 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.497352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826b7c-ee84-436f-a92c-b1730bec3ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.498013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826b7c-ee84-436f-a92c-b1730bec3ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.498425 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826b7c-ee84-436f-a92c-b1730bec3ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.498754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f826b7c-ee84-436f-a92c-b1730bec3ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.499573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f826b7c-ee84-436f-a92c-b1730bec3ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.502690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f826b7c-ee84-436f-a92c-b1730bec3ef2 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.561565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 791/1576] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:22 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:22.562664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e10be-d2e1-4b94-9a4b-5bc63b33bcf7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.634823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e10be-d2e1-4b94-9a4b-5bc63b33bcf7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.640994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f3655-3d2b-41fa-badd-96d91fd7844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.641791 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f3655-3d2b-41fa-badd-96d91fd7844f admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.642141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f3655-3d2b-41fa-badd-96d91fd7844f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.642543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f3655-3d2b-41fa-badd-96d91fd7844f admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.643523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f3655-3d2b-41fa-badd-96d91fd7844f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.645951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f3655-3d2b-41fa-badd-96d91fd7844f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.658627 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 786/1577] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:22 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:22.658627 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826b7c-ee84-436f-a92c-b1730bec3ef2 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.731935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f826b7c-ee84-436f-a92c-b1730bec3ef2 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.737087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf340d2-4983-4150-982c-26241e40d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.737702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf340d2-4983-4150-982c-26241e40d7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.737976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf340d2-4983-4150-982c-26241e40d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.738244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf340d2-4983-4150-982c-26241e40d7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.738891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf340d2-4983-4150-982c-26241e40d7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.740521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf340d2-4983-4150-982c-26241e40d7cd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.754317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 792/1578] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:22 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:22.754522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 787/1579] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:22.754609 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f3655-3d2b-41fa-badd-96d91fd7844f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.754684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da1c0-69f2-4873-afb3-dace488871dc None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.754684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da1c0-69f2-4873-afb3-dace488871dc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.754684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573da1c0-69f2-4873-afb3-dace488871dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.792868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-573da1c0-69f2-4873-afb3-dace488871dc None None] MFA Rules not processed for user `2781d93982944a65a835387bf8fcebe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:22.794788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-573da1c0-69f2-4873-afb3-dace488871dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:22.839419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f3655-3d2b-41fa-badd-96d91fd7844f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.844223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16138b88-eea9-4347-9c99-b273a00a5c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.844889 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16138b88-eea9-4347-9c99-b273a00a5c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.845170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16138b88-eea9-4347-9c99-b273a00a5c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.845437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16138b88-eea9-4347-9c99-b273a00a5c77 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.846076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16138b88-eea9-4347-9c99-b273a00a5c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.848010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16138b88-eea9-4347-9c99-b273a00a5c77 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.873061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 788/1580] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:22.874130 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573da1c0-69f2-4873-afb3-dace488871dc None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.887282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573da1c0-69f2-4873-afb3-dace488871dc None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.893803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbeec2-025b-4316-8180-859af97f62bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:22.894478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbeec2-025b-4316-8180-859af97f62bf admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:22.895310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbeec2-025b-4316-8180-859af97f62bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:22.895310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbeec2-025b-4316-8180-859af97f62bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:22.895782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbeec2-025b-4316-8180-859af97f62bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:22.897822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbeec2-025b-4316-8180-859af97f62bf admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:22.968153 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 793/1581] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:22 2022] POST /identity/v3/users => generated 295 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:22.969475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16138b88-eea9-4347-9c99-b273a00a5c77 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:22.983071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16138b88-eea9-4347-9c99-b273a00a5c77 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:22.984800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 789/1582] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:22 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:22.985649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbeec2-025b-4316-8180-859af97f62bf admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.002037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:23.062288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbeec2-025b-4316-8180-859af97f62bf admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.069379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaefaf-1fe0-4e17-b3b6-e8035f4afcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.070114 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaefaf-1fe0-4e17-b3b6-e8035f4afcbb admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.070392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaefaf-1fe0-4e17-b3b6-e8035f4afcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.070723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaefaf-1fe0-4e17-b3b6-e8035f4afcbb admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.071459 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aaefaf-1fe0-4e17-b3b6-e8035f4afcbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.072107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7ed69-a390-45fe-b282-3589f0032f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.072781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7ed69-a390-45fe-b282-3589f0032f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.073075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7ed69-a390-45fe-b282-3589f0032f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.073351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7ed69-a390-45fe-b282-3589f0032f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.074000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aaefaf-1fe0-4e17-b3b6-e8035f4afcbb admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.074101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7ed69-a390-45fe-b282-3589f0032f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.075636 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7ed69-a390-45fe-b282-3589f0032f84 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.086776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 794/1583] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:23.087616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7ed69-a390-45fe-b282-3589f0032f84 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.095787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:23.099739 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7ed69-a390-45fe-b282-3589f0032f84 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.104922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e1348-5ce5-49d6-9f26-93aa75956f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.105096 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1348-5ce5-49d6-9f26-93aa75956f2c admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.105375 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1348-5ce5-49d6-9f26-93aa75956f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.105669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e1348-5ce5-49d6-9f26-93aa75956f2c admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.106299 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e1348-5ce5-49d6-9f26-93aa75956f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.108215 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e1348-5ce5-49d6-9f26-93aa75956f2c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.188617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 790/1584] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:22 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:23.189599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaefaf-1fe0-4e17-b3b6-e8035f4afcbb admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.199811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaefaf-1fe0-4e17-b3b6-e8035f4afcbb admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.204775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ed0b2-2eab-4b94-9a4b-e355b980b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.205003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 795/1585] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:23 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:23.205399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ed0b2-2eab-4b94-9a4b-e355b980b319 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.205679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ed0b2-2eab-4b94-9a4b-e355b980b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.205960 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ed0b2-2eab-4b94-9a4b-e355b980b319 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.206589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ed0b2-2eab-4b94-9a4b-e355b980b319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.207026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e1348-5ce5-49d6-9f26-93aa75956f2c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.208671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ed0b2-2eab-4b94-9a4b-e355b980b319 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.219132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e1348-5ce5-49d6-9f26-93aa75956f2c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.224966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2d5f6-192f-424c-8d15-8d2f9b816744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.225867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2d5f6-192f-424c-8d15-8d2f9b816744 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.226137 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2d5f6-192f-424c-8d15-8d2f9b816744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.226430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2d5f6-192f-424c-8d15-8d2f9b816744 admin admin] PATH_INFO: `/v3/projects/710b77d088734bca99607de3548945bf/users/783ab09b25294b72942d03d6ba722413/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.243039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2d5f6-192f-424c-8d15-8d2f9b816744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710b77d088734bca99607de3548945bf, user_id=783ab09b25294b72942d03d6ba722413, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.245896 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2d5f6-192f-424c-8d15-8d2f9b816744 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.314548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 791/1586] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:23 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:23.316149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ed0b2-2eab-4b94-9a4b-e355b980b319 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.334777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ed0b2-2eab-4b94-9a4b-e355b980b319 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.342946 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae442c04-1c1d-4482-8702-159823d75646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.344026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442c04-1c1d-4482-8702-159823d75646 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.344577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442c04-1c1d-4482-8702-159823d75646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.345079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae442c04-1c1d-4482-8702-159823d75646 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.346373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae442c04-1c1d-4482-8702-159823d75646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.350292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae442c04-1c1d-4482-8702-159823d75646 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.370022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 796/1587] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:23 2022] PUT /identity/v3/projects/710b77d088734bca99607de3548945bf/users/783ab09b25294b72942d03d6ba722413/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:23.370975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2d5f6-192f-424c-8d15-8d2f9b816744 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.448354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2d5f6-192f-424c-8d15-8d2f9b816744 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.453413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739580af-97ff-43d5-87a2-232301d7059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.454056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739580af-97ff-43d5-87a2-232301d7059a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.457308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739580af-97ff-43d5-87a2-232301d7059a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.457308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739580af-97ff-43d5-87a2-232301d7059a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.457308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739580af-97ff-43d5-87a2-232301d7059a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.457308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739580af-97ff-43d5-87a2-232301d7059a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.458574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 792/1588] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:23 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:23.459445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae442c04-1c1d-4482-8702-159823d75646 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.471988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 797/1589] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:23.472633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739580af-97ff-43d5-87a2-232301d7059a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.492678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739580af-97ff-43d5-87a2-232301d7059a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.543818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae442c04-1c1d-4482-8702-159823d75646 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.550805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1c7ff-b2da-4c0e-b8f2-3be08a91cdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.551439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1c7ff-b2da-4c0e-b8f2-3be08a91cdde admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.552086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1c7ff-b2da-4c0e-b8f2-3be08a91cdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.552377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1c7ff-b2da-4c0e-b8f2-3be08a91cdde admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.553368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1c7ff-b2da-4c0e-b8f2-3be08a91cdde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.556161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1c7ff-b2da-4c0e-b8f2-3be08a91cdde admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.568938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b5441-dd8d-49dc-989f-4e9285d64400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.569634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b5441-dd8d-49dc-989f-4e9285d64400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.569924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b5441-dd8d-49dc-989f-4e9285d64400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.570202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b5441-dd8d-49dc-989f-4e9285d64400 admin admin] PATH_INFO: `/v3/projects/4d6eb6dd6cad46be81629819c22e3cc1/users/99285bae990640b597103115522f0ecc/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.589377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b5441-dd8d-49dc-989f-4e9285d64400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6eb6dd6cad46be81629819c22e3cc1, user_id=99285bae990640b597103115522f0ecc, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.592214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b5441-dd8d-49dc-989f-4e9285d64400 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.630899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 793/1590] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:23 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:23.632045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1c7ff-b2da-4c0e-b8f2-3be08a91cdde admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.645554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1c7ff-b2da-4c0e-b8f2-3be08a91cdde admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.650724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8042-7969-4f2b-9673-3c707c916ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.651614 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8042-7969-4f2b-9673-3c707c916ddc admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.651962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8042-7969-4f2b-9673-3c707c916ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.652309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c8042-7969-4f2b-9673-3c707c916ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.653095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8042-7969-4f2b-9673-3c707c916ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.655852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c8042-7969-4f2b-9673-3c707c916ddc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.676244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 794/1591] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:23.676244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8042-7969-4f2b-9673-3c707c916ddc admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.682003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 798/1592] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:23 2022] PUT /identity/v3/projects/4d6eb6dd6cad46be81629819c22e3cc1/users/99285bae990640b597103115522f0ecc/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:23.683884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b5441-dd8d-49dc-989f-4e9285d64400 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.695686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c8042-7969-4f2b-9673-3c707c916ddc admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.742416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:23.743660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:23.761227 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b5441-dd8d-49dc-989f-4e9285d64400 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.762970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3f218-71fd-45b2-897d-dd754bb3610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.763691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3f218-71fd-45b2-897d-dd754bb3610c admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.764038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3f218-71fd-45b2-897d-dd754bb3610c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.764397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3f218-71fd-45b2-897d-dd754bb3610c admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.765094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3f218-71fd-45b2-897d-dd754bb3610c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.766780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3f218-71fd-45b2-897d-dd754bb3610c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.767118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98907e25-a3f7-4829-bc76-542d78e1b4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.767847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98907e25-a3f7-4829-bc76-542d78e1b4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.768129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98907e25-a3f7-4829-bc76-542d78e1b4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.768402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98907e25-a3f7-4829-bc76-542d78e1b4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.769184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98907e25-a3f7-4829-bc76-542d78e1b4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.770823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98907e25-a3f7-4829-bc76-542d78e1b4dc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.785090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 799/1593] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:23.785372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 795/1594] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:23.785589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b775f0a-f0f7-4d10-b165-c0ff1405dcb6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.785589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b775f0a-f0f7-4d10-b165-c0ff1405dcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.785589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b775f0a-f0f7-4d10-b165-c0ff1405dcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.786394 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3f218-71fd-45b2-897d-dd754bb3610c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.798074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3f218-71fd-45b2-897d-dd754bb3610c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.806014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb2852-cc1b-4db9-802d-8615f736877e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.806790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2852-cc1b-4db9-802d-8615f736877e admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.807079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2852-cc1b-4db9-802d-8615f736877e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.807356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb2852-cc1b-4db9-802d-8615f736877e admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.808004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb2852-cc1b-4db9-802d-8615f736877e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.810048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb2852-cc1b-4db9-802d-8615f736877e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.815184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7b775f0a-f0f7-4d10-b165-c0ff1405dcb6 None None] MFA Rules not processed for user `783ab09b25294b72942d03d6ba722413`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:23.817812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7b775f0a-f0f7-4d10-b165-c0ff1405dcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:23.889330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 800/1595] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:23.891211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b775f0a-f0f7-4d10-b165-c0ff1405dcb6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.903447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b775f0a-f0f7-4d10-b165-c0ff1405dcb6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.911595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 796/1596] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:23 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:23.912170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e28032-4881-4486-838c-0049e751319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.912319 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb2852-cc1b-4db9-802d-8615f736877e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.912404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28032-4881-4486-838c-0049e751319d admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.912404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28032-4881-4486-838c-0049e751319d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.912404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28032-4881-4486-838c-0049e751319d admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.912404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e28032-4881-4486-838c-0049e751319d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.913079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e28032-4881-4486-838c-0049e751319d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.920578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb2852-cc1b-4db9-802d-8615f736877e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.925706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062755-148b-4dcf-919b-e2611eccf5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.926330 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062755-148b-4dcf-919b-e2611eccf5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.926645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062755-148b-4dcf-919b-e2611eccf5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.926804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 801/1597] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:23.930787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062755-148b-4dcf-919b-e2611eccf5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.930906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e28032-4881-4486-838c-0049e751319d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.931004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1062755-148b-4dcf-919b-e2611eccf5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.931004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1062755-148b-4dcf-919b-e2611eccf5e7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.938123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e28032-4881-4486-838c-0049e751319d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.940942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 797/1598] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:23.942295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca775ca7-9c3d-478d-8338-f69afccd65b7 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.942589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca775ca7-9c3d-478d-8338-f69afccd65b7 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.942865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca775ca7-9c3d-478d-8338-f69afccd65b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.947632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa5184-cb8c-41dc-a4e4-0fa234ed0a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.948227 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa5184-cb8c-41dc-a4e4-0fa234ed0a2c admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.948523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa5184-cb8c-41dc-a4e4-0fa234ed0a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.948825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa5184-cb8c-41dc-a4e4-0fa234ed0a2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.949462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa5184-cb8c-41dc-a4e4-0fa234ed0a2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.951049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa5184-cb8c-41dc-a4e4-0fa234ed0a2c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:23.962850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 802/1599] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:23.963709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa5184-cb8c-41dc-a4e4-0fa234ed0a2c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:23.974279 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-ca775ca7-9c3d-478d-8338-f69afccd65b7 None None] MFA Rules not processed for user `99285bae990640b597103115522f0ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:23.975511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ca775ca7-9c3d-478d-8338-f69afccd65b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:23.977367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa5184-cb8c-41dc-a4e4-0fa234ed0a2c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:23.982629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2afa-9f42-46e3-aebd-b6e6bd3458dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:23.983253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2afa-9f42-46e3-aebd-b6e6bd3458dd admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:23.983528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2afa-9f42-46e3-aebd-b6e6bd3458dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:23.983802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2afa-9f42-46e3-aebd-b6e6bd3458dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:23.984453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2afa-9f42-46e3-aebd-b6e6bd3458dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:23.986184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2afa-9f42-46e3-aebd-b6e6bd3458dd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.001298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 803/1600] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:24.004964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2afa-9f42-46e3-aebd-b6e6bd3458dd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.019647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2afa-9f42-46e3-aebd-b6e6bd3458dd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:24.027560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1952e5-b920-4f7d-ace0-0804dec68713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:24.028319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1952e5-b920-4f7d-ace0-0804dec68713 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.028636 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1952e5-b920-4f7d-ace0-0804dec68713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.028905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1952e5-b920-4f7d-ace0-0804dec68713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.029548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1952e5-b920-4f7d-ace0-0804dec68713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:24.031817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1952e5-b920-4f7d-ace0-0804dec68713 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.042741 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 804/1601] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:24.043658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1952e5-b920-4f7d-ace0-0804dec68713 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.051265 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 798/1602] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:24.052891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca775ca7-9c3d-478d-8338-f69afccd65b7 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.065034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca775ca7-9c3d-478d-8338-f69afccd65b7 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:24.070507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8b84d-1fbe-4283-8504-99f66842f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:24.071129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b84d-1fbe-4283-8504-99f66842f986 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.071403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b84d-1fbe-4283-8504-99f66842f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.071669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c8b84d-1fbe-4283-8504-99f66842f986 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.072317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8b84d-1fbe-4283-8504-99f66842f986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:24.073934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c8b84d-1fbe-4283-8504-99f66842f986 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.085668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 799/1603] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:24.086365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8b84d-1fbe-4283-8504-99f66842f986 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.098925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c8b84d-1fbe-4283-8504-99f66842f986 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:24.104247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6833ca-8a5e-4083-977c-e02df2fa5bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:24.104949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6833ca-8a5e-4083-977c-e02df2fa5bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.105223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6833ca-8a5e-4083-977c-e02df2fa5bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.105573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6833ca-8a5e-4083-977c-e02df2fa5bfd admin admin] PATH_INFO: `/v3/projects/754af1c2cd154e91ad9ecbee3ce04d0d/users/fb465b4782514e7d8e75a7dc14c0a1e7/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.130342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6833ca-8a5e-4083-977c-e02df2fa5bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=754af1c2cd154e91ad9ecbee3ce04d0d, user_id=fb465b4782514e7d8e75a7dc14c0a1e7, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:24.134695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6833ca-8a5e-4083-977c-e02df2fa5bfd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.137517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1952e5-b920-4f7d-ace0-0804dec68713 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:24.141839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f0a34-f23e-4549-ab0e-b0f55aca09d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:24.142460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f0a34-f23e-4549-ab0e-b0f55aca09d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.142734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f0a34-f23e-4549-ab0e-b0f55aca09d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.143005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f0a34-f23e-4549-ab0e-b0f55aca09d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.152860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f0a34-f23e-4549-ab0e-b0f55aca09d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:24.154317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f0a34-f23e-4549-ab0e-b0f55aca09d2 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.164423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 805/1604] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:24.165276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f0a34-f23e-4549-ab0e-b0f55aca09d2 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.176070 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f0a34-f23e-4549-ab0e-b0f55aca09d2 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:24.180999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb1d64-e895-433f-bba7-31e837a8199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:24.181507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb1d64-e895-433f-bba7-31e837a8199a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.181808 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb1d64-e895-433f-bba7-31e837a8199a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.182082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb1d64-e895-433f-bba7-31e837a8199a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.182722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb1d64-e895-433f-bba7-31e837a8199a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:24.184341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb1d64-e895-433f-bba7-31e837a8199a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.195787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 806/1605] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:24.196646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb1d64-e895-433f-bba7-31e837a8199a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.207685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb1d64-e895-433f-bba7-31e837a8199a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:24.212476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e885a4-2370-40aa-a7b8-764d29ad4328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:24.213177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e885a4-2370-40aa-a7b8-764d29ad4328 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.213457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e885a4-2370-40aa-a7b8-764d29ad4328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.213733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e885a4-2370-40aa-a7b8-764d29ad4328 admin admin] PATH_INFO: `/v3/projects/d45ce54651ad4326bccecbeea8b5b084/users/ed8ef9f9eafd4248bae86f0e8ec72731/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.228217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:24.231532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e885a4-2370-40aa-a7b8-764d29ad4328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45ce54651ad4326bccecbeea8b5b084, user_id=ed8ef9f9eafd4248bae86f0e8ec72731, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:24.234855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e885a4-2370-40aa-a7b8-764d29ad4328 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.236265 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 800/1606] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:24 2022] PUT /identity/v3/projects/754af1c2cd154e91ad9ecbee3ce04d0d/users/fb465b4782514e7d8e75a7dc14c0a1e7/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:24.237281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6833ca-8a5e-4083-977c-e02df2fa5bfd admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.308650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6833ca-8a5e-4083-977c-e02df2fa5bfd admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:24.313672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bda5bf-15f3-4008-83db-a8187c1bf2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:24.314345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda5bf-15f3-4008-83db-a8187c1bf2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.314624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda5bf-15f3-4008-83db-a8187c1bf2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.314891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda5bf-15f3-4008-83db-a8187c1bf2a9 admin admin] PATH_INFO: `/v3/projects/be7f29d3c82242b7bdc4ead9fa6f4afc/users/2698bc78f2e3432faf8fd2a1d16d3b3a/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.318259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:24.331207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bda5bf-15f3-4008-83db-a8187c1bf2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7f29d3c82242b7bdc4ead9fa6f4afc, user_id=2698bc78f2e3432faf8fd2a1d16d3b3a, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:24.333943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bda5bf-15f3-4008-83db-a8187c1bf2a9 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.353963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 807/1607] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:24 2022] PUT /identity/v3/projects/d45ce54651ad4326bccecbeea8b5b084/users/ed8ef9f9eafd4248bae86f0e8ec72731/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:24.354804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e885a4-2370-40aa-a7b8-764d29ad4328 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.430253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 801/1608] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:24 2022] PUT /identity/v3/projects/be7f29d3c82242b7bdc4ead9fa6f4afc/users/2698bc78f2e3432faf8fd2a1d16d3b3a/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:24.431503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e885a4-2370-40aa-a7b8-764d29ad4328 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:24.435808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4b15f-2910-4fd7-8ddd-1dd7becf1d09 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.436012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4b15f-2910-4fd7-8ddd-1dd7becf1d09 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.436502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4b15f-2910-4fd7-8ddd-1dd7becf1d09 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.438920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 802/1609] 10.222.0.83 () {54 vars in 962 bytes} [Mon Aug 29 21:50:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:50:24.444618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4b15f-2910-4fd7-8ddd-1dd7becf1d09 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.510398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914526d-1f53-4f25-a830-5908669ca356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:24.510982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914526d-1f53-4f25-a830-5908669ca356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.511262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914526d-1f53-4f25-a830-5908669ca356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.511529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914526d-1f53-4f25-a830-5908669ca356 admin admin] PATH_INFO: `/v3/projects/d257be319764437297be6cbd99df8279/users/a422824315984d02841ba7a8cc1fb93f/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.514941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4b15f-2910-4fd7-8ddd-1dd7becf1d09 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:24.521729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ec60c-6410-4e0d-b574-f7e423fb9828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:24.522494 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ec60c-6410-4e0d-b574-f7e423fb9828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.522775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ec60c-6410-4e0d-b574-f7e423fb9828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.523048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ec60c-6410-4e0d-b574-f7e423fb9828 admin admin] PATH_INFO: `/v3/projects/dc2893d3b18446149387b9ee9ab1c71a/users/a465312ddd1e443e84f492c6bc14c759/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.529561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914526d-1f53-4f25-a830-5908669ca356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d257be319764437297be6cbd99df8279, user_id=a422824315984d02841ba7a8cc1fb93f, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:24.532575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914526d-1f53-4f25-a830-5908669ca356 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.542297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ec60c-6410-4e0d-b574-f7e423fb9828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2893d3b18446149387b9ee9ab1c71a, user_id=a465312ddd1e443e84f492c6bc14c759, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:24.545602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ec60c-6410-4e0d-b574-f7e423fb9828 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.647134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 808/1610] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:24 2022] PUT /identity/v3/projects/d257be319764437297be6cbd99df8279/users/a422824315984d02841ba7a8cc1fb93f/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:24.647822 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914526d-1f53-4f25-a830-5908669ca356 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.652769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 803/1611] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:24 2022] PUT /identity/v3/projects/dc2893d3b18446149387b9ee9ab1c71a/users/a465312ddd1e443e84f492c6bc14c759/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:24.652769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe43e5-1170-4443-8db8-296d44bd2bf6 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.652769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe43e5-1170-4443-8db8-296d44bd2bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.653286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe43e5-1170-4443-8db8-296d44bd2bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.676621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-60fe43e5-1170-4443-8db8-296d44bd2bf6 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:24.677877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-60fe43e5-1170-4443-8db8-296d44bd2bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:24.735173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914526d-1f53-4f25-a830-5908669ca356 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:24.753414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 804/1612] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:24.754993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b584-ae99-49f1-8850-309eb29b4bcb None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.754993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b584-ae99-49f1-8850-309eb29b4bcb None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.755312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b584-ae99-49f1-8850-309eb29b4bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.770437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:24.775631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-28f9b584-ae99-49f1-8850-309eb29b4bcb None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:24.776878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-28f9b584-ae99-49f1-8850-309eb29b4bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:24.784959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 805/1613] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:24.788761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b499520-02b4-4b45-8a62-900b3dcd649b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.788761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b499520-02b4-4b45-8a62-900b3dcd649b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.788761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b499520-02b4-4b45-8a62-900b3dcd649b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.808777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0b499520-02b4-4b45-8a62-900b3dcd649b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:24.810178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0b499520-02b4-4b45-8a62-900b3dcd649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:24.810697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c6520-98a9-43d4-995e-9cd6cfb2144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:24.811373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c6520-98a9-43d4-995e-9cd6cfb2144c admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.811651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c6520-98a9-43d4-995e-9cd6cfb2144c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.811922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c6520-98a9-43d4-995e-9cd6cfb2144c admin admin] PATH_INFO: `/v3/projects/74ad24fefb36441aa078c6b9a9e3e4e8/users/f7a967836b8e463ba12fd1b5e630efb5/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.819716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 806/1614] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:24.821657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1a381-1806-4e1b-94cc-e6346b35cc7f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.822040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1a381-1806-4e1b-94cc-e6346b35cc7f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.825040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1a381-1806-4e1b-94cc-e6346b35cc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:24.834807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c6520-98a9-43d4-995e-9cd6cfb2144c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ad24fefb36441aa078c6b9a9e3e4e8, user_id=f7a967836b8e463ba12fd1b5e630efb5, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:24.839743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c6520-98a9-43d4-995e-9cd6cfb2144c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:24.882687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-39f1a381-1806-4e1b-94cc-e6346b35cc7f None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:24.885998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-39f1a381-1806-4e1b-94cc-e6346b35cc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:24.926640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 809/1615] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:24 2022] PUT /identity/v3/projects/74ad24fefb36441aa078c6b9a9e3e4e8/users/f7a967836b8e463ba12fd1b5e630efb5/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:24.927596 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c6520-98a9-43d4-995e-9cd6cfb2144c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:24.957833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:24.995061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 807/1616] 10.222.0.83 () {58 vars in 1059 bytes} [Mon Aug 29 21:50:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:24.996388 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b123-efc6-4798-b4a2-f6718537e0d0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:24.996785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b123-efc6-4798-b4a2-f6718537e0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:24.997066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715b123-efc6-4798-b4a2-f6718537e0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.023662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c6520-98a9-43d4-995e-9cd6cfb2144c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.030858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbc900-da2d-454d-99e5-6544040c9763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.032058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc900-da2d-454d-99e5-6544040c9763 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.032342 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc900-da2d-454d-99e5-6544040c9763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.032713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbc900-da2d-454d-99e5-6544040c9763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.033427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbc900-da2d-454d-99e5-6544040c9763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.035315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e715b123-efc6-4798-b4a2-f6718537e0d0 None None] MFA Rules not processed for user `a422824315984d02841ba7a8cc1fb93f`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:25.036618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbc900-da2d-454d-99e5-6544040c9763 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.036901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e715b123-efc6-4798-b4a2-f6718537e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:25.055934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 810/1617] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:25.059994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbc900-da2d-454d-99e5-6544040c9763 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:25.117589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 808/1618] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:25.129999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715b123-efc6-4798-b4a2-f6718537e0d0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:25.149413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbc900-da2d-454d-99e5-6544040c9763 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.155291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9227d1-2e40-43a7-a148-ed003afb4241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.156843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9227d1-2e40-43a7-a148-ed003afb4241 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.157251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9227d1-2e40-43a7-a148-ed003afb4241 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.157707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9227d1-2e40-43a7-a148-ed003afb4241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.173089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9227d1-2e40-43a7-a148-ed003afb4241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.175666 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9227d1-2e40-43a7-a148-ed003afb4241 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.189281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 811/1619] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:25.190320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9227d1-2e40-43a7-a148-ed003afb4241 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:25.197557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715b123-efc6-4798-b4a2-f6718537e0d0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.199550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9227d1-2e40-43a7-a148-ed003afb4241 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.201599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1c8c9-ed4b-4918-b4ae-e8c89b29d5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.202239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c8c9-ed4b-4918-b4ae-e8c89b29d5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.202520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c8c9-ed4b-4918-b4ae-e8c89b29d5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.202785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1c8c9-ed4b-4918-b4ae-e8c89b29d5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.203826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be173401-b643-4064-8d27-196b2ceb0ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.204400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173401-b643-4064-8d27-196b2ceb0ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.204721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173401-b643-4064-8d27-196b2ceb0ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.205059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be173401-b643-4064-8d27-196b2ceb0ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.213815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1c8c9-ed4b-4918-b4ae-e8c89b29d5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.215351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1c8c9-ed4b-4918-b4ae-e8c89b29d5c6 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.215882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be173401-b643-4064-8d27-196b2ceb0ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.217861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be173401-b643-4064-8d27-196b2ceb0ec7 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.228563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 809/1620] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:25.229670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e636ef-7c71-4097-a277-a7a466ef829e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.229971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e636ef-7c71-4097-a277-a7a466ef829e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.230286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e636ef-7c71-4097-a277-a7a466ef829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.231957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 812/1621] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:25.232952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be173401-b643-4064-8d27-196b2ceb0ec7 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:25.272390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-40e636ef-7c71-4097-a277-a7a466ef829e None None] MFA Rules not processed for user `f7a967836b8e463ba12fd1b5e630efb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:25.273879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-40e636ef-7c71-4097-a277-a7a466ef829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:25.290460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:25.338702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be173401-b643-4064-8d27-196b2ceb0ec7 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.349786 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24eb1b-a2e1-492d-a203-f93da604b513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.350478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24eb1b-a2e1-492d-a203-f93da604b513 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.353437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24eb1b-a2e1-492d-a203-f93da604b513 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.353437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24eb1b-a2e1-492d-a203-f93da604b513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.369763 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 810/1622] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:25.370650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e636ef-7c71-4097-a277-a7a466ef829e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:25.384373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e636ef-7c71-4097-a277-a7a466ef829e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.390223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2ea2b-073b-4e97-8901-c5874a002259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.391734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2ea2b-073b-4e97-8901-c5874a002259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.392138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2ea2b-073b-4e97-8901-c5874a002259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.392569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2ea2b-073b-4e97-8901-c5874a002259 admin admin] PATH_INFO: `/v3/projects/dc2893d3b18446149387b9ee9ab1c71a/users/a465312ddd1e443e84f492c6bc14c759/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.395351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2ea2b-073b-4e97-8901-c5874a002259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc2893d3b18446149387b9ee9ab1c71a, user_id=a465312ddd1e443e84f492c6bc14c759, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.398712 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2ea2b-073b-4e97-8901-c5874a002259 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.414448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 811/1623] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:25 2022] PUT /identity/v3/projects/dc2893d3b18446149387b9ee9ab1c71a/users/a465312ddd1e443e84f492c6bc14c759/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:25.416075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2ea2b-073b-4e97-8901-c5874a002259 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:25.481133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:25.506004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2ea2b-073b-4e97-8901-c5874a002259 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.508408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24eb1b-a2e1-492d-a203-f93da604b513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.510245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24eb1b-a2e1-492d-a203-f93da604b513 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.523295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 813/1624] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:25.523799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc2749-350f-45c4-ba93-c0e62297fb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.524510 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc2749-350f-45c4-ba93-c0e62297fb58 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.524710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d86fb7-c9a4-44d2-b3b7-0668d1399d2a None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.524844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc2749-350f-45c4-ba93-c0e62297fb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.525011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc2749-350f-45c4-ba93-c0e62297fb58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.525880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc2749-350f-45c4-ba93-c0e62297fb58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.526537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d86fb7-c9a4-44d2-b3b7-0668d1399d2a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.526840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d86fb7-c9a4-44d2-b3b7-0668d1399d2a None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.527862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc2749-350f-45c4-ba93-c0e62297fb58 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.528956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 814/1625] 10.222.0.83 () {54 vars in 962 bytes} [Mon Aug 29 21:50:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:50:25.530240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cbe06-344f-4995-9bfc-7a6a937fb43c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.530522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cbe06-344f-4995-9bfc-7a6a937fb43c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.530810 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9cbe06-344f-4995-9bfc-7a6a937fb43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.569453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-be9cbe06-344f-4995-9bfc-7a6a937fb43c None None] MFA Rules not processed for user `a465312ddd1e443e84f492c6bc14c759`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:25.571169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-be9cbe06-344f-4995-9bfc-7a6a937fb43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:25.664175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 815/1626] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:25.665787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1d37c-a2df-4c4a-b019-c7ea4c890b23 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.666138 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1d37c-a2df-4c4a-b019-c7ea4c890b23 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.666541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1d37c-a2df-4c4a-b019-c7ea4c890b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.695290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a4b1d37c-a2df-4c4a-b019-c7ea4c890b23 None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:25.697243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a4b1d37c-a2df-4c4a-b019-c7ea4c890b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:25.749631 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 812/1627] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:25 2022] POST /identity/v3/projects => generated 371 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:25.750407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc2749-350f-45c4-ba93-c0e62297fb58 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:25.795688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 816/1628] 10.222.0.83 () {58 vars in 1059 bytes} [Mon Aug 29 21:50:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:25.797396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1d37c-a2df-4c4a-b019-c7ea4c890b23 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:25.813411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1d37c-a2df-4c4a-b019-c7ea4c890b23 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.834219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc2749-350f-45c4-ba93-c0e62297fb58 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:25.840338 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6ef04-a220-4792-8e05-b31f9140ecc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.841535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6ef04-a220-4792-8e05-b31f9140ecc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.842439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6ef04-a220-4792-8e05-b31f9140ecc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.842956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6ef04-a220-4792-8e05-b31f9140ecc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.896183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ad670-ee15-4c4c-ad63-949bb20fd9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:25.897155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad670-ee15-4c4c-ad63-949bb20fd9c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:25.897457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad670-ee15-4c4c-ad63-949bb20fd9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:25.897830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad670-ee15-4c4c-ad63-949bb20fd9c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:25.898785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ad670-ee15-4c4c-ad63-949bb20fd9c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.901792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925ad670-ee15-4c4c-ad63-949bb20fd9c6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.917857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6ef04-a220-4792-8e05-b31f9140ecc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:25.919425 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6ef04-a220-4792-8e05-b31f9140ecc0 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:25.930965 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 813/1629] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:25.938542 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6ef04-a220-4792-8e05-b31f9140ecc0 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.362778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6ef04-a220-4792-8e05-b31f9140ecc0 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.362778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b882-3f58-4520-a03f-20f311652720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.362778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b882-3f58-4520-a03f-20f311652720 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.362778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b882-3f58-4520-a03f-20f311652720 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.365874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76b882-3f58-4520-a03f-20f311652720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.368080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 817/1630] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:25 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:26.368080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61598cf3-2234-40f4-b236-bf7923878168 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.368080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61598cf3-2234-40f4-b236-bf7923878168 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.368080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61598cf3-2234-40f4-b236-bf7923878168 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.368080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 818/1631] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 21:50:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:50:26.368080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61598cf3-2234-40f4-b236-bf7923878168 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.371595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61598cf3-2234-40f4-b236-bf7923878168 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.371595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a342a-1581-47b3-8c97-f92c4e8c98e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.371595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a342a-1581-47b3-8c97-f92c4e8c98e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.371595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a342a-1581-47b3-8c97-f92c4e8c98e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.373506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a342a-1581-47b3-8c97-f92c4e8c98e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.373506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a342a-1581-47b3-8c97-f92c4e8c98e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.373506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a342a-1581-47b3-8c97-f92c4e8c98e5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.373506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 819/1632] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:26.373506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a001-2fe6-4409-b473-185b526994e2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.373506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a001-2fe6-4409-b473-185b526994e2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.376635 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277a001-2fe6-4409-b473-185b526994e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.378371 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b882-3f58-4520-a03f-20f311652720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.378371 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76b882-3f58-4520-a03f-20f311652720 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.378371 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 814/1633] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:26.380106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4277a001-2fe6-4409-b473-185b526994e2 None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:26.380106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4277a001-2fe6-4409-b473-185b526994e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:26.381490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b882-3f58-4520-a03f-20f311652720 service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.382047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 820/1634] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:50:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:26.382047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277a001-2fe6-4409-b473-185b526994e2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.382047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277a001-2fe6-4409-b473-185b526994e2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.382569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76b882-3f58-4520-a03f-20f311652720 service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.382710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e4b2e-6765-4b7f-ad64-614c7b23e517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.382710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e4b2e-6765-4b7f-ad64-614c7b23e517 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.382710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e4b2e-6765-4b7f-ad64-614c7b23e517 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.382710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e4b2e-6765-4b7f-ad64-614c7b23e517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.383228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151c62d-a291-4ea8-9b6c-d41aa5164212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.383228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151c62d-a291-4ea8-9b6c-d41aa5164212 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.383228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151c62d-a291-4ea8-9b6c-d41aa5164212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.383228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a151c62d-a291-4ea8-9b6c-d41aa5164212 admin admin] PATH_INFO: `/v3/projects/bffb7903745340aab0cc174c79f5ba96/users/69850b6b4f434dd9a59b2c90c6d11f98/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.383974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e4b2e-6765-4b7f-ad64-614c7b23e517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.383974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e4b2e-6765-4b7f-ad64-614c7b23e517 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.384327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151c62d-a291-4ea8-9b6c-d41aa5164212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffb7903745340aab0cc174c79f5ba96, user_id=69850b6b4f434dd9a59b2c90c6d11f98, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.384327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a151c62d-a291-4ea8-9b6c-d41aa5164212 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.386170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 821/1635] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:26.488902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621ca2f-6c06-43c0-955c-339b88b14889 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.489208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621ca2f-6c06-43c0-955c-339b88b14889 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.489987 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621ca2f-6c06-43c0-955c-339b88b14889 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.491169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 822/1636] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 21:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:50:26.496857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a035-6251-4d06-ad43-21c34c73dbdc None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.497140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a035-6251-4d06-ad43-21c34c73dbdc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.497809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a035-6251-4d06-ad43-21c34c73dbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.509978 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 815/1637] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:26 2022] PUT /identity/v3/projects/bffb7903745340aab0cc174c79f5ba96/users/69850b6b4f434dd9a59b2c90c6d11f98/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:26.514587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151c62d-a291-4ea8-9b6c-d41aa5164212 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.529431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:26.530857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5c21a035-6251-4d06-ad43-21c34c73dbdc None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:26.532161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5c21a035-6251-4d06-ad43-21c34c73dbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:26.630716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a151c62d-a291-4ea8-9b6c-d41aa5164212 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.636795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 823/1638] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:50:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:50:26.645791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5d0af-e0c7-4a27-a0dc-89a290f9e440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.646610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d0af-e0c7-4a27-a0dc-89a290f9e440 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.646900 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d0af-e0c7-4a27-a0dc-89a290f9e440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.647179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d0af-e0c7-4a27-a0dc-89a290f9e440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.647921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5d0af-e0c7-4a27-a0dc-89a290f9e440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.650486 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed5d0af-e0c7-4a27-a0dc-89a290f9e440 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.667781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 816/1639] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:50:26.669572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:26.673083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21a035-6251-4d06-ad43-21c34c73dbdc None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.692151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21a035-6251-4d06-ad43-21c34c73dbdc None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.718872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf783b6-99d1-49aa-9fca-6b10fe793b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:26.720669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf783b6-99d1-49aa-9fca-6b10fe793b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.724293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf783b6-99d1-49aa-9fca-6b10fe793b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.724293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf783b6-99d1-49aa-9fca-6b10fe793b24 admin admin] PATH_INFO: `/v3/projects/bffb7903745340aab0cc174c79f5ba96/users/69850b6b4f434dd9a59b2c90c6d11f98/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.727503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf783b6-99d1-49aa-9fca-6b10fe793b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffb7903745340aab0cc174c79f5ba96, user_id=69850b6b4f434dd9a59b2c90c6d11f98, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:26.741541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf783b6-99d1-49aa-9fca-6b10fe793b24 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:26.773648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 824/1640] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:26 2022] PUT /identity/v3/projects/bffb7903745340aab0cc174c79f5ba96/users/69850b6b4f434dd9a59b2c90c6d11f98/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:26.776523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db82b5c-d97f-4601-a1db-ba4bf98ede6c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:26.777090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db82b5c-d97f-4601-a1db-ba4bf98ede6c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:26.777562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db82b5c-d97f-4601-a1db-ba4bf98ede6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:26.813733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-2db82b5c-d97f-4601-a1db-ba4bf98ede6c None None] MFA Rules not processed for user `69850b6b4f434dd9a59b2c90c6d11f98`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:26.815439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2db82b5c-d97f-4601-a1db-ba4bf98ede6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:26.895923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf783b6-99d1-49aa-9fca-6b10fe793b24 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:26.911446 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 817/1641] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:50:26.993487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf783b6-99d1-49aa-9fca-6b10fe793b24 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:26.999399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023e598-e0c9-4eb1-aed2-0a46c6fea2e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:27.000544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023e598-e0c9-4eb1-aed2-0a46c6fea2e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:27.001073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023e598-e0c9-4eb1-aed2-0a46c6fea2e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:27.001606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023e598-e0c9-4eb1-aed2-0a46c6fea2e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:27.101206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023e598-e0c9-4eb1-aed2-0a46c6fea2e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:27.103591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023e598-e0c9-4eb1-aed2-0a46c6fea2e0 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:27.117989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 825/1642] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:50:27.172867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:27.347641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db82b5c-d97f-4601-a1db-ba4bf98ede6c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:27.363400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db82b5c-d97f-4601-a1db-ba4bf98ede6c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:27.371555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99455533-47e1-4fea-bbb6-8c577b9d4d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:27.372215 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99455533-47e1-4fea-bbb6-8c577b9d4d5e service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:27.372608 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99455533-47e1-4fea-bbb6-8c577b9d4d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:27.372838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99455533-47e1-4fea-bbb6-8c577b9d4d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:27.392971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99455533-47e1-4fea-bbb6-8c577b9d4d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:27.394451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99455533-47e1-4fea-bbb6-8c577b9d4d5e service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:27.406702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 818/1643] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:50:27.497199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:28.228999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023e598-e0c9-4eb1-aed2-0a46c6fea2e0 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:28.239179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023e598-e0c9-4eb1-aed2-0a46c6fea2e0 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:28.245118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef9a8d-b76f-41fd-b16c-81d060a8f33a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:28.246072 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef9a8d-b76f-41fd-b16c-81d060a8f33a service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:28.246396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef9a8d-b76f-41fd-b16c-81d060a8f33a service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:28.246670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef9a8d-b76f-41fd-b16c-81d060a8f33a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:28.350927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef9a8d-b76f-41fd-b16c-81d060a8f33a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:28.352598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef9a8d-b76f-41fd-b16c-81d060a8f33a service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:28.377903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 826/1644] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:32.061647 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99455533-47e1-4fea-bbb6-8c577b9d4d5e service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:32.284567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99455533-47e1-4fea-bbb6-8c577b9d4d5e service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:32.299896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:32.302160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:32.303416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:32.303717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] PATH_INFO: `/v3/users/99285bae990640b597103115522f0ecc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:32.306183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99285bae990640b597103115522f0ecc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:32.318352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:32.765097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99285bae990640b597103115522f0ecc'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:32.788682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99285bae990640b597103115522f0ecc'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:32.789405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99285bae990640b597103115522f0ecc'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:32.993717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99285bae990640b597103115522f0ecc'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:33.024521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99285bae990640b597103115522f0ecc'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:33.038953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 819/1645] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:32 2022] DELETE /identity/v3/users/99285bae990640b597103115522f0ecc => generated 0 bytes in 983 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:33.045405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ecdb3-bef6-4d33-a3f5-f68b07b648d7 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:33.046912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ecdb3-bef6-4d33-a3f5-f68b07b648d7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:33.047395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ecdb3-bef6-4d33-a3f5-f68b07b648d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:33.077730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-601ecdb3-bef6-4d33-a3f5-f68b07b648d7 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:33.079458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-601ecdb3-bef6-4d33-a3f5-f68b07b648d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:33.175147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 827/1646] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:33.185087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:33.187517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:33.238574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:33.351278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356cbb2-1aa9-4d13-92e2-f80482b00714 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:33.375991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c821d0a-4fcb-4cb2-9969-2786b105fa1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:33.377001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c821d0a-4fcb-4cb2-9969-2786b105fa1b service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:33.379910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c821d0a-4fcb-4cb2-9969-2786b105fa1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:33.380721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c821d0a-4fcb-4cb2-9969-2786b105fa1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:33.394569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c821d0a-4fcb-4cb2-9969-2786b105fa1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:33.399248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c821d0a-4fcb-4cb2-9969-2786b105fa1b service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:33.428820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 820/1647] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:34.512466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ecdb3-bef6-4d33-a3f5-f68b07b648d7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:34.518676 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-601ecdb3-bef6-4d33-a3f5-f68b07b648d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:34.594253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ecdb3-bef6-4d33-a3f5-f68b07b648d7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:34.610503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:34.611055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:34.611343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:34.611619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] PATH_INFO: `/v3/projects/4d6eb6dd6cad46be81629819c22e3cc1` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:34.614014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6eb6dd6cad46be81629819c22e3cc1)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:34.616025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:34.638345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:34.927981 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6eb6dd6cad46be81629819c22e3cc1', 'request_id': 'req-62529d84-5531-4bec-a113-b6e164a4ddcb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:34.954265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6eb6dd6cad46be81629819c22e3cc1', 'request_id': 'req-62529d84-5531-4bec-a113-b6e164a4ddcb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:35.159681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6eb6dd6cad46be81629819c22e3cc1', 'request_id': 'req-62529d84-5531-4bec-a113-b6e164a4ddcb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:35.199481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] The token cache is being invalidate because project 4d6eb6dd6cad46be81629819c22e3cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:35.199936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:35.203871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-62529d84-5531-4bec-a113-b6e164a4ddcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:35.211494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 828/1648] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:34 2022] DELETE /identity/v3/projects/4d6eb6dd6cad46be81629819c22e3cc1 => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:35.217932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb237de0-5a09-493c-a507-3fad78e67bed None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:35.219379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb237de0-5a09-493c-a507-3fad78e67bed None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:35.220156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb237de0-5a09-493c-a507-3fad78e67bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:35.295399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-cb237de0-5a09-493c-a507-3fad78e67bed None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:35.304922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-cb237de0-5a09-493c-a507-3fad78e67bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:35.471268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60e90a-7780-4b70-8216-dadf080760b5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:35.471554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60e90a-7780-4b70-8216-dadf080760b5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:35.471834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60e90a-7780-4b70-8216-dadf080760b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:35.484255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 821/1649] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:35.504160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5c60e90a-7780-4b70-8216-dadf080760b5 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:35.505926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5c60e90a-7780-4b70-8216-dadf080760b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:35.555487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb237de0-5a09-493c-a507-3fad78e67bed None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:35.569798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 829/1650] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:35.575075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb237de0-5a09-493c-a507-3fad78e67bed None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:35.590367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fd99f-1bb5-440b-a8c7-e1e0ccb785cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:35.591659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fd99f-1bb5-440b-a8c7-e1e0ccb785cc admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:35.593500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fd99f-1bb5-440b-a8c7-e1e0ccb785cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:35.593949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fd99f-1bb5-440b-a8c7-e1e0ccb785cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:35.597573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fd99f-1bb5-440b-a8c7-e1e0ccb785cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:35.598067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fd99f-1bb5-440b-a8c7-e1e0ccb785cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:35.602283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fd99f-1bb5-440b-a8c7-e1e0ccb785cc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:35.639333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60e90a-7780-4b70-8216-dadf080760b5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:35.647228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 822/1651] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:35.656333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60e90a-7780-4b70-8216-dadf080760b5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:35.669393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60018b8-3219-41fa-9074-87916224e306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:35.670277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60018b8-3219-41fa-9074-87916224e306 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:35.672605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60018b8-3219-41fa-9074-87916224e306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:35.673041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60018b8-3219-41fa-9074-87916224e306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:35.677697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60018b8-3219-41fa-9074-87916224e306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:35.680516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60018b8-3219-41fa-9074-87916224e306 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:35.823200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 830/1652] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:35 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:35.829410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fd99f-1bb5-440b-a8c7-e1e0ccb785cc admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:35.845565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fd99f-1bb5-440b-a8c7-e1e0ccb785cc admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:36.049481 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5933b2-bdbe-4d5a-ae4f-cb9347beba35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:36.051748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5933b2-bdbe-4d5a-ae4f-cb9347beba35 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:36.052511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5933b2-bdbe-4d5a-ae4f-cb9347beba35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:36.053671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5933b2-bdbe-4d5a-ae4f-cb9347beba35 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:36.054523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5933b2-bdbe-4d5a-ae4f-cb9347beba35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:36.059975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5933b2-bdbe-4d5a-ae4f-cb9347beba35 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:36.216956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 823/1653] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:35 2022] POST /identity/v3/users => generated 290 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:36.219344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60018b8-3219-41fa-9074-87916224e306 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:36.252682 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60018b8-3219-41fa-9074-87916224e306 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:36.268814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87166e57-ee04-40f3-83e2-eacb413d3cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:36.269772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166e57-ee04-40f3-83e2-eacb413d3cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:36.270150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166e57-ee04-40f3-83e2-eacb413d3cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:36.270572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87166e57-ee04-40f3-83e2-eacb413d3cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:36.271880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87166e57-ee04-40f3-83e2-eacb413d3cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:36.273843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87166e57-ee04-40f3-83e2-eacb413d3cb6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:36.302934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 831/1654] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:50:36.303783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5933b2-bdbe-4d5a-ae4f-cb9347beba35 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:36.319077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5933b2-bdbe-4d5a-ae4f-cb9347beba35 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:36.335743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d718b-0752-417c-ac65-58ee197f5aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:36.341169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d718b-0752-417c-ac65-58ee197f5aae admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:36.341858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d718b-0752-417c-ac65-58ee197f5aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:36.346098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d718b-0752-417c-ac65-58ee197f5aae admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:36.348013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d718b-0752-417c-ac65-58ee197f5aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:36.353314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d718b-0752-417c-ac65-58ee197f5aae admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:36.391244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 824/1655] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:36.394171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87166e57-ee04-40f3-83e2-eacb413d3cb6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:36.401368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d718b-0752-417c-ac65-58ee197f5aae admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:36.403259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-87166e57-ee04-40f3-83e2-eacb413d3cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:36.432761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d718b-0752-417c-ac65-58ee197f5aae admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:36.445964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c201d16-5167-4087-86b4-dcae68d47ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:36.448316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c201d16-5167-4087-86b4-dcae68d47ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:36.450359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c201d16-5167-4087-86b4-dcae68d47ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:36.450359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c201d16-5167-4087-86b4-dcae68d47ff6 admin admin] PATH_INFO: `/v3/projects/371d00b6838544588f03e9c839cec18c/users/9039b9be42844152860edf5ea7b2808e/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:36.461953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87166e57-ee04-40f3-83e2-eacb413d3cb6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:36.475397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c201d16-5167-4087-86b4-dcae68d47ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371d00b6838544588f03e9c839cec18c, user_id=9039b9be42844152860edf5ea7b2808e, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:36.479956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c201d16-5167-4087-86b4-dcae68d47ff6 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:36.493003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:36.509716 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:36.512931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:36.516061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] PATH_INFO: `/v3/users/2781d93982944a65a835387bf8fcebe0` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:36.524351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2781d93982944a65a835387bf8fcebe0)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:36.531203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: WARNING py.warnings [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:50:36.531203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: warnings.warn(msg) Aug 29 21:50:36.531203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: Aug 29 21:50:36.533684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:36.617263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 825/1656] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:36 2022] PUT /identity/v3/projects/371d00b6838544588f03e9c839cec18c/users/9039b9be42844152860edf5ea7b2808e/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:36.619568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dab125-cd4b-4123-8844-159a20173d57 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:36.619568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dab125-cd4b-4123-8844-159a20173d57 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:36.619993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dab125-cd4b-4123-8844-159a20173d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:36.699515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-25dab125-cd4b-4123-8844-159a20173d57 None None] MFA Rules not processed for user `fb465b4782514e7d8e75a7dc14c0a1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:36.701040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-25dab125-cd4b-4123-8844-159a20173d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:36.892839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:36.904374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2781d93982944a65a835387bf8fcebe0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:36.937612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2781d93982944a65a835387bf8fcebe0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:36.943211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2781d93982944a65a835387bf8fcebe0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:36.975381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 826/1657] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:36.979708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3d208-dd6a-4e84-b792-7e2fcdbbb0d9 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:36.980195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3d208-dd6a-4e84-b792-7e2fcdbbb0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:36.980697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3d208-dd6a-4e84-b792-7e2fcdbbb0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:37.050801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2781d93982944a65a835387bf8fcebe0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:37.051181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2781d93982944a65a835387bf8fcebe0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:37.142945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 832/1658] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:36 2022] DELETE /identity/v3/users/2781d93982944a65a835387bf8fcebe0 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:37.145492 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:37.150031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:37.161079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-fcd3d208-dd6a-4e84-b792-7e2fcdbbb0d9 None None] MFA Rules not processed for user `9039b9be42844152860edf5ea7b2808e`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:37.184773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fcd3d208-dd6a-4e84-b792-7e2fcdbbb0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:37.233534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:37.390116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 827/1659] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:37.391478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5941c6-73b7-4c70-a942-94d9d81bec26 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:37.391918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5941c6-73b7-4c70-a942-94d9d81bec26 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:37.392519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5941c6-73b7-4c70-a942-94d9d81bec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:37.448455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bc3d5-91bd-49b1-8491-cb5c35475e2b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:37.449668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-1b5941c6-73b7-4c70-a942-94d9d81bec26 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:37.454555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-1b5941c6-73b7-4c70-a942-94d9d81bec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:37.496139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac4ee4-948e-4191-aa4e-71ad151a9a1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:37.504390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac4ee4-948e-4191-aa4e-71ad151a9a1a service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:37.504390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac4ee4-948e-4191-aa4e-71ad151a9a1a service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:37.504390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac4ee4-948e-4191-aa4e-71ad151a9a1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:37.517669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8eac4ee4-948e-4191-aa4e-71ad151a9a1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:37.650887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 828/1660] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:37.654818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5941c6-73b7-4c70-a942-94d9d81bec26 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:37.658779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-1b5941c6-73b7-4c70-a942-94d9d81bec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:37.698062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac4ee4-948e-4191-aa4e-71ad151a9a1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:37.699785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eac4ee4-948e-4191-aa4e-71ad151a9a1a service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:37.707334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5941c6-73b7-4c70-a942-94d9d81bec26 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:37.718597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 833/1661] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:37.735761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac4ee4-948e-4191-aa4e-71ad151a9a1a service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:37.736933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a43d4-79e4-4006-988f-482355f1c160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:37.737799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a43d4-79e4-4006-988f-482355f1c160 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:37.738297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a43d4-79e4-4006-988f-482355f1c160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:37.738781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a43d4-79e4-4006-988f-482355f1c160 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:37.739729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a43d4-79e4-4006-988f-482355f1c160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:37.746062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a43d4-79e4-4006-988f-482355f1c160 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:37.746686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8eac4ee4-948e-4191-aa4e-71ad151a9a1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:37.916269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eac4ee4-948e-4191-aa4e-71ad151a9a1a service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:37.930177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342e0db-130b-4c6c-8e4e-1abc432d836e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:37.930822 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342e0db-130b-4c6c-8e4e-1abc432d836e service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:37.931097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342e0db-130b-4c6c-8e4e-1abc432d836e service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:37.943972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342e0db-130b-4c6c-8e4e-1abc432d836e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:37.954265 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 829/1662] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:37 2022] POST /identity/v3/projects => generated 381 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:37.958814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a43d4-79e4-4006-988f-482355f1c160 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:37.980358 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342e0db-130b-4c6c-8e4e-1abc432d836e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:37.983495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342e0db-130b-4c6c-8e4e-1abc432d836e service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:38.025848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 834/1663] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:38.118219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a43d4-79e4-4006-988f-482355f1c160 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:38.144823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee0697-081c-4239-aa6b-6b5cbfe8d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:38.145646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0697-081c-4239-aa6b-6b5cbfe8d159 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:38.146697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0697-081c-4239-aa6b-6b5cbfe8d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:38.147100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee0697-081c-4239-aa6b-6b5cbfe8d159 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:38.148727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee0697-081c-4239-aa6b-6b5cbfe8d159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:38.159630 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee0697-081c-4239-aa6b-6b5cbfe8d159 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:38.217180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342e0db-130b-4c6c-8e4e-1abc432d836e service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:38.219216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9342e0db-130b-4c6c-8e4e-1abc432d836e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:38.263985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342e0db-130b-4c6c-8e4e-1abc432d836e service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:38.277445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:38.278130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:38.278417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:38.278696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] PATH_INFO: `/v3/users/f7a967836b8e463ba12fd1b5e630efb5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:38.280107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a967836b8e463ba12fd1b5e630efb5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:38.294528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:38.325801 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 830/1664] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:37 2022] POST /identity/v3/users => generated 297 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:38.330829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee0697-081c-4239-aa6b-6b5cbfe8d159 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:38.350773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee0697-081c-4239-aa6b-6b5cbfe8d159 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:38.370837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1649f8-cf9e-4814-8212-1714a64e0d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:38.371765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1649f8-cf9e-4814-8212-1714a64e0d7a admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:38.372390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1649f8-cf9e-4814-8212-1714a64e0d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:38.372826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1649f8-cf9e-4814-8212-1714a64e0d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:38.373630 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1649f8-cf9e-4814-8212-1714a64e0d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:38.376359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1649f8-cf9e-4814-8212-1714a64e0d7a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:38.404368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 831/1665] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:38.409804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1649f8-cf9e-4814-8212-1714a64e0d7a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:38.422994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1649f8-cf9e-4814-8212-1714a64e0d7a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:38.436042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289f673-7be4-4406-9cc7-0996df57a925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:38.439078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289f673-7be4-4406-9cc7-0996df57a925 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:38.440801 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289f673-7be4-4406-9cc7-0996df57a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:38.446144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289f673-7be4-4406-9cc7-0996df57a925 admin admin] PATH_INFO: `/v3/projects/a47786656a68429cac1e8ad596800d0c/users/854ca487dd6b446f8f0cc5e24993a967/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:38.496008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289f673-7be4-4406-9cc7-0996df57a925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47786656a68429cac1e8ad596800d0c, user_id=854ca487dd6b446f8f0cc5e24993a967, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:38.506159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289f673-7be4-4406-9cc7-0996df57a925 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:38.634621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 832/1666] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:38 2022] PUT /identity/v3/projects/a47786656a68429cac1e8ad596800d0c/users/854ca487dd6b446f8f0cc5e24993a967/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:50:38.639095 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a967836b8e463ba12fd1b5e630efb5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:38.639862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289f673-7be4-4406-9cc7-0996df57a925 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:38.659545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a967836b8e463ba12fd1b5e630efb5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:38.660586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a967836b8e463ba12fd1b5e630efb5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:38.822064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a967836b8e463ba12fd1b5e630efb5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:38.828160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-358a5f24-ed51-4e8d-8245-bf7b368b11db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a967836b8e463ba12fd1b5e630efb5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:38.875021 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289f673-7be4-4406-9cc7-0996df57a925 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:38.885348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a7c45-e47d-40f4-a347-673a7c22cefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:38.885986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a7c45-e47d-40f4-a347-673a7c22cefb admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:38.886264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a7c45-e47d-40f4-a347-673a7c22cefb admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:38.886553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a7c45-e47d-40f4-a347-673a7c22cefb admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:38.887286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a7c45-e47d-40f4-a347-673a7c22cefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:38.889115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a7c45-e47d-40f4-a347-673a7c22cefb admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:38.909329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 835/1667] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:38 2022] DELETE /identity/v3/users/f7a967836b8e463ba12fd1b5e630efb5 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:50:38.914191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f27b8-7f7a-4528-802e-0c6b647ff590 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:38.915998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f27b8-7f7a-4528-802e-0c6b647ff590 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:38.916464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f27b8-7f7a-4528-802e-0c6b647ff590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:38.925394 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 833/1668] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:38.926429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a7c45-e47d-40f4-a347-673a7c22cefb admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:38.928668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-079a7c45-e47d-40f4-a347-673a7c22cefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:38.960656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a7c45-e47d-40f4-a347-673a7c22cefb admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:39.016021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c63f27b8-7f7a-4528-802e-0c6b647ff590 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:39.018248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c63f27b8-7f7a-4528-802e-0c6b647ff590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:39.113749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209ecfd-de42-45d1-87b3-753719fb0f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:39.116073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209ecfd-de42-45d1-87b3-753719fb0f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:39.119280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209ecfd-de42-45d1-87b3-753719fb0f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:39.119939 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209ecfd-de42-45d1-87b3-753719fb0f02 admin admin] PATH_INFO: `/v3/projects/a47786656a68429cac1e8ad596800d0c/users/854ca487dd6b446f8f0cc5e24993a967/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:39.123498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209ecfd-de42-45d1-87b3-753719fb0f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47786656a68429cac1e8ad596800d0c, user_id=854ca487dd6b446f8f0cc5e24993a967, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:39.128515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1209ecfd-de42-45d1-87b3-753719fb0f02 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:39.148760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 834/1669] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:38 2022] PUT /identity/v3/projects/a47786656a68429cac1e8ad596800d0c/users/854ca487dd6b446f8f0cc5e24993a967/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:39.158818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:39.161643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773ae98-9812-4917-8cff-46606c7b4aa9 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:39.168764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773ae98-9812-4917-8cff-46606c7b4aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:39.168764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773ae98-9812-4917-8cff-46606c7b4aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:39.169100 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 836/1670] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:39.180769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f27b8-7f7a-4528-802e-0c6b647ff590 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:39.182973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c63f27b8-7f7a-4528-802e-0c6b647ff590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:39.227990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5773ae98-9812-4917-8cff-46606c7b4aa9 None None] MFA Rules not processed for user `854ca487dd6b446f8f0cc5e24993a967`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:39.233162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5773ae98-9812-4917-8cff-46606c7b4aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:39.387589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f27b8-7f7a-4528-802e-0c6b647ff590 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:39.544629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 835/1671] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:39.553411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b57a-4ee4-44d9-8e34-e4cb45963807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:39.554494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b57a-4ee4-44d9-8e34-e4cb45963807 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:39.555052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b57a-4ee4-44d9-8e34-e4cb45963807 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:39.555693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b57a-4ee4-44d9-8e34-e4cb45963807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:39.565258 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773ae98-9812-4917-8cff-46606c7b4aa9 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:39.569375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5773ae98-9812-4917-8cff-46606c7b4aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:39.657164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773ae98-9812-4917-8cff-46606c7b4aa9 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:39.664185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c3aac-f795-4964-bc3b-308ebe7f317d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:39.665131 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c3aac-f795-4964-bc3b-308ebe7f317d service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:39.665657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c3aac-f795-4964-bc3b-308ebe7f317d service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:39.666109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c3aac-f795-4964-bc3b-308ebe7f317d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:39.695043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453b57a-4ee4-44d9-8e34-e4cb45963807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:39.696685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a453b57a-4ee4-44d9-8e34-e4cb45963807 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:39.697913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c3aac-f795-4964-bc3b-308ebe7f317d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:39.699164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c3aac-f795-4964-bc3b-308ebe7f317d service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:39.734646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 837/1672] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:39.736294 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b57a-4ee4-44d9-8e34-e4cb45963807 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:39.742755 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a453b57a-4ee4-44d9-8e34-e4cb45963807 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:39.753826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 836/1673] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:50:39.782155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b57a-4ee4-44d9-8e34-e4cb45963807 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:39.813631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:39.814197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:39.814412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:39.814683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] PATH_INFO: `/v3/projects/27b8b6c731c54b37b3d0ea39ebcbd088` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:39.823373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b8b6c731c54b37b3d0ea39ebcbd088)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:39.826764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:40.119705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b8b6c731c54b37b3d0ea39ebcbd088', 'request_id': 'req-83c666f4-620e-4e3b-adc1-84776fa44cbb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.161234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b8b6c731c54b37b3d0ea39ebcbd088', 'request_id': 'req-83c666f4-620e-4e3b-adc1-84776fa44cbb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.298983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b8b6c731c54b37b3d0ea39ebcbd088', 'request_id': 'req-83c666f4-620e-4e3b-adc1-84776fa44cbb'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.333332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] The token cache is being invalidate because project 27b8b6c731c54b37b3d0ea39ebcbd088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:40.335477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.340819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83c666f4-620e-4e3b-adc1-84776fa44cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.348770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 838/1674] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:39 2022] DELETE /identity/v3/projects/27b8b6c731c54b37b3d0ea39ebcbd088 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:40.353507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c3aac-f795-4964-bc3b-308ebe7f317d service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:40.390226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c3aac-f795-4964-bc3b-308ebe7f317d service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:40.413995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f5cf3-0c79-4126-ae59-b0f97befd713 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:40.413995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f5cf3-0c79-4126-ae59-b0f97befd713 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:40.414552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f5cf3-0c79-4126-ae59-b0f97befd713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:40.488073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-eb4f5cf3-0c79-4126-ae59-b0f97befd713 None None] MFA Rules not processed for user `2698bc78f2e3432faf8fd2a1d16d3b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:40.488876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:40.489374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-eb4f5cf3-0c79-4126-ae59-b0f97befd713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:40.489547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:40.490027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:40.490505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] PATH_INFO: `/v3/users/a465312ddd1e443e84f492c6bc14c759` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:40.491933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a465312ddd1e443e84f492c6bc14c759)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:40.494221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:40.612534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 839/1675] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:50:40.612534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f5cf3-0c79-4126-ae59-b0f97befd713 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:40.625749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-eb4f5cf3-0c79-4126-ae59-b0f97befd713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:40.656675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f5cf3-0c79-4126-ae59-b0f97befd713 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:40.667824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:40.668556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:40.668807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:40.670305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] PATH_INFO: `/v3/projects/74ad24fefb36441aa078c6b9a9e3e4e8` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:40.670544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ad24fefb36441aa078c6b9a9e3e4e8)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:40.675344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:40.787366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a465312ddd1e443e84f492c6bc14c759'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.813789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a465312ddd1e443e84f492c6bc14c759'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.814857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a465312ddd1e443e84f492c6bc14c759'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.862037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:40.935689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a465312ddd1e443e84f492c6bc14c759'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.951647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ad24fefb36441aa078c6b9a9e3e4e8', 'request_id': 'req-0ae13c74-748b-463a-811e-58271f82e12d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.956578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ecd688fb-aaaa-40ce-ab3a-ac3f7dc08018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a465312ddd1e443e84f492c6bc14c759'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.969719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ad24fefb36441aa078c6b9a9e3e4e8', 'request_id': 'req-0ae13c74-748b-463a-811e-58271f82e12d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:40.980043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 837/1676] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:40 2022] DELETE /identity/v3/users/a465312ddd1e443e84f492c6bc14c759 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:40.981787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a126845-e3c9-42e4-ad99-575c75f40c41 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:40.985845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a126845-e3c9-42e4-ad99-575c75f40c41 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:40.986318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a126845-e3c9-42e4-ad99-575c75f40c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:41.042677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7a126845-e3c9-42e4-ad99-575c75f40c41 None None] MFA Rules not processed for user `2698bc78f2e3432faf8fd2a1d16d3b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:41.043996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7a126845-e3c9-42e4-ad99-575c75f40c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:41.142835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ad24fefb36441aa078c6b9a9e3e4e8', 'request_id': 'req-0ae13c74-748b-463a-811e-58271f82e12d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:41.226196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] The token cache is being invalidate because project 74ad24fefb36441aa078c6b9a9e3e4e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:41.228468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:41.234938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0ae13c74-748b-463a-811e-58271f82e12d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:41.251337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 840/1677] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:40 2022] DELETE /identity/v3/projects/74ad24fefb36441aa078c6b9a9e3e4e8 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:41.259433 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b407146-bb37-4766-b15b-f3c256913586 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:41.259978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b407146-bb37-4766-b15b-f3c256913586 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:41.260455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b407146-bb37-4766-b15b-f3c256913586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:41.288678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 838/1678] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:41.290298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee3721-417f-4b11-9bbd-f706ef7ed92f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:41.291852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee3721-417f-4b11-9bbd-f706ef7ed92f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:41.292138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee3721-417f-4b11-9bbd-f706ef7ed92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:41.350558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-dfee3721-417f-4b11-9bbd-f706ef7ed92f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:41.366572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-dfee3721-417f-4b11-9bbd-f706ef7ed92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:41.416412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9b407146-bb37-4766-b15b-f3c256913586 None None] MFA Rules not processed for user `ed8ef9f9eafd4248bae86f0e8ec72731`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:41.430711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9b407146-bb37-4766-b15b-f3c256913586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:41.548766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 839/1679] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:41.550516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee3721-417f-4b11-9bbd-f706ef7ed92f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:41.567140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-dfee3721-417f-4b11-9bbd-f706ef7ed92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:41.669727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 841/1680] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:41.671798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c829c-908a-42aa-9e5c-1fdc108420c3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:41.672427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c829c-908a-42aa-9e5c-1fdc108420c3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:41.672873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c829c-908a-42aa-9e5c-1fdc108420c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:41.721136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-544c829c-908a-42aa-9e5c-1fdc108420c3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:41.724225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-544c829c-908a-42aa-9e5c-1fdc108420c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:41.741355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 842/1681] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:41.742727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c829c-908a-42aa-9e5c-1fdc108420c3 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:41.744369 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-544c829c-908a-42aa-9e5c-1fdc108420c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:41.764159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:41.861968 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c829c-908a-42aa-9e5c-1fdc108420c3 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:41.866300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee3721-417f-4b11-9bbd-f706ef7ed92f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:41.883373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c07a9-c406-48f6-944d-b841fbe5e2c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:41.884365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c07a9-c406-48f6-944d-b841fbe5e2c2 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:41.884813 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c07a9-c406-48f6-944d-b841fbe5e2c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:41.885253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c07a9-c406-48f6-944d-b841fbe5e2c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:41.887320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-497c07a9-c406-48f6-944d-b841fbe5e2c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:41.888121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90b9d1-717c-4860-b75e-37d262d53498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:41.888908 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90b9d1-717c-4860-b75e-37d262d53498 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:41.889514 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90b9d1-717c-4860-b75e-37d262d53498 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:41.889927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90b9d1-717c-4860-b75e-37d262d53498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:41.900971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90b9d1-717c-4860-b75e-37d262d53498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:41.903643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90b9d1-717c-4860-b75e-37d262d53498 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:41.911085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c07a9-c406-48f6-944d-b841fbe5e2c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:41.913571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c07a9-c406-48f6-944d-b841fbe5e2c2 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:41.915858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 843/1682] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:41.916913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90b9d1-717c-4860-b75e-37d262d53498 service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:41.937307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 840/1683] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:41.988047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90b9d1-717c-4860-b75e-37d262d53498 service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:42.014720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c07a9-c406-48f6-944d-b841fbe5e2c2 service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:42.020993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-497c07a9-c406-48f6-944d-b841fbe5e2c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:42.037942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e46f9-4e8c-4bde-90a0-293b6d8054ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:42.041787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e46f9-4e8c-4bde-90a0-293b6d8054ba admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:42.042354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e46f9-4e8c-4bde-90a0-293b6d8054ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:42.043595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e46f9-4e8c-4bde-90a0-293b6d8054ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:42.046707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e46f9-4e8c-4bde-90a0-293b6d8054ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:42.049659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e46f9-4e8c-4bde-90a0-293b6d8054ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:42.051715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e46f9-4e8c-4bde-90a0-293b6d8054ba admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:42.060087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c07a9-c406-48f6-944d-b841fbe5e2c2 service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:42.078395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 844/1684] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:42.082858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e46f9-4e8c-4bde-90a0-293b6d8054ba admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:42.084233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:42.092655 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:42.093178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:42.093464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] PATH_INFO: `/v3/projects/dc2893d3b18446149387b9ee9ab1c71a` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:42.099680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e46f9-4e8c-4bde-90a0-293b6d8054ba admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:42.100903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc2893d3b18446149387b9ee9ab1c71a)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:42.111301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadacb92-eac0-40d3-9f00-f165c9de04ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:42.112051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadacb92-eac0-40d3-9f00-f165c9de04ee admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:42.114077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadacb92-eac0-40d3-9f00-f165c9de04ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:42.114077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadacb92-eac0-40d3-9f00-f165c9de04ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:42.114077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadacb92-eac0-40d3-9f00-f165c9de04ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:42.116168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: WARNING py.warnings [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 21:50:42.116168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: warnings.warn(msg) Aug 29 21:50:42.116168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: Aug 29 21:50:42.116762 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadacb92-eac0-40d3-9f00-f165c9de04ee admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:42.122665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:42.284714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 845/1685] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:42 2022] POST /identity/v3/projects => generated 403 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:42.286299 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadacb92-eac0-40d3-9f00-f165c9de04ee admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:42.289775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-aadacb92-eac0-40d3-9f00-f165c9de04ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:42.375747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc2893d3b18446149387b9ee9ab1c71a', 'request_id': 'req-5ccd5a6f-8b51-477d-9404-6d6a19866224'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:42.408790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc2893d3b18446149387b9ee9ab1c71a', 'request_id': 'req-5ccd5a6f-8b51-477d-9404-6d6a19866224'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:42.446705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadacb92-eac0-40d3-9f00-f165c9de04ee admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:42.544423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db0bfe-7a13-4b31-9585-5f87448368ca tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854ca487dd6b446f8f0cc5e24993a967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a47786656a68429cac1e8ad596800d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:42.546847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db0bfe-7a13-4b31-9585-5f87448368ca tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:42.547886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db0bfe-7a13-4b31-9585-5f87448368ca tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:42.548315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db0bfe-7a13-4b31-9585-5f87448368ca tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:42.548975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc2893d3b18446149387b9ee9ab1c71a', 'request_id': 'req-5ccd5a6f-8b51-477d-9404-6d6a19866224'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:42.549913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db0bfe-7a13-4b31-9585-5f87448368ca tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:42.550334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db0bfe-7a13-4b31-9585-5f87448368ca tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:42.552132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db0bfe-7a13-4b31-9585-5f87448368ca tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:42.578512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 846/1686] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:42.578512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db0bfe-7a13-4b31-9585-5f87448368ca tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:42.607253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] The token cache is being invalidate because project dc2893d3b18446149387b9ee9ab1c71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:42.610171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:42.613400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:42.623004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 841/1687] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:42 2022] DELETE /identity/v3/projects/dc2893d3b18446149387b9ee9ab1c71a => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:42.628259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:42.636292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:42.672242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db0bfe-7a13-4b31-9585-5f87448368ca tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:42.678236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ffeb3-2f21-42b1-91ef-4eb643352562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:42.680713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ffeb3-2f21-42b1-91ef-4eb643352562 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:42.681258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ffeb3-2f21-42b1-91ef-4eb643352562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:42.681731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ffeb3-2f21-42b1-91ef-4eb643352562 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:42.682885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ffeb3-2f21-42b1-91ef-4eb643352562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:42.685365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ffeb3-2f21-42b1-91ef-4eb643352562 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:42.686055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd5a6f-8b51-477d-9404-6d6a19866224 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:42.704231 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830e5ae-d3b6-466b-8b90-fc5da1aa391c tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854ca487dd6b446f8f0cc5e24993a967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a47786656a68429cac1e8ad596800d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:42.705629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e5ae-d3b6-466b-8b90-fc5da1aa391c tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:42.706273 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e5ae-d3b6-466b-8b90-fc5da1aa391c tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:42.706696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830e5ae-d3b6-466b-8b90-fc5da1aa391c tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:42.707506 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830e5ae-d3b6-466b-8b90-fc5da1aa391c tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:42.711381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830e5ae-d3b6-466b-8b90-fc5da1aa391c tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:42.840661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 847/1688] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:42 2022] POST /identity/v3/users => generated 302 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:42.840661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf26d3-eb20-4121-9aba-2c111f0596ce None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:42.840661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf26d3-eb20-4121-9aba-2c111f0596ce None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:42.840661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf26d3-eb20-4121-9aba-2c111f0596ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:42.850467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 842/1689] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:42 2022] POST /identity/v3/projects => generated 354 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:42.853184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830e5ae-d3b6-466b-8b90-fc5da1aa391c tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:42.861516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0830e5ae-d3b6-466b-8b90-fc5da1aa391c tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:42.893326 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a3cf26d3-eb20-4121-9aba-2c111f0596ce None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:42.894674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a3cf26d3-eb20-4121-9aba-2c111f0596ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:43.034293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830e5ae-d3b6-466b-8b90-fc5da1aa391c tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:43.044552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187928cd-d9a9-49fd-ab42-2c04f0603caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:43.045441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187928cd-d9a9-49fd-ab42-2c04f0603caf admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:43.045991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187928cd-d9a9-49fd-ab42-2c04f0603caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:43.047786 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187928cd-d9a9-49fd-ab42-2c04f0603caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:43.048752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187928cd-d9a9-49fd-ab42-2c04f0603caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:43.050559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187928cd-d9a9-49fd-ab42-2c04f0603caf admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:43.060854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 848/1690] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:43.061818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf26d3-eb20-4121-9aba-2c111f0596ce None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:43.094539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 843/1691] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:43.097020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620ed19-3c19-4f70-bf1b-c22053e01568 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:43.097564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620ed19-3c19-4f70-bf1b-c22053e01568 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:43.098038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620ed19-3c19-4f70-bf1b-c22053e01568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:43.171832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0620ed19-3c19-4f70-bf1b-c22053e01568 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:43.174170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0620ed19-3c19-4f70-bf1b-c22053e01568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:43.188247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 844/1692] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:43.189440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620ed19-3c19-4f70-bf1b-c22053e01568 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:43.219448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620ed19-3c19-4f70-bf1b-c22053e01568 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:43.241707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635963b4-79af-4c2f-8430-1f40fafe9987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:43.242507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635963b4-79af-4c2f-8430-1f40fafe9987 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:43.244257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635963b4-79af-4c2f-8430-1f40fafe9987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:43.244652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635963b4-79af-4c2f-8430-1f40fafe9987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:43.246948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635963b4-79af-4c2f-8430-1f40fafe9987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:43.254066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635963b4-79af-4c2f-8430-1f40fafe9987 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:43.277662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf26d3-eb20-4121-9aba-2c111f0596ce None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:43.282768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 845/1693] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:43.287016 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635963b4-79af-4c2f-8430-1f40fafe9987 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:43.321329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6489bd0-63f6-44b2-a8f8-d35842395134 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854ca487dd6b446f8f0cc5e24993a967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a47786656a68429cac1e8ad596800d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:43.323247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6489bd0-63f6-44b2-a8f8-d35842395134 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:43.323537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6489bd0-63f6-44b2-a8f8-d35842395134 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:43.323815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6489bd0-63f6-44b2-a8f8-d35842395134 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:43.324608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6489bd0-63f6-44b2-a8f8-d35842395134 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:43.324921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6489bd0-63f6-44b2-a8f8-d35842395134 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:43.327713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6489bd0-63f6-44b2-a8f8-d35842395134 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:43.339001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635963b4-79af-4c2f-8430-1f40fafe9987 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:43.361075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9a72-f85e-48ca-a013-c1be369acdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:43.362100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9a72-f85e-48ca-a013-c1be369acdeb admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:43.362594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9a72-f85e-48ca-a013-c1be369acdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:43.363058 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9a72-f85e-48ca-a013-c1be369acdeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:43.363909 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9a72-f85e-48ca-a013-c1be369acdeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:43.364908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9a72-f85e-48ca-a013-c1be369acdeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:43.368152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9a72-f85e-48ca-a013-c1be369acdeb admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:43.369079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 849/1694] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:43.382327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053bb48-5b5b-4ebb-8c30-0c2722172989 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:43.383106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053bb48-5b5b-4ebb-8c30-0c2722172989 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:43.383403 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053bb48-5b5b-4ebb-8c30-0c2722172989 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:43.389031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 850/1695] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 21:50:43 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:50:43.390441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053bb48-5b5b-4ebb-8c30-0c2722172989 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:43.400778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 846/1696] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:43.409453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9a72-f85e-48ca-a013-c1be369acdeb admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:43.411721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ac2e9a72-f85e-48ca-a013-c1be369acdeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:43.429403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9a72-f85e-48ca-a013-c1be369acdeb admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:43.436346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:43.438458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:43.438950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:43.439370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] PATH_INFO: `/v3/users/783ab09b25294b72942d03d6ba722413` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:43.441834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=783ab09b25294b72942d03d6ba722413)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:43.444291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:43.458797 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053bb48-5b5b-4ebb-8c30-0c2722172989 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:43.479874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889988a4-7311-4de9-bdcd-6f237e942ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:43.480906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889988a4-7311-4de9-bdcd-6f237e942ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:43.481219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889988a4-7311-4de9-bdcd-6f237e942ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:43.488393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889988a4-7311-4de9-bdcd-6f237e942ae6 admin admin] PATH_INFO: `/v3/projects/1886e860f0324a30a9414b39aefd7e6a/users/32dc5057e1ae419f85adf21ae784d5c0/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:43.550434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889988a4-7311-4de9-bdcd-6f237e942ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1886e860f0324a30a9414b39aefd7e6a, user_id=32dc5057e1ae419f85adf21ae784d5c0, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:43.560528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889988a4-7311-4de9-bdcd-6f237e942ae6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:43.727715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 851/1697] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:43 2022] PUT /identity/v3/projects/1886e860f0324a30a9414b39aefd7e6a/users/32dc5057e1ae419f85adf21ae784d5c0/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:43.727715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b543-bd62-41ce-890b-1ed1d627c585 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:43.727715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b543-bd62-41ce-890b-1ed1d627c585 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:43.727715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8b543-bd62-41ce-890b-1ed1d627c585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:43.778059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b1c8b543-bd62-41ce-890b-1ed1d627c585 None None] MFA Rules not processed for user `2adcc3ba3bdf4b92bd719f60e0b263ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:43.779964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b1c8b543-bd62-41ce-890b-1ed1d627c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:43.849077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 852/1698] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:50:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:43.850180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b543-bd62-41ce-890b-1ed1d627c585 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:43.904049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783ab09b25294b72942d03d6ba722413'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:43.919502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783ab09b25294b72942d03d6ba722413'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:43.921787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783ab09b25294b72942d03d6ba722413'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:44.039693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8b543-bd62-41ce-890b-1ed1d627c585 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:44.047634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c5f43-63a0-4460-bba6-d1944e5acc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:44.051295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c5f43-63a0-4460-bba6-d1944e5acc82 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:44.051295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c5f43-63a0-4460-bba6-d1944e5acc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:44.051295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c5f43-63a0-4460-bba6-d1944e5acc82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:44.051295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c5f43-63a0-4460-bba6-d1944e5acc82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:44.051711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c5f43-63a0-4460-bba6-d1944e5acc82 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:44.087341 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783ab09b25294b72942d03d6ba722413'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:44.138667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783ab09b25294b72942d03d6ba722413'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:44.173017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 847/1699] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:43 2022] DELETE /identity/v3/users/783ab09b25294b72942d03d6ba722413 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:44.174275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:44.176458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:44.302434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 853/1700] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:43 2022] POST /identity/v3/projects => generated 381 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:44.306134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de655d-b531-4289-9e99-fea992303a0b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:44.306763 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de655d-b531-4289-9e99-fea992303a0b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:44.307044 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de655d-b531-4289-9e99-fea992303a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:44.329754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b0fe1-cae5-47b0-ad64-5a4afb772f41 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:44.369896 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-57de655d-b531-4289-9e99-fea992303a0b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:44.373477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-57de655d-b531-4289-9e99-fea992303a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:44.445338 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:44.465217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 854/1701] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:44.465217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de655d-b531-4289-9e99-fea992303a0b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:44.465217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-57de655d-b531-4289-9e99-fea992303a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:44.465962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '854ca487dd6b446f8f0cc5e24993a967', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a47786656a68429cac1e8ad596800d0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:44.465962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:44.465962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:44.466203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] PATH_INFO: `/v3/projects/cb92b522bb214b989a7666ce601b12b7` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:44.466203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb92b522bb214b989a7666ce601b12b7)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:44.466203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:44.519989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:44.546801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de655d-b531-4289-9e99-fea992303a0b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:44.551980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d58987-d473-4ab2-aaca-6a12a8105fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:44.552712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d58987-d473-4ab2-aaca-6a12a8105fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:44.553073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d58987-d473-4ab2-aaca-6a12a8105fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:44.553356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d58987-d473-4ab2-aaca-6a12a8105fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:44.556016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-62d58987-d473-4ab2-aaca-6a12a8105fc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:44.568468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d58987-d473-4ab2-aaca-6a12a8105fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:44.570027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d58987-d473-4ab2-aaca-6a12a8105fc9 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:44.579350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 855/1702] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:44.580691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d84682-1aa6-48a7-ad07-d2da2bbb7cd6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:44.581004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d84682-1aa6-48a7-ad07-d2da2bbb7cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:44.581252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d84682-1aa6-48a7-ad07-d2da2bbb7cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:44.603734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb92b522bb214b989a7666ce601b12b7', 'request_id': 'req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:44.623246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-08d84682-1aa6-48a7-ad07-d2da2bbb7cd6 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:44.624782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-08d84682-1aa6-48a7-ad07-d2da2bbb7cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:44.628089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb92b522bb214b989a7666ce601b12b7', 'request_id': 'req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:44.724249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb92b522bb214b989a7666ce601b12b7', 'request_id': 'req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:44.758368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] The token cache is being invalidate because project cb92b522bb214b989a7666ce601b12b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:44.768173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:44.768173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:44.768173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 848/1703] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:44 2022] DELETE /identity/v3/projects/cb92b522bb214b989a7666ce601b12b7 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:44.768173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:44.768761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:44.776390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 856/1704] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:44.779445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b46ff-43ad-4f44-8897-6d6da7a92818 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:44.781853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b46ff-43ad-4f44-8897-6d6da7a92818 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:44.783161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b46ff-43ad-4f44-8897-6d6da7a92818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:44.784199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2001bd9-bf2f-4d1e-9823-2cc6491b55c1 tempest-VolumeQuotaClassesTest-2048660521 tempest-VolumeQuotaClassesTest-2048660521-project-admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:44.798512 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d0294-f173-41a2-b8a1-9b18ac2262dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:44.799674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d0294-f173-41a2-b8a1-9b18ac2262dc admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:44.800619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d0294-f173-41a2-b8a1-9b18ac2262dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:44.801028 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d0294-f173-41a2-b8a1-9b18ac2262dc admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:44.801790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d0294-f173-41a2-b8a1-9b18ac2262dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:44.805871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d0294-f173-41a2-b8a1-9b18ac2262dc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:44.811358 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d46b46ff-43ad-4f44-8897-6d6da7a92818 None None] MFA Rules not processed for user `fb465b4782514e7d8e75a7dc14c0a1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:44.812901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d46b46ff-43ad-4f44-8897-6d6da7a92818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:44.890951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 857/1705] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:44.891976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b46ff-43ad-4f44-8897-6d6da7a92818 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:44.894888 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d46b46ff-43ad-4f44-8897-6d6da7a92818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:44.967217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 849/1706] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:44 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:44.970342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d0294-f173-41a2-b8a1-9b18ac2262dc admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:44.980436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-cb2d0294-f173-41a2-b8a1-9b18ac2262dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:45.041343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b46ff-43ad-4f44-8897-6d6da7a92818 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:45.054499 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5f477-fe43-48fe-b973-0313f4ea069d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:45.056503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5f477-fe43-48fe-b973-0313f4ea069d service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:45.057735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5f477-fe43-48fe-b973-0313f4ea069d service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:45.058149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5f477-fe43-48fe-b973-0313f4ea069d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:45.063600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1fd5f477-fe43-48fe-b973-0313f4ea069d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:45.097807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5f477-fe43-48fe-b973-0313f4ea069d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:45.101971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5f477-fe43-48fe-b973-0313f4ea069d service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:45.127299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d0294-f173-41a2-b8a1-9b18ac2262dc admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:45.133423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 858/1707] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:45.134792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5f477-fe43-48fe-b973-0313f4ea069d service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:45.142020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c32ff-b261-44b7-aecc-056aa9e443da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:45.142885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c32ff-b261-44b7-aecc-056aa9e443da service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:45.143241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c32ff-b261-44b7-aecc-056aa9e443da service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:45.143587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c32ff-b261-44b7-aecc-056aa9e443da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:45.146903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6b2c32ff-b261-44b7-aecc-056aa9e443da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:45.157821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5f477-fe43-48fe-b973-0313f4ea069d service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:45.174154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186ca2-7654-4063-aaa4-d65a5cc7288e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:45.175227 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186ca2-7654-4063-aaa4-d65a5cc7288e admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:45.175612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186ca2-7654-4063-aaa4-d65a5cc7288e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:45.175963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be186ca2-7654-4063-aaa4-d65a5cc7288e admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:45.176753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be186ca2-7654-4063-aaa4-d65a5cc7288e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:45.180107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be186ca2-7654-4063-aaa4-d65a5cc7288e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:45.181396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c32ff-b261-44b7-aecc-056aa9e443da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:45.182961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c32ff-b261-44b7-aecc-056aa9e443da service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:45.209223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 859/1708] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:45.209445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 850/1709] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:45.210749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186ca2-7654-4063-aaa4-d65a5cc7288e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:45.222969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be186ca2-7654-4063-aaa4-d65a5cc7288e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:45.229366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a56f5-a00b-42d3-983f-61890db62437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:45.230201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a56f5-a00b-42d3-983f-61890db62437 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:45.230644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a56f5-a00b-42d3-983f-61890db62437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:45.230971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a56f5-a00b-42d3-983f-61890db62437 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:45.231892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a56f5-a00b-42d3-983f-61890db62437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:45.234405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a56f5-a00b-42d3-983f-61890db62437 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:45.252572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 860/1710] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:50:45.254533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c32ff-b261-44b7-aecc-056aa9e443da service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:45.266500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c32ff-b261-44b7-aecc-056aa9e443da service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:45.286252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a24e8-89b1-4c7c-83fd-8726f186b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:45.287131 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a24e8-89b1-4c7c-83fd-8726f186b2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:45.287556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a24e8-89b1-4c7c-83fd-8726f186b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:45.287943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a24e8-89b1-4c7c-83fd-8726f186b2ca admin admin] PATH_INFO: `/v3/projects/d26426947c184c1caab4ecc228e86345/users/213d1429fc964a46aa0bbd16d81d136d/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:45.309558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a24e8-89b1-4c7c-83fd-8726f186b2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26426947c184c1caab4ecc228e86345, user_id=213d1429fc964a46aa0bbd16d81d136d, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:45.313030 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a24e8-89b1-4c7c-83fd-8726f186b2ca admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:45.420927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 851/1711] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:45 2022] PUT /identity/v3/projects/d26426947c184c1caab4ecc228e86345/users/213d1429fc964a46aa0bbd16d81d136d/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:45.437057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55cba7-74bd-45ed-9ba5-e647f38c2209 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:45.437577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55cba7-74bd-45ed-9ba5-e647f38c2209 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:45.437577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55cba7-74bd-45ed-9ba5-e647f38c2209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:45.573587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6d55cba7-74bd-45ed-9ba5-e647f38c2209 None None] MFA Rules not processed for user `213d1429fc964a46aa0bbd16d81d136d`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:45.581139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6d55cba7-74bd-45ed-9ba5-e647f38c2209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:45.665714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a24e8-89b1-4c7c-83fd-8726f186b2ca admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:45.667518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ae4a24e8-89b1-4c7c-83fd-8726f186b2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:45.822618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a24e8-89b1-4c7c-83fd-8726f186b2ca admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:45.853507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7893974-ed8d-46d3-8c0e-9aed99e07160 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca09f6fe11f4b878dd11c4cb69ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:45.854622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893974-ed8d-46d3-8c0e-9aed99e07160 service placement] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:45.855142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893974-ed8d-46d3-8c0e-9aed99e07160 service placement] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:45.855656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893974-ed8d-46d3-8c0e-9aed99e07160 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:45.863267 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 861/1712] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:45.864737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f7893974-ed8d-46d3-8c0e-9aed99e07160 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:45.866189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55cba7-74bd-45ed-9ba5-e647f38c2209 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:45.869418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6d55cba7-74bd-45ed-9ba5-e647f38c2209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:45.935770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7893974-ed8d-46d3-8c0e-9aed99e07160 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:45.937997 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7893974-ed8d-46d3-8c0e-9aed99e07160 service placement] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:45.969678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 852/1713] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:45.970544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7893974-ed8d-46d3-8c0e-9aed99e07160 service placement] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:46.023141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55cba7-74bd-45ed-9ba5-e647f38c2209 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:46.031435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:46.033645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:46.034225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:46.039473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] PATH_INFO: `/v3/users/9039b9be42844152860edf5ea7b2808e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:46.041651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9039b9be42844152860edf5ea7b2808e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:46.044242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:46.162120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7893974-ed8d-46d3-8c0e-9aed99e07160 service placement] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:46.180211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff007b-13d4-4956-8ca8-1d61bfeace13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:46.181099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff007b-13d4-4956-8ca8-1d61bfeace13 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:46.181369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff007b-13d4-4956-8ca8-1d61bfeace13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:46.181650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff007b-13d4-4956-8ca8-1d61bfeace13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:46.182369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff007b-13d4-4956-8ca8-1d61bfeace13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:46.186148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff007b-13d4-4956-8ca8-1d61bfeace13 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:46.313707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9039b9be42844152860edf5ea7b2808e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:46.355582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9039b9be42844152860edf5ea7b2808e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:46.356879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9039b9be42844152860edf5ea7b2808e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:46.449303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 853/1714] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:45 2022] POST /identity/v3/projects => generated 379 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:46.451055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281145-478c-49f9-95e4-cd38d5a2a7a7 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:46.451444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281145-478c-49f9-95e4-cd38d5a2a7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:46.451876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3281145-478c-49f9-95e4-cd38d5a2a7a7 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:46.453514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 854/1715] 10.222.0.83 () {54 vars in 912 bytes} [Mon Aug 29 21:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:50:46.455540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281145-478c-49f9-95e4-cd38d5a2a7a7 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:46.484986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9039b9be42844152860edf5ea7b2808e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:46.486031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ff5d76dd-0a0b-4e87-8f47-a91d5c29910b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9039b9be42844152860edf5ea7b2808e'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:46.553663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 862/1716] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:45 2022] DELETE /identity/v3/users/9039b9be42844152860edf5ea7b2808e => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:46.558542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec86b72-8ab4-48da-91df-45cedac58275 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:46.559035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec86b72-8ab4-48da-91df-45cedac58275 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:46.560675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec86b72-8ab4-48da-91df-45cedac58275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:46.641597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3281145-478c-49f9-95e4-cd38d5a2a7a7 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:46.651702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0ec86b72-8ab4-48da-91df-45cedac58275 None None] MFA Rules not processed for user `2adcc3ba3bdf4b92bd719f60e0b263ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:46.657058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0ec86b72-8ab4-48da-91df-45cedac58275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:46.678955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:46.805831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 863/1717] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:50:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:46.807462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9474e-9752-448b-a1b2-1ba313ea31ba None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:46.807746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9474e-9752-448b-a1b2-1ba313ea31ba None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:46.814990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9474e-9752-448b-a1b2-1ba313ea31ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:46.846940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2ef9474e-9752-448b-a1b2-1ba313ea31ba None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:46.848809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2ef9474e-9752-448b-a1b2-1ba313ea31ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:46.927356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d83f2-d393-4f3f-9c12-1633d5ed13cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:46.929178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d83f2-d393-4f3f-9c12-1633d5ed13cd admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:46.929810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d83f2-d393-4f3f-9c12-1633d5ed13cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:46.934052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d83f2-d393-4f3f-9c12-1633d5ed13cd admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:46.941106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d83f2-d393-4f3f-9c12-1633d5ed13cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:46.941106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d83f2-d393-4f3f-9c12-1633d5ed13cd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:46.949865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 864/1718] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:46.951310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9474e-9752-448b-a1b2-1ba313ea31ba None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:46.953191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2ef9474e-9752-448b-a1b2-1ba313ea31ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:46.980326 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9474e-9752-448b-a1b2-1ba313ea31ba None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:46.985558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7defcc-e859-4cb9-a629-f824d021c85b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:46.986476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7defcc-e859-4cb9-a629-f824d021c85b service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:46.986923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7defcc-e859-4cb9-a629-f824d021c85b service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:46.987443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7defcc-e859-4cb9-a629-f824d021c85b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:46.997972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7defcc-e859-4cb9-a629-f824d021c85b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:47.000700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7defcc-e859-4cb9-a629-f824d021c85b service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:47.020950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 865/1719] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:47.021895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7defcc-e859-4cb9-a629-f824d021c85b service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:47.034501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7defcc-e859-4cb9-a629-f824d021c85b service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:47.049918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638db6a-2e6b-4ca9-b152-2becbbd5def8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:47.051125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638db6a-2e6b-4ca9-b152-2becbbd5def8 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:47.051732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638db6a-2e6b-4ca9-b152-2becbbd5def8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:47.052169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638db6a-2e6b-4ca9-b152-2becbbd5def8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:47.071271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638db6a-2e6b-4ca9-b152-2becbbd5def8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:47.074149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638db6a-2e6b-4ca9-b152-2becbbd5def8 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:47.111353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 866/1720] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:47.118753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638db6a-2e6b-4ca9-b152-2becbbd5def8 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:47.122515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 855/1721] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:46 2022] POST /identity/v3/users => generated 296 bytes in 668 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:47.134509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7638db6a-2e6b-4ca9-b152-2becbbd5def8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:47.134660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d83f2-d393-4f3f-9c12-1633d5ed13cd admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:47.134660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8b3d83f2-d393-4f3f-9c12-1633d5ed13cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:47.159996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d83f2-d393-4f3f-9c12-1633d5ed13cd admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:47.177145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e240b19-230f-43fd-926d-e2ec0589b841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:47.178739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e240b19-230f-43fd-926d-e2ec0589b841 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:47.179322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e240b19-230f-43fd-926d-e2ec0589b841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:47.179775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e240b19-230f-43fd-926d-e2ec0589b841 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:47.180662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e240b19-230f-43fd-926d-e2ec0589b841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:47.182758 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e240b19-230f-43fd-926d-e2ec0589b841 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:47.193338 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638db6a-2e6b-4ca9-b152-2becbbd5def8 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:47.207828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 856/1722] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:50:47.217102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e240b19-230f-43fd-926d-e2ec0589b841 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:47.239786 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:47.240357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e240b19-230f-43fd-926d-e2ec0589b841 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:47.241685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:47.245027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:47.245991 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] PATH_INFO: `/v3/projects/710b77d088734bca99607de3548945bf` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:47.255849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=710b77d088734bca99607de3548945bf)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:47.255849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:47.256069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a10d9-0439-4167-b932-75d6f5943e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:47.256696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a10d9-0439-4167-b932-75d6f5943e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:47.257159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a10d9-0439-4167-b932-75d6f5943e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:47.257576 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a10d9-0439-4167-b932-75d6f5943e2f admin admin] PATH_INFO: `/v3/projects/537f09703ef744ffb033da7ebb0e95ba/users/5359fe9c72b34fa196902dcd28eafe65/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:47.305224 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a10d9-0439-4167-b932-75d6f5943e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=537f09703ef744ffb033da7ebb0e95ba, user_id=5359fe9c72b34fa196902dcd28eafe65, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:47.309752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a10d9-0439-4167-b932-75d6f5943e2f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:47.481746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 857/1723] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:47 2022] PUT /identity/v3/projects/537f09703ef744ffb033da7ebb0e95ba/users/5359fe9c72b34fa196902dcd28eafe65/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:47.482493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a10d9-0439-4167-b932-75d6f5943e2f admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:47.516001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:47.565117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710b77d088734bca99607de3548945bf', 'request_id': 'req-22483efe-1414-432f-beaf-9247f0972f0a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:47.609604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710b77d088734bca99607de3548945bf', 'request_id': 'req-22483efe-1414-432f-beaf-9247f0972f0a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:47.675507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a10d9-0439-4167-b932-75d6f5943e2f admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:47.732184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710b77d088734bca99607de3548945bf', 'request_id': 'req-22483efe-1414-432f-beaf-9247f0972f0a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:47.774292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] The token cache is being invalidate because project 710b77d088734bca99607de3548945bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:47.774694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:47.787398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-22483efe-1414-432f-beaf-9247f0972f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:47.791996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 867/1724] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:47 2022] DELETE /identity/v3/projects/710b77d088734bca99607de3548945bf => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:47.798535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a4fcf-159b-4da6-a089-943945a155c0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:47.801238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a4fcf-159b-4da6-a089-943945a155c0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:47.801884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a4fcf-159b-4da6-a089-943945a155c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:47.843326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b120818-db8b-4b01-b5bd-bcd2b70e97cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:47.844860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b120818-db8b-4b01-b5bd-bcd2b70e97cb admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:47.845358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b120818-db8b-4b01-b5bd-bcd2b70e97cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:47.845829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b120818-db8b-4b01-b5bd-bcd2b70e97cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:47.847014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b120818-db8b-4b01-b5bd-bcd2b70e97cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:47.851184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b120818-db8b-4b01-b5bd-bcd2b70e97cb admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:47.855522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0a6a4fcf-159b-4da6-a089-943945a155c0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:47.858016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0a6a4fcf-159b-4da6-a089-943945a155c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:47.866752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 858/1725] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:47.872843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b120818-db8b-4b01-b5bd-bcd2b70e97cb admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:47.876413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7b120818-db8b-4b01-b5bd-bcd2b70e97cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:47.887741 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 868/1726] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:50:47.894662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97361f1e-be1a-4a26-8a39-2351bba26f8d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:47.895794 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97361f1e-be1a-4a26-8a39-2351bba26f8d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:47.896416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97361f1e-be1a-4a26-8a39-2351bba26f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:47.905167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b120818-db8b-4b01-b5bd-bcd2b70e97cb admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:47.921044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35f6fc-c3e4-4366-9ec5-e4e8516dfba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:47.921981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35f6fc-c3e4-4366-9ec5-e4e8516dfba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:47.922369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35f6fc-c3e4-4366-9ec5-e4e8516dfba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:47.922749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35f6fc-c3e4-4366-9ec5-e4e8516dfba1 admin admin] PATH_INFO: `/v3/projects/537f09703ef744ffb033da7ebb0e95ba/users/5359fe9c72b34fa196902dcd28eafe65/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:47.929465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35f6fc-c3e4-4366-9ec5-e4e8516dfba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537f09703ef744ffb033da7ebb0e95ba, user_id=5359fe9c72b34fa196902dcd28eafe65, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:47.932326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35f6fc-c3e4-4366-9ec5-e4e8516dfba1 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:47.972358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 859/1727] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:47 2022] PUT /identity/v3/projects/537f09703ef744ffb033da7ebb0e95ba/users/5359fe9c72b34fa196902dcd28eafe65/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:50:47.972646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-97361f1e-be1a-4a26-8a39-2351bba26f8d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:47.972646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-97361f1e-be1a-4a26-8a39-2351bba26f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:47.979498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e166-dc9a-4698-95f1-4444295e4948 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:47.979900 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e166-dc9a-4698-95f1-4444295e4948 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:47.980287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741e166-dc9a-4698-95f1-4444295e4948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:48.062579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e741e166-dc9a-4698-95f1-4444295e4948 None None] MFA Rules not processed for user `5359fe9c72b34fa196902dcd28eafe65`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:48.063887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e741e166-dc9a-4698-95f1-4444295e4948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:48.222927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 869/1728] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:50:48.257330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97361f1e-be1a-4a26-8a39-2351bba26f8d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:48.279880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 860/1729] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:48.292288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741e166-dc9a-4698-95f1-4444295e4948 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:48.293840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97361f1e-be1a-4a26-8a39-2351bba26f8d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:48.304941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e741e166-dc9a-4698-95f1-4444295e4948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:48.318422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf778181-7496-4cc3-b440-23a60597a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:48.319207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778181-7496-4cc3-b440-23a60597a6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:48.319489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778181-7496-4cc3-b440-23a60597a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:48.319857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf778181-7496-4cc3-b440-23a60597a6f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:48.320420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf778181-7496-4cc3-b440-23a60597a6f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:48.320754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf778181-7496-4cc3-b440-23a60597a6f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:48.327987 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf778181-7496-4cc3-b440-23a60597a6f5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:48.388310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 870/1730] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:48.395152 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf778181-7496-4cc3-b440-23a60597a6f5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:48.435232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf778181-7496-4cc3-b440-23a60597a6f5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:48.454908 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd296ab-d316-4d17-b55f-a41239a2e524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:48.455543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd296ab-d316-4d17-b55f-a41239a2e524 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:48.455861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd296ab-d316-4d17-b55f-a41239a2e524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:48.456086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd296ab-d316-4d17-b55f-a41239a2e524 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:48.456756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd296ab-d316-4d17-b55f-a41239a2e524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:48.461545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd296ab-d316-4d17-b55f-a41239a2e524 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:48.558889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741e166-dc9a-4698-95f1-4444295e4948 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:48.565360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027cb1a-e022-4756-8761-9152ca43caec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:48.566002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027cb1a-e022-4756-8761-9152ca43caec service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:48.566333 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027cb1a-e022-4756-8761-9152ca43caec service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:48.566649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027cb1a-e022-4756-8761-9152ca43caec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:48.606165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027cb1a-e022-4756-8761-9152ca43caec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:48.607747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027cb1a-e022-4756-8761-9152ca43caec service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:48.622523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 861/1731] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:48.705897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 871/1732] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:48 2022] POST /identity/v3/projects => generated 405 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:50:48.711004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027cb1a-e022-4756-8761-9152ca43caec service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:48.744004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd296ab-d316-4d17-b55f-a41239a2e524 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:48.749546 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027cb1a-e022-4756-8761-9152ca43caec service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:48.768622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3bd296ab-d316-4d17-b55f-a41239a2e524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:48.840171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3612-3854-4328-8c30-c64056465155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:48.844142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3612-3854-4328-8c30-c64056465155 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:48.844142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3612-3854-4328-8c30-c64056465155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:48.844142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a3612-3854-4328-8c30-c64056465155 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:48.845622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a3612-3854-4328-8c30-c64056465155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:48.850535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a3612-3854-4328-8c30-c64056465155 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:48.957270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd296ab-d316-4d17-b55f-a41239a2e524 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:48.972915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:48.974564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:48.976509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:48.977720 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] PATH_INFO: `/v3/projects/371d00b6838544588f03e9c839cec18c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:48.980343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] RBAC: Authorizing `identity:delete_project(project_id=371d00b6838544588f03e9c839cec18c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:48.983054 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:49.111344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 862/1733] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:48 2022] POST /identity/v3/users => generated 303 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:50:49.116661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3612-3854-4328-8c30-c64056465155 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:49.134033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a3612-3854-4328-8c30-c64056465155 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:49.142925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689473b-7b24-40c8-9b3f-a192a4d64c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:49.144403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689473b-7b24-40c8-9b3f-a192a4d64c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:49.145168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689473b-7b24-40c8-9b3f-a192a4d64c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:49.146323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4689473b-7b24-40c8-9b3f-a192a4d64c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:49.147890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689473b-7b24-40c8-9b3f-a192a4d64c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:49.150823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4689473b-7b24-40c8-9b3f-a192a4d64c5c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:49.171620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 863/1734] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:49.173379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689473b-7b24-40c8-9b3f-a192a4d64c5c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:49.184837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4689473b-7b24-40c8-9b3f-a192a4d64c5c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:49.190057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e1b2b-3484-4b62-9d59-6d38ca383ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:49.191000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e1b2b-3484-4b62-9d59-6d38ca383ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:49.191282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e1b2b-3484-4b62-9d59-6d38ca383ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:49.192216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e1b2b-3484-4b62-9d59-6d38ca383ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:49.192382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e1b2b-3484-4b62-9d59-6d38ca383ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:49.194108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e1b2b-3484-4b62-9d59-6d38ca383ca8 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:49.243643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 864/1735] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:50:49.245198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8024f-0c59-4d53-a8ca-67b88927c1fb None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:49.245480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8024f-0c59-4d53-a8ca-67b88927c1fb None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:49.245755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8024f-0c59-4d53-a8ca-67b88927c1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:49.260840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371d00b6838544588f03e9c839cec18c', 'request_id': 'req-654f917f-6f8e-407e-bb3c-73873f6e640c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:49.275158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371d00b6838544588f03e9c839cec18c', 'request_id': 'req-654f917f-6f8e-407e-bb3c-73873f6e640c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:49.309166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b5c8024f-0c59-4d53-a8ca-67b88927c1fb None None] MFA Rules not processed for user `32dc5057e1ae419f85adf21ae784d5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:49.324783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b5c8024f-0c59-4d53-a8ca-67b88927c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:49.399400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371d00b6838544588f03e9c839cec18c', 'request_id': 'req-654f917f-6f8e-407e-bb3c-73873f6e640c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:49.424005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 865/1736] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:49 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:49.434638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2496f-acbb-4ff8-94fd-36e34099e666 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:49.435184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] The token cache is being invalidate because project 371d00b6838544588f03e9c839cec18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:49.435673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:49.437912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:49.439458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2496f-acbb-4ff8-94fd-36e34099e666 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:49.439972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2496f-acbb-4ff8-94fd-36e34099e666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:49.443453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 872/1737] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:48 2022] DELETE /identity/v3/projects/371d00b6838544588f03e9c839cec18c => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:49.444524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:49.449829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:49.480659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-27e2496f-acbb-4ff8-94fd-36e34099e666 None None] MFA Rules not processed for user `ed8ef9f9eafd4248bae86f0e8ec72731`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:49.482896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-27e2496f-acbb-4ff8-94fd-36e34099e666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:49.568583 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 866/1738] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:49.569666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2496f-acbb-4ff8-94fd-36e34099e666 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:49.579176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-27e2496f-acbb-4ff8-94fd-36e34099e666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:49.596110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f917f-6f8e-407e-bb3c-73873f6e640c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:49.617029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2496f-acbb-4ff8-94fd-36e34099e666 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:49.617188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84911e71-b39e-4fba-ab2f-646ef46a56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:49.617188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84911e71-b39e-4fba-ab2f-646ef46a56e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:49.617188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84911e71-b39e-4fba-ab2f-646ef46a56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:49.617188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84911e71-b39e-4fba-ab2f-646ef46a56e4 admin admin] PATH_INFO: `/v3/projects/f41af7dea7814b5787e88a35adadb5c2/users/fd76f4bc5d5a459fa6a8edcf18b93467/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:49.629127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23d410-2d1d-4a63-b0b3-610c63b35d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:49.631914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23d410-2d1d-4a63-b0b3-610c63b35d3b admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:49.632904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23d410-2d1d-4a63-b0b3-610c63b35d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:49.633766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23d410-2d1d-4a63-b0b3-610c63b35d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:49.635101 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23d410-2d1d-4a63-b0b3-610c63b35d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:49.639897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23d410-2d1d-4a63-b0b3-610c63b35d3b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:49.663215 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84911e71-b39e-4fba-ab2f-646ef46a56e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41af7dea7814b5787e88a35adadb5c2, user_id=fd76f4bc5d5a459fa6a8edcf18b93467, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:49.669525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84911e71-b39e-4fba-ab2f-646ef46a56e4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:49.823640 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 867/1739] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:49 2022] POST /identity/v3/projects => generated 405 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:49.824225 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23d410-2d1d-4a63-b0b3-610c63b35d3b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:49.824738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 873/1740] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:49 2022] PUT /identity/v3/projects/f41af7dea7814b5787e88a35adadb5c2/users/fd76f4bc5d5a459fa6a8edcf18b93467/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:49.829500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84911e71-b39e-4fba-ab2f-646ef46a56e4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:49.837548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2b23d410-2d1d-4a63-b0b3-610c63b35d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:49.846405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-84911e71-b39e-4fba-ab2f-646ef46a56e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:50.049709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84911e71-b39e-4fba-ab2f-646ef46a56e4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:50.127569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23d410-2d1d-4a63-b0b3-610c63b35d3b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:50.140201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:50.141407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:50.142324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:50.143272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] PATH_INFO: `/v3/users/854ca487dd6b446f8f0cc5e24993a967` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:50.145924 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] RBAC: Authorizing `identity:delete_user(user_id=854ca487dd6b446f8f0cc5e24993a967)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:50.151280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:50.172450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:50.195589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:50.197623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:50.198010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:50.198471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] PATH_INFO: `/v3/users/213d1429fc964a46aa0bbd16d81d136d` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:50.200402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=213d1429fc964a46aa0bbd16d81d136d)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:50.205167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:50.496853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '854ca487dd6b446f8f0cc5e24993a967'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:50.513773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213d1429fc964a46aa0bbd16d81d136d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:50.516071 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '854ca487dd6b446f8f0cc5e24993a967'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:50.519103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '854ca487dd6b446f8f0cc5e24993a967'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:50.553875 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213d1429fc964a46aa0bbd16d81d136d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:50.555963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213d1429fc964a46aa0bbd16d81d136d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:50.651620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '854ca487dd6b446f8f0cc5e24993a967'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:50.682382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '854ca487dd6b446f8f0cc5e24993a967'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:50.695397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 868/1741] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:49 2022] DELETE /identity/v3/users/854ca487dd6b446f8f0cc5e24993a967 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:50.697984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:50.716266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:50.783528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213d1429fc964a46aa0bbd16d81d136d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:50.785757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb540be6-bdbe-445a-b0df-27395e29fc6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213d1429fc964a46aa0bbd16d81d136d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:50.813497 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 874/1742] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:49 2022] DELETE /identity/v3/users/213d1429fc964a46aa0bbd16d81d136d => generated 0 bytes in 985 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:50.815400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8be83-f9d8-49ae-8e23-1486268ddd4e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:50.815723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8be83-f9d8-49ae-8e23-1486268ddd4e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:50.816698 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8be83-f9d8-49ae-8e23-1486268ddd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:50.878919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f8f8be83-f9d8-49ae-8e23-1486268ddd4e None None] MFA Rules not processed for user `fd76f4bc5d5a459fa6a8edcf18b93467`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:50.880936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f8f8be83-f9d8-49ae-8e23-1486268ddd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:50.883387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dffa8a-2433-41e2-ac2c-8bed61caa08b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:50.997814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5287be-cb60-4aee-bf56-6c902442ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:50.998569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5287be-cb60-4aee-bf56-6c902442ffcf admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:50.999482 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5287be-cb60-4aee-bf56-6c902442ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:51.000640 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5287be-cb60-4aee-bf56-6c902442ffcf admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:51.002101 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5287be-cb60-4aee-bf56-6c902442ffcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:51.009136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5287be-cb60-4aee-bf56-6c902442ffcf admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:51.041854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 875/1743] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:51.043999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08691d1-0e38-4d1c-b261-e3554989ab9e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:51.044363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08691d1-0e38-4d1c-b261-e3554989ab9e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:51.045236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08691d1-0e38-4d1c-b261-e3554989ab9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:51.067693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b08691d1-0e38-4d1c-b261-e3554989ab9e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:51.068959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b08691d1-0e38-4d1c-b261-e3554989ab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:51.080981 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 876/1744] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:51.082279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08691d1-0e38-4d1c-b261-e3554989ab9e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:51.083927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b08691d1-0e38-4d1c-b261-e3554989ab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:51.097986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08691d1-0e38-4d1c-b261-e3554989ab9e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:51.104163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e3ef2-c8b9-44c8-9bc8-7b19d6437443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:51.104848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e3ef2-c8b9-44c8-9bc8-7b19d6437443 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:51.110423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e3ef2-c8b9-44c8-9bc8-7b19d6437443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:51.110423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e3ef2-c8b9-44c8-9bc8-7b19d6437443 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:51.110423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e3ef2-c8b9-44c8-9bc8-7b19d6437443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:51.110423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e3ef2-c8b9-44c8-9bc8-7b19d6437443 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:51.281188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 869/1745] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:50 2022] POST /identity/v3/users => generated 309 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:51.281478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5287be-cb60-4aee-bf56-6c902442ffcf admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:51.290354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ab5287be-cb60-4aee-bf56-6c902442ffcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:51.335609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:51.340539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 877/1746] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:51 2022] POST /identity/v3/projects => generated 403 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:51.341628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e3ef2-c8b9-44c8-9bc8-7b19d6437443 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:51.347338 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1f8e3ef2-c8b9-44c8-9bc8-7b19d6437443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:51.410319 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5287be-cb60-4aee-bf56-6c902442ffcf admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:51.511449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e3ef2-c8b9-44c8-9bc8-7b19d6437443 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:51.520775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c92ea-55e4-4ecd-bdfb-cb446218cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:51.521570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c92ea-55e4-4ecd-bdfb-cb446218cfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:51.521972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c92ea-55e4-4ecd-bdfb-cb446218cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:51.522401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c92ea-55e4-4ecd-bdfb-cb446218cfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:51.523230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c92ea-55e4-4ecd-bdfb-cb446218cfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:51.525728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106c92ea-55e4-4ecd-bdfb-cb446218cfd2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:51.539159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 878/1747] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:51.543036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c92ea-55e4-4ecd-bdfb-cb446218cfd2 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:51.611075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c92ea-55e4-4ecd-bdfb-cb446218cfd2 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:51.625340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa413fc-825b-4525-a978-aa2a88ee1128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:51.625340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa413fc-825b-4525-a978-aa2a88ee1128 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:51.625340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa413fc-825b-4525-a978-aa2a88ee1128 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:51.625340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa413fc-825b-4525-a978-aa2a88ee1128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:51.631735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3d6d8-3f84-4ab2-8b8b-32537a0e2936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:51.632589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3d6d8-3f84-4ab2-8b8b-32537a0e2936 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:51.632971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3d6d8-3f84-4ab2-8b8b-32537a0e2936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:51.633361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3d6d8-3f84-4ab2-8b8b-32537a0e2936 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:51.634112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3d6d8-3f84-4ab2-8b8b-32537a0e2936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:51.643796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3d6d8-3f84-4ab2-8b8b-32537a0e2936 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:51.664985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa413fc-825b-4525-a978-aa2a88ee1128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:51.668955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa413fc-825b-4525-a978-aa2a88ee1128 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:51.727493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 870/1748] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:51.729538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa413fc-825b-4525-a978-aa2a88ee1128 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:51.764998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa413fc-825b-4525-a978-aa2a88ee1128 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:51.776546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 879/1749] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:51 2022] POST /identity/v3/users => generated 308 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:51.781411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3d6d8-3f84-4ab2-8b8b-32537a0e2936 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:51.783973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f85f4-9ac3-4daa-aade-82c0b59595c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:51.784764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f85f4-9ac3-4daa-aade-82c0b59595c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:51.785072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f85f4-9ac3-4daa-aade-82c0b59595c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:51.785533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f85f4-9ac3-4daa-aade-82c0b59595c5 admin admin] PATH_INFO: `/v3/projects/c024d640fe094a13b337b51f9bcfdbe9/users/887ed8602e2a4af4a63ab20d170b7dc4/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:51.794742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3d6d8-3f84-4ab2-8b8b-32537a0e2936 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:51.805496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f85f4-9ac3-4daa-aade-82c0b59595c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c024d640fe094a13b337b51f9bcfdbe9, user_id=887ed8602e2a4af4a63ab20d170b7dc4, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:51.807045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f85f4-9ac3-4daa-aade-82c0b59595c5 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:51.810605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3df69-d7ec-4de1-874c-e047ff1f428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:51.811896 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3df69-d7ec-4de1-874c-e047ff1f428f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:51.812228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3df69-d7ec-4de1-874c-e047ff1f428f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:51.815352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3df69-d7ec-4de1-874c-e047ff1f428f admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:51.820924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3df69-d7ec-4de1-874c-e047ff1f428f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:51.822589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3df69-d7ec-4de1-874c-e047ff1f428f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:51.834939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 880/1750] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:51.839232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3df69-d7ec-4de1-874c-e047ff1f428f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:51.853686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3df69-d7ec-4de1-874c-e047ff1f428f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:51.860231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8b020-01e1-43c5-8321-0087707e8087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:51.860953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8b020-01e1-43c5-8321-0087707e8087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:51.861232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8b020-01e1-43c5-8321-0087707e8087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:51.861507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8b020-01e1-43c5-8321-0087707e8087 admin admin] PATH_INFO: `/v3/projects/7c5c954ff86849d3ab98a633c659e550/users/8d5ff4b5ad974c349dad363503448460/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:51.881219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8b020-01e1-43c5-8321-0087707e8087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5c954ff86849d3ab98a633c659e550, user_id=8d5ff4b5ad974c349dad363503448460, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:51.883919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8b020-01e1-43c5-8321-0087707e8087 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:51.914929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 871/1751] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:51 2022] PUT /identity/v3/projects/c024d640fe094a13b337b51f9bcfdbe9/users/887ed8602e2a4af4a63ab20d170b7dc4/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:51.919582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f85f4-9ac3-4daa-aade-82c0b59595c5 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:52.007906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f85f4-9ac3-4daa-aade-82c0b59595c5 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:52.013326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c071ede-d3b0-4d2a-b41c-007029d4693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:52.013973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c071ede-d3b0-4d2a-b41c-007029d4693f admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:52.014284 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c071ede-d3b0-4d2a-b41c-007029d4693f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:52.015199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c071ede-d3b0-4d2a-b41c-007029d4693f admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:52.015866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c071ede-d3b0-4d2a-b41c-007029d4693f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:52.017559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c071ede-d3b0-4d2a-b41c-007029d4693f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:52.033051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 872/1752] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:50:52.037535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c071ede-d3b0-4d2a-b41c-007029d4693f admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:52.053373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c071ede-d3b0-4d2a-b41c-007029d4693f admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:52.060148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967206b3-aa61-4d4c-ad32-8518979301dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:52.060883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967206b3-aa61-4d4c-ad32-8518979301dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:52.061685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967206b3-aa61-4d4c-ad32-8518979301dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:52.061964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967206b3-aa61-4d4c-ad32-8518979301dc admin admin] PATH_INFO: `/v3/projects/c024d640fe094a13b337b51f9bcfdbe9/users/887ed8602e2a4af4a63ab20d170b7dc4/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:52.064096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967206b3-aa61-4d4c-ad32-8518979301dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c024d640fe094a13b337b51f9bcfdbe9, user_id=887ed8602e2a4af4a63ab20d170b7dc4, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:52.072344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967206b3-aa61-4d4c-ad32-8518979301dc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:52.078625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 881/1753] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:51 2022] PUT /identity/v3/projects/7c5c954ff86849d3ab98a633c659e550/users/8d5ff4b5ad974c349dad363503448460/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:50:52.080113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8b020-01e1-43c5-8321-0087707e8087 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:52.115236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 873/1754] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:52 2022] PUT /identity/v3/projects/c024d640fe094a13b337b51f9bcfdbe9/users/887ed8602e2a4af4a63ab20d170b7dc4/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:52.133031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967206b3-aa61-4d4c-ad32-8518979301dc admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:52.143910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-967206b3-aa61-4d4c-ad32-8518979301dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:52.220347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8b020-01e1-43c5-8321-0087707e8087 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:52.358784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967206b3-aa61-4d4c-ad32-8518979301dc admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:52.408053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:52.416090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:52.418964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:52.425012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] PATH_INFO: `/v3/projects/a47786656a68429cac1e8ad596800d0c` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:52.430043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47786656a68429cac1e8ad596800d0c)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:52.452592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:52.479209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8339a8-9bdf-4c2c-a95e-b19d7689f3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:52.482914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8339a8-9bdf-4c2c-a95e-b19d7689f3eb admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:52.484595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8339a8-9bdf-4c2c-a95e-b19d7689f3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:52.486878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8339a8-9bdf-4c2c-a95e-b19d7689f3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:52.489512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8339a8-9bdf-4c2c-a95e-b19d7689f3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:52.497969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8339a8-9bdf-4c2c-a95e-b19d7689f3eb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:52.549014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 882/1755] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:52.550951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8339a8-9bdf-4c2c-a95e-b19d7689f3eb admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:52.572797 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8339a8-9bdf-4c2c-a95e-b19d7689f3eb admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:52.578466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf6f91e-b619-4070-bf04-a9f6ea992dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:52.579283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6f91e-b619-4070-bf04-a9f6ea992dff admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:52.579656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6f91e-b619-4070-bf04-a9f6ea992dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:52.580006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf6f91e-b619-4070-bf04-a9f6ea992dff admin admin] PATH_INFO: `/v3/projects/7c5c954ff86849d3ab98a633c659e550/users/8d5ff4b5ad974c349dad363503448460/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:52.582256 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6f91e-b619-4070-bf04-a9f6ea992dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c5c954ff86849d3ab98a633c659e550, user_id=8d5ff4b5ad974c349dad363503448460, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:52.585528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf6f91e-b619-4070-bf04-a9f6ea992dff admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:52.624628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 883/1756] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:52 2022] PUT /identity/v3/projects/7c5c954ff86849d3ab98a633c659e550/users/8d5ff4b5ad974c349dad363503448460/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:52.627915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f89e7a-a441-4914-9eb4-e33c8e5b262e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:52.628899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f89e7a-a441-4914-9eb4-e33c8e5b262e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:52.629762 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f89e7a-a441-4914-9eb4-e33c8e5b262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:52.707264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-45f89e7a-a441-4914-9eb4-e33c8e5b262e None None] MFA Rules not processed for user `8d5ff4b5ad974c349dad363503448460`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:52.708905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-45f89e7a-a441-4914-9eb4-e33c8e5b262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:52.724200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47786656a68429cac1e8ad596800d0c', 'request_id': 'req-e1f689c6-7ba5-446b-b942-cc53446fc870'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:52.738701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47786656a68429cac1e8ad596800d0c', 'request_id': 'req-e1f689c6-7ba5-446b-b942-cc53446fc870'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:52.837197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 884/1757] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:52.849564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47786656a68429cac1e8ad596800d0c', 'request_id': 'req-e1f689c6-7ba5-446b-b942-cc53446fc870'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:52.861871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f89e7a-a441-4914-9eb4-e33c8e5b262e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:52.867743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-45f89e7a-a441-4914-9eb4-e33c8e5b262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:52.887078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] The token cache is being invalidate because project a47786656a68429cac1e8ad596800d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:52.888403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:52.890525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e1f689c6-7ba5-446b-b942-cc53446fc870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:52.909063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 874/1758] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:52 2022] DELETE /identity/v3/projects/a47786656a68429cac1e8ad596800d0c => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:52.914638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184cb5-0eaf-4f02-bbb0-2dd80831e4f0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:52.915169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184cb5-0eaf-4f02-bbb0-2dd80831e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:52.915588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73184cb5-0eaf-4f02-bbb0-2dd80831e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:52.959809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-73184cb5-0eaf-4f02-bbb0-2dd80831e4f0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:52.961094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-73184cb5-0eaf-4f02-bbb0-2dd80831e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:53.057866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f89e7a-a441-4914-9eb4-e33c8e5b262e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:53.079618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f750df7-9b84-45f2-b484-209285e56af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:53.082962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750df7-9b84-45f2-b484-209285e56af5 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:53.084640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750df7-9b84-45f2-b484-209285e56af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:53.085390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f750df7-9b84-45f2-b484-209285e56af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:53.092993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1f750df7-9b84-45f2-b484-209285e56af5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:53.132788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 875/1759] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:53.140221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a797b-628f-4aa2-9d96-edc49eb0cb39 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:53.140572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a797b-628f-4aa2-9d96-edc49eb0cb39 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:53.140836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a797b-628f-4aa2-9d96-edc49eb0cb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:53.151069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f750df7-9b84-45f2-b484-209285e56af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:53.154396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f750df7-9b84-45f2-b484-209285e56af5 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:53.181703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 885/1760] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:52 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:53.184419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4c5d-c398-4eeb-baad-b3b0a732d926 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:53.184419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4c5d-c398-4eeb-baad-b3b0a732d926 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:53.184798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4c5d-c398-4eeb-baad-b3b0a732d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:53.226876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-598f4c5d-c398-4eeb-baad-b3b0a732d926 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:53.230154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-598f4c5d-c398-4eeb-baad-b3b0a732d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:53.257424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 886/1761] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:53.271178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4c5d-c398-4eeb-baad-b3b0a732d926 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:53.283562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-485a797b-628f-4aa2-9d96-edc49eb0cb39 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:53.285500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-485a797b-628f-4aa2-9d96-edc49eb0cb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:53.316259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4c5d-c398-4eeb-baad-b3b0a732d926 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:53.332159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075b32f-180b-43ea-bab9-c7aa827b62bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:53.336364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b32f-180b-43ea-bab9-c7aa827b62bc admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:53.337158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b32f-180b-43ea-bab9-c7aa827b62bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:53.345308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b32f-180b-43ea-bab9-c7aa827b62bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:53.346821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075b32f-180b-43ea-bab9-c7aa827b62bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:50:53.348387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075b32f-180b-43ea-bab9-c7aa827b62bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:53.351422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075b32f-180b-43ea-bab9-c7aa827b62bc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:53.378532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 887/1762] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:50:53.379859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075b32f-180b-43ea-bab9-c7aa827b62bc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:53.410419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075b32f-180b-43ea-bab9-c7aa827b62bc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:53.419059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93955dfb-2965-4cdc-a7a8-84f1d61950fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:53.422501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93955dfb-2965-4cdc-a7a8-84f1d61950fa admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:53.422905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93955dfb-2965-4cdc-a7a8-84f1d61950fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:53.423318 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93955dfb-2965-4cdc-a7a8-84f1d61950fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:53.424328 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93955dfb-2965-4cdc-a7a8-84f1d61950fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:53.426470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93955dfb-2965-4cdc-a7a8-84f1d61950fa admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:53.562928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 876/1763] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:53.567474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a797b-628f-4aa2-9d96-edc49eb0cb39 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:53.570802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-485a797b-628f-4aa2-9d96-edc49eb0cb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:53.593978 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a797b-628f-4aa2-9d96-edc49eb0cb39 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:53.598699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:53.599341 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:53.599617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:53.599887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] PATH_INFO: `/v3/users/fd76f4bc5d5a459fa6a8edcf18b93467` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:53.601153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd76f4bc5d5a459fa6a8edcf18b93467)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:53.603064 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:53.651608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 888/1764] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:53 2022] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:53.652742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93955dfb-2965-4cdc-a7a8-84f1d61950fa admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:53.778011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93955dfb-2965-4cdc-a7a8-84f1d61950fa admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:53.783179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d30dc-0c08-4667-8040-cd5aad0b96c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:53.785725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d30dc-0c08-4667-8040-cd5aad0b96c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:53.785725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d30dc-0c08-4667-8040-cd5aad0b96c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:53.785725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d30dc-0c08-4667-8040-cd5aad0b96c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:53.786088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d30dc-0c08-4667-8040-cd5aad0b96c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:53.790511 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d30dc-0c08-4667-8040-cd5aad0b96c0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:53.879435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:53.995346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 889/1765] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:53 2022] POST /identity/v3/users => generated 292 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:53.995346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d30dc-0c08-4667-8040-cd5aad0b96c0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:53.995346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ec1d30dc-0c08-4667-8040-cd5aad0b96c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:54.025703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d30dc-0c08-4667-8040-cd5aad0b96c0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:54.037072 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:54.038014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:54.038538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:54.039361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] PATH_INFO: `/v3/projects/d26426947c184c1caab4ecc228e86345` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:54.042437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26426947c184c1caab4ecc228e86345)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:54.048049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd76f4bc5d5a459fa6a8edcf18b93467'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:54.053694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:54.057829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd76f4bc5d5a459fa6a8edcf18b93467'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:54.058819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd76f4bc5d5a459fa6a8edcf18b93467'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:54.175326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd76f4bc5d5a459fa6a8edcf18b93467'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:54.201620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd76f4bc5d5a459fa6a8edcf18b93467'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:54.215104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 877/1766] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:53 2022] DELETE /identity/v3/users/fd76f4bc5d5a459fa6a8edcf18b93467 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:54.216357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:54.219682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:54.326818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121128b9-426f-4ba6-804b-9501064e138c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:54.332198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5765d6-ba0c-4dad-88c7-a88df8cf09dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:54.332885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5765d6-ba0c-4dad-88c7-a88df8cf09dd admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:54.333166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5765d6-ba0c-4dad-88c7-a88df8cf09dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:54.333441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5765d6-ba0c-4dad-88c7-a88df8cf09dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:54.334090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5765d6-ba0c-4dad-88c7-a88df8cf09dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:54.335913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5765d6-ba0c-4dad-88c7-a88df8cf09dd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:54.380113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 878/1767] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:54.383075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5765d6-ba0c-4dad-88c7-a88df8cf09dd admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:54.392311 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6f5765d6-ba0c-4dad-88c7-a88df8cf09dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:54.404131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26426947c184c1caab4ecc228e86345', 'request_id': 'req-8f50cae2-55d7-46cf-9252-728756cfff63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:54.421568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26426947c184c1caab4ecc228e86345', 'request_id': 'req-8f50cae2-55d7-46cf-9252-728756cfff63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:54.525006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26426947c184c1caab4ecc228e86345', 'request_id': 'req-8f50cae2-55d7-46cf-9252-728756cfff63'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:54.545293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] The token cache is being invalidate because project d26426947c184c1caab4ecc228e86345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:54.546231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:54.546948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8f50cae2-55d7-46cf-9252-728756cfff63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:54.548807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 890/1768] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:53 2022] DELETE /identity/v3/projects/d26426947c184c1caab4ecc228e86345 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:54.550123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832cf0c-43a8-4055-b214-fa97102bbb06 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:54.550404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832cf0c-43a8-4055-b214-fa97102bbb06 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:54.550673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4832cf0c-43a8-4055-b214-fa97102bbb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:54.581758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4832cf0c-43a8-4055-b214-fa97102bbb06 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:54.584850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4832cf0c-43a8-4055-b214-fa97102bbb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:54.602943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5765d6-ba0c-4dad-88c7-a88df8cf09dd admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:54.728791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deb3ec-9a7f-4832-ad0e-0796f4800909 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:54.729865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deb3ec-9a7f-4832-ad0e-0796f4800909 service swift] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:54.730380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deb3ec-9a7f-4832-ad0e-0796f4800909 service swift] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:54.730714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00deb3ec-9a7f-4832-ad0e-0796f4800909 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:54.734587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-00deb3ec-9a7f-4832-ad0e-0796f4800909 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:54.736830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 891/1769] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:54.746554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832cf0c-43a8-4055-b214-fa97102bbb06 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:54.746554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4832cf0c-43a8-4055-b214-fa97102bbb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:54.753538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4832cf0c-43a8-4055-b214-fa97102bbb06 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:54.761789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf643264-8609-4cf9-b0de-b03bd6d4cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:54.762248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf643264-8609-4cf9-b0de-b03bd6d4cbbd admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:54.762754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf643264-8609-4cf9-b0de-b03bd6d4cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:54.762754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf643264-8609-4cf9-b0de-b03bd6d4cbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:54.763434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf643264-8609-4cf9-b0de-b03bd6d4cbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:54.765133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf643264-8609-4cf9-b0de-b03bd6d4cbbd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:54.783352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 892/1770] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:54.783352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf643264-8609-4cf9-b0de-b03bd6d4cbbd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:54.786886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cf643264-8609-4cf9-b0de-b03bd6d4cbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:54.809688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf643264-8609-4cf9-b0de-b03bd6d4cbbd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:54.828355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:54.830895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:54.831444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:54.831938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] PATH_INFO: `/v3/users/5359fe9c72b34fa196902dcd28eafe65` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:54.834533 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5359fe9c72b34fa196902dcd28eafe65)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:54.838551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:54.904466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:54.920471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00deb3ec-9a7f-4832-ad0e-0796f4800909 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:54.935108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00deb3ec-9a7f-4832-ad0e-0796f4800909 service swift] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:54.959115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 879/1771] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:50:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:50:54.962974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deb3ec-9a7f-4832-ad0e-0796f4800909 service swift] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:54.963855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-00deb3ec-9a7f-4832-ad0e-0796f4800909 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:55.123632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00deb3ec-9a7f-4832-ad0e-0796f4800909 service swift] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:55.161494 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb914392-dbff-4dc8-a619-15f496e0d296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:55.162387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb914392-dbff-4dc8-a619-15f496e0d296 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:55.162387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb914392-dbff-4dc8-a619-15f496e0d296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:55.162634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb914392-dbff-4dc8-a619-15f496e0d296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:55.197215 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb914392-dbff-4dc8-a619-15f496e0d296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:55.197912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5359fe9c72b34fa196902dcd28eafe65'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:55.198888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb914392-dbff-4dc8-a619-15f496e0d296 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:55.230319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5359fe9c72b34fa196902dcd28eafe65'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:55.239928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5359fe9c72b34fa196902dcd28eafe65'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:55.251839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 880/1772] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:55.254774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb914392-dbff-4dc8-a619-15f496e0d296 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:55.277222 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb914392-dbff-4dc8-a619-15f496e0d296 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:55.284696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d783e0-e520-404a-835b-75082868cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:55.285370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d783e0-e520-404a-835b-75082868cc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:55.285531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d783e0-e520-404a-835b-75082868cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:55.285899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d783e0-e520-404a-835b-75082868cc5b admin admin] PATH_INFO: `/v3/projects/a14e519e5f684d45a27c74abcd62dc98/users/8bb72f48c8fc466d97ef102a077dff64/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:55.332032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d783e0-e520-404a-835b-75082868cc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14e519e5f684d45a27c74abcd62dc98, user_id=8bb72f48c8fc466d97ef102a077dff64, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:55.343878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d783e0-e520-404a-835b-75082868cc5b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:55.364210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5359fe9c72b34fa196902dcd28eafe65'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:55.365374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6d911694-95fe-4ef6-8650-0753b2435672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5359fe9c72b34fa196902dcd28eafe65'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:55.432902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 893/1773] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:54 2022] DELETE /identity/v3/users/5359fe9c72b34fa196902dcd28eafe65 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:55.435337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92995345-99a4-4df7-892c-e0ba8f40631b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:55.435810 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92995345-99a4-4df7-892c-e0ba8f40631b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:55.436346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92995345-99a4-4df7-892c-e0ba8f40631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:55.491336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 881/1774] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:55 2022] PUT /identity/v3/projects/a14e519e5f684d45a27c74abcd62dc98/users/8bb72f48c8fc466d97ef102a077dff64/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:55.498687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b30fe-6807-4f0a-b698-19d0d9f8510a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:55.498687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b30fe-6807-4f0a-b698-19d0d9f8510a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:55.498687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b30fe-6807-4f0a-b698-19d0d9f8510a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:55.560062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-92995345-99a4-4df7-892c-e0ba8f40631b None None] MFA Rules not processed for user `2adcc3ba3bdf4b92bd719f60e0b263ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:55.566702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-92995345-99a4-4df7-892c-e0ba8f40631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:55.617521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b22b30fe-6807-4f0a-b698-19d0d9f8510a None None] MFA Rules not processed for user `887ed8602e2a4af4a63ab20d170b7dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:55.618926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b22b30fe-6807-4f0a-b698-19d0d9f8510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:55.687902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 894/1775] 10.222.0.121 () {58 vars in 1016 bytes} [Mon Aug 29 21:50:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:55.689521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2467331-ea9d-4431-9dde-429c0f3a49d4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:55.701030 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2467331-ea9d-4431-9dde-429c0f3a49d4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:55.701563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2467331-ea9d-4431-9dde-429c0f3a49d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:55.804896 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a2467331-ea9d-4431-9dde-429c0f3a49d4 None None] MFA Rules not processed for user `8bb72f48c8fc466d97ef102a077dff64`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:55.810213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a2467331-ea9d-4431-9dde-429c0f3a49d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:55.812401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 882/1776] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:55 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:55.826037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b30fe-6807-4f0a-b698-19d0d9f8510a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:55.830420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b22b30fe-6807-4f0a-b698-19d0d9f8510a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:55.894725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b30fe-6807-4f0a-b698-19d0d9f8510a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:55.912539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d315e-1f34-4cb0-a6ae-de89ed9abd63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:55.914923 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d315e-1f34-4cb0-a6ae-de89ed9abd63 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:55.917142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d315e-1f34-4cb0-a6ae-de89ed9abd63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:55.917493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d315e-1f34-4cb0-a6ae-de89ed9abd63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:55.938818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d315e-1f34-4cb0-a6ae-de89ed9abd63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:55.940391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d315e-1f34-4cb0-a6ae-de89ed9abd63 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:55.967742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 883/1777] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:56.022281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 895/1778] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:56.027396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d315e-1f34-4cb0-a6ae-de89ed9abd63 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:56.029245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-450d315e-1f34-4cb0-a6ae-de89ed9abd63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:56.214995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d315e-1f34-4cb0-a6ae-de89ed9abd63 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:56.220221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2c0d4-55a6-47ef-b6ab-a3b660ae0e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:56.221012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2c0d4-55a6-47ef-b6ab-a3b660ae0e33 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:56.221359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2c0d4-55a6-47ef-b6ab-a3b660ae0e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:56.221704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2c0d4-55a6-47ef-b6ab-a3b660ae0e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:56.222476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2c0d4-55a6-47ef-b6ab-a3b660ae0e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:56.224527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2c0d4-55a6-47ef-b6ab-a3b660ae0e33 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:56.699277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:56.907403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 884/1779] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:50:56 2022] POST /identity/v3/projects => generated 381 bytes in 872 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:56.908450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2467331-ea9d-4431-9dde-429c0f3a49d4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:56.943046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2467331-ea9d-4431-9dde-429c0f3a49d4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:57.092917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f65145-3553-4a03-9e1d-3c90ad6dcc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:57.093996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f65145-3553-4a03-9e1d-3c90ad6dcc8b admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:57.094631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f65145-3553-4a03-9e1d-3c90ad6dcc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:57.095126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f65145-3553-4a03-9e1d-3c90ad6dcc8b admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:57.096103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f65145-3553-4a03-9e1d-3c90ad6dcc8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:57.098912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f65145-3553-4a03-9e1d-3c90ad6dcc8b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:57.493842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 896/1780] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:50:56 2022] POST /identity/v3/users => generated 297 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:50:57.495636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2c0d4-55a6-47ef-b6ab-a3b660ae0e33 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:57.550625 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2c0d4-55a6-47ef-b6ab-a3b660ae0e33 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:57.559594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d7d29-6f37-455d-a213-4faf82312e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:57.560925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7d29-6f37-455d-a213-4faf82312e4c admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:57.561934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7d29-6f37-455d-a213-4faf82312e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:57.562423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7d29-6f37-455d-a213-4faf82312e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:57.563778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d7d29-6f37-455d-a213-4faf82312e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:57.567080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d7d29-6f37-455d-a213-4faf82312e4c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:57.598362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 885/1781] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:57.606491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f65145-3553-4a03-9e1d-3c90ad6dcc8b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:57.621175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f65145-3553-4a03-9e1d-3c90ad6dcc8b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:57.630984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fda6a-8977-4044-8ce3-4e7a923bbbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:57.640000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fda6a-8977-4044-8ce3-4e7a923bbbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:57.640000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fda6a-8977-4044-8ce3-4e7a923bbbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:57.640000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fda6a-8977-4044-8ce3-4e7a923bbbc6 admin admin] PATH_INFO: `/v3/projects/55cecd1346bb43468bdbed7a8b23105d/users/c712a9666cc94b14833f7abe212962b4/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:57.674526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fda6a-8977-4044-8ce3-4e7a923bbbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cecd1346bb43468bdbed7a8b23105d, user_id=c712a9666cc94b14833f7abe212962b4, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:57.678091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fda6a-8977-4044-8ce3-4e7a923bbbc6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:57.855841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 897/1782] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:57 2022] PUT /identity/v3/projects/55cecd1346bb43468bdbed7a8b23105d/users/c712a9666cc94b14833f7abe212962b4/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:57.871232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d7d29-6f37-455d-a213-4faf82312e4c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:57.882571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d7d29-6f37-455d-a213-4faf82312e4c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:57.994151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a302e-21a7-47d8-9a1e-ca13429fab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:57.995500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a302e-21a7-47d8-9a1e-ca13429fab15 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:57.996021 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a302e-21a7-47d8-9a1e-ca13429fab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:57.996454 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a302e-21a7-47d8-9a1e-ca13429fab15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:57.997586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a302e-21a7-47d8-9a1e-ca13429fab15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:58.000029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a302e-21a7-47d8-9a1e-ca13429fab15 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:58.021612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 886/1783] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:50:58.027828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fda6a-8977-4044-8ce3-4e7a923bbbc6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:58.068815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fda6a-8977-4044-8ce3-4e7a923bbbc6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:58.089691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998a93a-5280-49ea-ae2e-b605899b4240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:58.090634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998a93a-5280-49ea-ae2e-b605899b4240 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:58.091026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998a93a-5280-49ea-ae2e-b605899b4240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:58.091554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998a93a-5280-49ea-ae2e-b605899b4240 admin admin] PATH_INFO: `/v3/projects/55cecd1346bb43468bdbed7a8b23105d/users/c712a9666cc94b14833f7abe212962b4/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:58.096363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998a93a-5280-49ea-ae2e-b605899b4240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cecd1346bb43468bdbed7a8b23105d, user_id=c712a9666cc94b14833f7abe212962b4, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:58.100677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998a93a-5280-49ea-ae2e-b605899b4240 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:58.131674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 898/1784] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:50:58 2022] PUT /identity/v3/projects/55cecd1346bb43468bdbed7a8b23105d/users/c712a9666cc94b14833f7abe212962b4/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:50:58.143134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce0047-ad90-4651-b51b-5500978afc0f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:58.146313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce0047-ad90-4651-b51b-5500978afc0f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:58.146313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce0047-ad90-4651-b51b-5500978afc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:58.209082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c3ce0047-ad90-4651-b51b-5500978afc0f None None] MFA Rules not processed for user `c712a9666cc94b14833f7abe212962b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:58.211272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c3ce0047-ad90-4651-b51b-5500978afc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:58.336382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998a93a-5280-49ea-ae2e-b605899b4240 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:58.343908 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4998a93a-5280-49ea-ae2e-b605899b4240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:58.344271 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 887/1785] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:50:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:58.387118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce0047-ad90-4651-b51b-5500978afc0f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:58.390038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c3ce0047-ad90-4651-b51b-5500978afc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:58.563246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce0047-ad90-4651-b51b-5500978afc0f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:58.578374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658029a-e53a-4ac1-bb6d-4863ff5adb6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:58.578374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658029a-e53a-4ac1-bb6d-4863ff5adb6b service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:58.578374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658029a-e53a-4ac1-bb6d-4863ff5adb6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:58.579342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658029a-e53a-4ac1-bb6d-4863ff5adb6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:58.579496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998a93a-5280-49ea-ae2e-b605899b4240 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:58.584941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:58.585767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:58.585931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:58.586309 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] PATH_INFO: `/v3/projects/f41af7dea7814b5787e88a35adadb5c2` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:58.587482 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41af7dea7814b5787e88a35adadb5c2)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:58.590897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:58.614651 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658029a-e53a-4ac1-bb6d-4863ff5adb6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:58.617725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658029a-e53a-4ac1-bb6d-4863ff5adb6b service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:58.664464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 888/1786] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:50:58.786148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41af7dea7814b5787e88a35adadb5c2', 'request_id': 'req-4e962785-21ae-40a1-bfe0-0c997885d180'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:58.807918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41af7dea7814b5787e88a35adadb5c2', 'request_id': 'req-4e962785-21ae-40a1-bfe0-0c997885d180'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:58.856982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35903d-5fb3-452c-8d0c-81d4715a2e2d None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:58.857350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35903d-5fb3-452c-8d0c-81d4715a2e2d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:58.857622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35903d-5fb3-452c-8d0c-81d4715a2e2d None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:58.860147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 889/1787] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:50:58.911057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35903d-5fb3-452c-8d0c-81d4715a2e2d None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:58.947091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41af7dea7814b5787e88a35adadb5c2', 'request_id': 'req-4e962785-21ae-40a1-bfe0-0c997885d180'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:58.982283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] The token cache is being invalidate because project f41af7dea7814b5787e88a35adadb5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:50:58.991555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:58.993712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4e962785-21ae-40a1-bfe0-0c997885d180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:58.997764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 899/1788] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:58 2022] DELETE /identity/v3/projects/f41af7dea7814b5787e88a35adadb5c2 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:50:58.999780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32184c9e-950a-4efa-a43e-33fd7013e197 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:58.999780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32184c9e-950a-4efa-a43e-33fd7013e197 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:58.999780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32184c9e-950a-4efa-a43e-33fd7013e197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:59.046002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-32184c9e-950a-4efa-a43e-33fd7013e197 None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:50:59.048257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-32184c9e-950a-4efa-a43e-33fd7013e197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:59.115628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e35903d-5fb3-452c-8d0c-81d4715a2e2d None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:59.129353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff97fb3-761f-4944-b806-450c70b19892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:59.130331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff97fb3-761f-4944-b806-450c70b19892 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:59.130765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff97fb3-761f-4944-b806-450c70b19892 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:59.131193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff97fb3-761f-4944-b806-450c70b19892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:59.133921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-eff97fb3-761f-4944-b806-450c70b19892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:59.270126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 900/1789] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:50:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:50:59.276607 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32184c9e-950a-4efa-a43e-33fd7013e197 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:59.284853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-32184c9e-950a-4efa-a43e-33fd7013e197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:59.347337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff97fb3-761f-4944-b806-450c70b19892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:59.351703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff97fb3-761f-4944-b806-450c70b19892 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:59.404544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 890/1790] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:50:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:50:59.404544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab50e-c2df-4340-a6c2-cfbc577c4b70 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:59.404544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab50e-c2df-4340-a6c2-cfbc577c4b70 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:59.404544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbab50e-c2df-4340-a6c2-cfbc577c4b70 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:59.411711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 891/1791] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:50:59 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:50:59.415567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbab50e-c2df-4340-a6c2-cfbc577c4b70 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:50:59.423268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fdbab50e-c2df-4340-a6c2-cfbc577c4b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:50:59.544561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:59.589832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:50:59.614230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32184c9e-950a-4efa-a43e-33fd7013e197 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:59.621339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:59.621339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:59.622001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:59.622983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] PATH_INFO: `/v3/users/8d5ff4b5ad974c349dad363503448460` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:59.624928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5ff4b5ad974c349dad363503448460)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:59.630541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:59.663281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbab50e-c2df-4340-a6c2-cfbc577c4b70 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:50:59.680739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:50:59.681410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:50:59.681727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:50:59.682778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] PATH_INFO: `/v3/projects/537f09703ef744ffb033da7ebb0e95ba` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:50:59.685243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537f09703ef744ffb033da7ebb0e95ba)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:50:59.692427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:50:59.903135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5ff4b5ad974c349dad363503448460'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:59.937014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5ff4b5ad974c349dad363503448460'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:50:59.939989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5ff4b5ad974c349dad363503448460'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.126946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5ff4b5ad974c349dad363503448460'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.128643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5d4ab993-8f5c-48b4-9dfd-f766c4c0aeab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5ff4b5ad974c349dad363503448460'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.177866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537f09703ef744ffb033da7ebb0e95ba', 'request_id': 'req-6f2b2ff0-e852-4198-b669-eec95995ea90'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.180627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 901/1792] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:50:59 2022] DELETE /identity/v3/users/8d5ff4b5ad974c349dad363503448460 => generated 0 bytes in 909 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:00.183221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739783-bcc4-4c20-ae6b-162376dcf958 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:00.185551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739783-bcc4-4c20-ae6b-162376dcf958 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:00.186767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90739783-bcc4-4c20-ae6b-162376dcf958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:00.193108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537f09703ef744ffb033da7ebb0e95ba', 'request_id': 'req-6f2b2ff0-e852-4198-b669-eec95995ea90'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.223788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-90739783-bcc4-4c20-ae6b-162376dcf958 None None] MFA Rules not processed for user `dca09f6fe11f4b878dd11c4cb69ca7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:00.227020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-90739783-bcc4-4c20-ae6b-162376dcf958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:00.415942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537f09703ef744ffb033da7ebb0e95ba', 'request_id': 'req-6f2b2ff0-e852-4198-b669-eec95995ea90'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.432281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 902/1793] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:51:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:00.442817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] The token cache is being invalidate because project 537f09703ef744ffb033da7ebb0e95ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:00.443192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90739783-bcc4-4c20-ae6b-162376dcf958 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:00.444005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.445304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-90739783-bcc4-4c20-ae6b-162376dcf958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:00.449459 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6f2b2ff0-e852-4198-b669-eec95995ea90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:00.451504 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 892/1794] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:50:59 2022] DELETE /identity/v3/projects/537f09703ef744ffb033da7ebb0e95ba => generated 0 bytes in 1036 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:00.459725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047bc22-163a-46c8-8994-cd74c5c15abf None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:00.462708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047bc22-163a-46c8-8994-cd74c5c15abf None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:00.462708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047bc22-163a-46c8-8994-cd74c5c15abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:00.544603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-2047bc22-163a-46c8-8994-cd74c5c15abf None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:00.544603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2047bc22-163a-46c8-8994-cd74c5c15abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:00.708736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90739783-bcc4-4c20-ae6b-162376dcf958 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:00.725011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c3fe9-7ad9-486e-9cb9-c2b6302d522a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:00.725648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3fe9-7ad9-486e-9cb9-c2b6302d522a service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:00.725923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3fe9-7ad9-486e-9cb9-c2b6302d522a service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:00.726220 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c3fe9-7ad9-486e-9cb9-c2b6302d522a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:00.732105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bd7c3fe9-7ad9-486e-9cb9-c2b6302d522a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:00.739827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 893/1795] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:00.740715 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047bc22-163a-46c8-8994-cd74c5c15abf None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:00.754715 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2047bc22-163a-46c8-8994-cd74c5c15abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:00.783026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c3fe9-7ad9-486e-9cb9-c2b6302d522a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:00.790555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c3fe9-7ad9-486e-9cb9-c2b6302d522a service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:00.814770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047bc22-163a-46c8-8994-cd74c5c15abf None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:00.829145 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 903/1796] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:00.830784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb016a-e830-48cb-86d3-4fc33d57a62a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:00.831289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb016a-e830-48cb-86d3-4fc33d57a62a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:00.831785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb016a-e830-48cb-86d3-4fc33d57a62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:00.842844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb84525-ae9a-4346-bd5f-4e60dd53eb14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca09f6fe11f4b878dd11c4cb69ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:00.843594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb84525-ae9a-4346-bd5f-4e60dd53eb14 service placement] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:00.843875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb84525-ae9a-4346-bd5f-4e60dd53eb14 service placement] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:00.844145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb84525-ae9a-4346-bd5f-4e60dd53eb14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:00.849368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bdb84525-ae9a-4346-bd5f-4e60dd53eb14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:00.897353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1efb016a-e830-48cb-86d3-4fc33d57a62a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:00.899790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1efb016a-e830-48cb-86d3-4fc33d57a62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:00.911890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb84525-ae9a-4346-bd5f-4e60dd53eb14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:00.911890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb84525-ae9a-4346-bd5f-4e60dd53eb14 service placement] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:00.952223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 904/1797] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:00.953414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb016a-e830-48cb-86d3-4fc33d57a62a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:00.953739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 894/1798] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:00.986616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb016a-e830-48cb-86d3-4fc33d57a62a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:01.009803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7391f7a-dcc0-46f0-b866-ed9496c72545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:01.009803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7391f7a-dcc0-46f0-b866-ed9496c72545 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:01.009803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7391f7a-dcc0-46f0-b866-ed9496c72545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:01.009803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7391f7a-dcc0-46f0-b866-ed9496c72545 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:01.010464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7391f7a-dcc0-46f0-b866-ed9496c72545 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:01.010464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7391f7a-dcc0-46f0-b866-ed9496c72545 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:01.016142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7391f7a-dcc0-46f0-b866-ed9496c72545 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:01.061443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 905/1799] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:51:01.074514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb84525-ae9a-4346-bd5f-4e60dd53eb14 service placement] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:01.111966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb84525-ae9a-4346-bd5f-4e60dd53eb14 service placement] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:01.115926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ed790-8b64-471b-aa33-b5884c804671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:01.117146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ed790-8b64-471b-aa33-b5884c804671 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:01.117619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ed790-8b64-471b-aa33-b5884c804671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:01.118022 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ed790-8b64-471b-aa33-b5884c804671 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:01.119931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ed790-8b64-471b-aa33-b5884c804671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:01.140321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ed790-8b64-471b-aa33-b5884c804671 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:01.268246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 895/1800] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:01 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:01.288767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7391f7a-dcc0-46f0-b866-ed9496c72545 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:01.310312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7391f7a-dcc0-46f0-b866-ed9496c72545 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:01.486858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb2dde-d009-4d19-9dc6-7ce9f8b41340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:01.487692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2dde-d009-4d19-9dc6-7ce9f8b41340 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:01.495109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2dde-d009-4d19-9dc6-7ce9f8b41340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:01.495438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb2dde-d009-4d19-9dc6-7ce9f8b41340 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:01.500644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb2dde-d009-4d19-9dc6-7ce9f8b41340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:01.500644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb2dde-d009-4d19-9dc6-7ce9f8b41340 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:01.712255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 906/1801] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:01 2022] POST /identity/v3/users => generated 287 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:01.718578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ed790-8b64-471b-aa33-b5884c804671 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:01.776821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ed790-8b64-471b-aa33-b5884c804671 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:01.798094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a73d8-226d-488b-8a5a-3d02a9a6125c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:01.799083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a73d8-226d-488b-8a5a-3d02a9a6125c admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:01.799581 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a73d8-226d-488b-8a5a-3d02a9a6125c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:01.800062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a73d8-226d-488b-8a5a-3d02a9a6125c admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:01.801334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a73d8-226d-488b-8a5a-3d02a9a6125c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:01.818748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a73d8-226d-488b-8a5a-3d02a9a6125c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:01.829407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 896/1802] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:01.833792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb2dde-d009-4d19-9dc6-7ce9f8b41340 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:01.848629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb2dde-d009-4d19-9dc6-7ce9f8b41340 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:01.864119 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62dfea-84df-4606-a156-86ad560f4e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:01.865773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62dfea-84df-4606-a156-86ad560f4e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:01.865773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62dfea-84df-4606-a156-86ad560f4e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:01.865773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62dfea-84df-4606-a156-86ad560f4e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:01.866485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62dfea-84df-4606-a156-86ad560f4e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:01.871335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62dfea-84df-4606-a156-86ad560f4e7f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:01.903249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 907/1803] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:01.904309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a73d8-226d-488b-8a5a-3d02a9a6125c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:01.928253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a73d8-226d-488b-8a5a-3d02a9a6125c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:01.934575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064c4fa-b07e-4773-a2b6-4ffc06e8d1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:01.935326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064c4fa-b07e-4773-a2b6-4ffc06e8d1ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:01.935612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064c4fa-b07e-4773-a2b6-4ffc06e8d1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:01.935919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064c4fa-b07e-4773-a2b6-4ffc06e8d1ad admin admin] PATH_INFO: `/v3/projects/91575ac1354247dca14aff7bbfe5d111/users/ad1787af22c94bc8a3599abf7e8fbe39/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:01.976616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:01.985756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064c4fa-b07e-4773-a2b6-4ffc06e8d1ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=91575ac1354247dca14aff7bbfe5d111, user_id=ad1787af22c94bc8a3599abf7e8fbe39, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:01.996740 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064c4fa-b07e-4773-a2b6-4ffc06e8d1ad admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:02.208914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 897/1804] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:01 2022] PUT /identity/v3/projects/91575ac1354247dca14aff7bbfe5d111/users/ad1787af22c94bc8a3599abf7e8fbe39/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:02.215033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f50991-3791-4f26-95b2-59535b3af689 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.215566 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f50991-3791-4f26-95b2-59535b3af689 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.215999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f50991-3791-4f26-95b2-59535b3af689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.293503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f5f50991-3791-4f26-95b2-59535b3af689 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:02.294826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f5f50991-3791-4f26-95b2-59535b3af689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:02.575986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 908/1805] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:02.719671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064c4fa-b07e-4773-a2b6-4ffc06e8d1ad admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:02.722873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a064c4fa-b07e-4773-a2b6-4ffc06e8d1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:02.918652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064c4fa-b07e-4773-a2b6-4ffc06e8d1ad admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:02.928024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adb7ab-a2f9-4a86-b24b-bea09a74010c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:02.931743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adb7ab-a2f9-4a86-b24b-bea09a74010c service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:02.932740 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adb7ab-a2f9-4a86-b24b-bea09a74010c service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:02.933476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adb7ab-a2f9-4a86-b24b-bea09a74010c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:02.956903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adb7ab-a2f9-4a86-b24b-bea09a74010c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:02.960272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adb7ab-a2f9-4a86-b24b-bea09a74010c service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:02.980334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 898/1806] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:03.583312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f50991-3791-4f26-95b2-59535b3af689 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:03.584927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f5f50991-3791-4f26-95b2-59535b3af689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:03.600852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f50991-3791-4f26-95b2-59535b3af689 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:03.624392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:03.625109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:03.625478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:03.625971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] PATH_INFO: `/v3/users/32dc5057e1ae419f85adf21ae784d5c0` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:03.627566 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32dc5057e1ae419f85adf21ae784d5c0)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:03.632471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:03.683321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adb7ab-a2f9-4a86-b24b-bea09a74010c service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:03.684823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-23adb7ab-a2f9-4a86-b24b-bea09a74010c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:03.718216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adb7ab-a2f9-4a86-b24b-bea09a74010c service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:03.734933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:03.736687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:03.739627 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:03.740171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] PATH_INFO: `/v3/projects/7c5c954ff86849d3ab98a633c659e550` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:03.742223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c5c954ff86849d3ab98a633c659e550)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:03.745558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:03.885270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:03.947749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32dc5057e1ae419f85adf21ae784d5c0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:03.953649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c5c954ff86849d3ab98a633c659e550', 'request_id': 'req-c5ba18ea-3d25-435e-9578-faf0da06eddb'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:03.974910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32dc5057e1ae419f85adf21ae784d5c0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:03.975822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c5c954ff86849d3ab98a633c659e550', 'request_id': 'req-c5ba18ea-3d25-435e-9578-faf0da06eddb'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:03.977926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32dc5057e1ae419f85adf21ae784d5c0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.052314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:04.127569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c5c954ff86849d3ab98a633c659e550', 'request_id': 'req-c5ba18ea-3d25-435e-9578-faf0da06eddb'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.142365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] The token cache is being invalidate because project 7c5c954ff86849d3ab98a633c659e550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:04.143204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.144269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-c5ba18ea-3d25-435e-9578-faf0da06eddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.158327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 899/1807] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:03 2022] DELETE /identity/v3/projects/7c5c954ff86849d3ab98a633c659e550 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:04.164157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0490-beca-48bb-ac88-a136b9263e52 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:04.164840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0490-beca-48bb-ac88-a136b9263e52 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:04.165328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0490-beca-48bb-ac88-a136b9263e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:04.207467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-2f7e0490-beca-48bb-ac88-a136b9263e52 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:04.209340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2f7e0490-beca-48bb-ac88-a136b9263e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:04.255684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32dc5057e1ae419f85adf21ae784d5c0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.256798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-95891f7c-f669-43e0-833d-7657eb657db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32dc5057e1ae419f85adf21ae784d5c0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:04.321566 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 909/1808] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:03 2022] DELETE /identity/v3/users/32dc5057e1ae419f85adf21ae784d5c0 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:04.324587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 900/1809] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:04.332422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c530-335c-4ab5-b6e1-d621ef6d648d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:04.332422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c530-335c-4ab5-b6e1-d621ef6d648d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:04.352627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5c530-335c-4ab5-b6e1-d621ef6d648d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:04.379495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-16f5c530-335c-4ab5-b6e1-d621ef6d648d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:04.380893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-16f5c530-335c-4ab5-b6e1-d621ef6d648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:04.540272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0490-beca-48bb-ac88-a136b9263e52 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:04.542249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 910/1810] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:04.583728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5c530-335c-4ab5-b6e1-d621ef6d648d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:04.586246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-16f5c530-335c-4ab5-b6e1-d621ef6d648d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:04.591796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0490-beca-48bb-ac88-a136b9263e52 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:04.610827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5c530-335c-4ab5-b6e1-d621ef6d648d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:04.628071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:04.628071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:04.628071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:04.628071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] PATH_INFO: `/v3/users/8bb72f48c8fc466d97ef102a077dff64` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:04.637834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704431cd-cf68-49fc-bf01-fd3f91abd976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:04.637834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704431cd-cf68-49fc-bf01-fd3f91abd976 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:04.637834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704431cd-cf68-49fc-bf01-fd3f91abd976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:04.637834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704431cd-cf68-49fc-bf01-fd3f91abd976 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:04.638246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704431cd-cf68-49fc-bf01-fd3f91abd976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:04.638340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bb72f48c8fc466d97ef102a077dff64)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:04.638455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704431cd-cf68-49fc-bf01-fd3f91abd976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:04.638567 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:04.642097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704431cd-cf68-49fc-bf01-fd3f91abd976 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:04.682513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 901/1811] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:51:04.687728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704431cd-cf68-49fc-bf01-fd3f91abd976 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:04.717219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704431cd-cf68-49fc-bf01-fd3f91abd976 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:04.735151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169c2d6-30b4-4cc3-b17e-84be4d8d9fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:04.741275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169c2d6-30b4-4cc3-b17e-84be4d8d9fee admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:04.741275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169c2d6-30b4-4cc3-b17e-84be4d8d9fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:04.741275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169c2d6-30b4-4cc3-b17e-84be4d8d9fee admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:04.741275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169c2d6-30b4-4cc3-b17e-84be4d8d9fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:04.741275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b169c2d6-30b4-4cc3-b17e-84be4d8d9fee admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:04.904605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 902/1812] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:04 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:04.911123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278d1b2-551c-4832-aec9-0c8d14f763e1 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:04.914653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278d1b2-551c-4832-aec9-0c8d14f763e1 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:04.914653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278d1b2-551c-4832-aec9-0c8d14f763e1 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:04.914653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 903/1813] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 21:51:04.915223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278d1b2-551c-4832-aec9-0c8d14f763e1 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:05.068694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278d1b2-551c-4832-aec9-0c8d14f763e1 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:05.083245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d5914-e2ce-423a-8ce2-b697c46293b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:05.083903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d5914-e2ce-423a-8ce2-b697c46293b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:05.084252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d5914-e2ce-423a-8ce2-b697c46293b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:05.090228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d5914-e2ce-423a-8ce2-b697c46293b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:05.091452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d5914-e2ce-423a-8ce2-b697c46293b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:05.095390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d5914-e2ce-423a-8ce2-b697c46293b9 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:05.151857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bb72f48c8fc466d97ef102a077dff64'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.164997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bb72f48c8fc466d97ef102a077dff64'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.166190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bb72f48c8fc466d97ef102a077dff64'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.234882 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 904/1814] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:04 2022] POST /identity/v3/users => generated 287 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:05.237073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54dfc2-4c56-4db5-89fd-d27029338cd6 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:05.238148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54dfc2-4c56-4db5-89fd-d27029338cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:05.238372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54dfc2-4c56-4db5-89fd-d27029338cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:05.255538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bb72f48c8fc466d97ef102a077dff64'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.256608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bb72f48c8fc466d97ef102a077dff64'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.273852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-ce54dfc2-4c56-4db5-89fd-d27029338cd6 None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:05.275493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ce54dfc2-4c56-4db5-89fd-d27029338cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:05.304677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 911/1815] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:04 2022] DELETE /identity/v3/users/8bb72f48c8fc466d97ef102a077dff64 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:05.308175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:05.310051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:05.481925 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98f8eb-0556-4f6a-8948-7c57e55b73ce admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:05.488412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faed41-7bba-4bbf-94cd-c1f5c65761ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:05.489310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faed41-7bba-4bbf-94cd-c1f5c65761ee admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:05.489695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faed41-7bba-4bbf-94cd-c1f5c65761ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:05.490075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faed41-7bba-4bbf-94cd-c1f5c65761ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:05.490988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faed41-7bba-4bbf-94cd-c1f5c65761ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:05.493443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faed41-7bba-4bbf-94cd-c1f5c65761ee admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:05.495438 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 905/1816] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:51:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:05.497648 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54dfc2-4c56-4db5-89fd-d27029338cd6 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:05.500288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ce54dfc2-4c56-4db5-89fd-d27029338cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:05.513814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 912/1817] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:05.516090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07fc5-a60d-4fbc-89bf-4ab421c437fa None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:05.516622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07fc5-a60d-4fbc-89bf-4ab421c437fa None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:05.518190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07fc5-a60d-4fbc-89bf-4ab421c437fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:05.533046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54dfc2-4c56-4db5-89fd-d27029338cd6 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:05.546702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4be07fc5-a60d-4fbc-89bf-4ab421c437fa None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:05.549149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4be07fc5-a60d-4fbc-89bf-4ab421c437fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:05.559914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:05.561177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:05.561501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:05.561925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] PATH_INFO: `/v3/projects/1886e860f0324a30a9414b39aefd7e6a` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:05.563984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=1886e860f0324a30a9414b39aefd7e6a)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:05.565065 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 913/1818] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:05.566345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be07fc5-a60d-4fbc-89bf-4ab421c437fa None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:05.566827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:05.579892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be07fc5-a60d-4fbc-89bf-4ab421c437fa None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:05.587213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff78ce2-5194-44b4-8678-af3f2bd2ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:05.588351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff78ce2-5194-44b4-8678-af3f2bd2ba53 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:05.588351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff78ce2-5194-44b4-8678-af3f2bd2ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:05.589272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff78ce2-5194-44b4-8678-af3f2bd2ba53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:05.590342 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff78ce2-5194-44b4-8678-af3f2bd2ba53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:05.592391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff78ce2-5194-44b4-8678-af3f2bd2ba53 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:05.608374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 914/1819] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:05.618248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff78ce2-5194-44b4-8678-af3f2bd2ba53 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:05.618248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4ff78ce2-5194-44b4-8678-af3f2bd2ba53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:05.733476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff78ce2-5194-44b4-8678-af3f2bd2ba53 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:05.740649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7c7a8-a1bc-4b21-8461-ca8799d6de48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:05.741392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7c7a8-a1bc-4b21-8461-ca8799d6de48 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:05.741631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7c7a8-a1bc-4b21-8461-ca8799d6de48 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:05.741959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7c7a8-a1bc-4b21-8461-ca8799d6de48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:05.754004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7c7a8-a1bc-4b21-8461-ca8799d6de48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:05.755753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7c7a8-a1bc-4b21-8461-ca8799d6de48 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:05.771774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 915/1820] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:05.772616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7c7a8-a1bc-4b21-8461-ca8799d6de48 service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:05.774335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-89e7c7a8-a1bc-4b21-8461-ca8799d6de48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:05.805223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1886e860f0324a30a9414b39aefd7e6a', 'request_id': 'req-47678602-24f2-4bfc-8bfd-328b04797dac'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.815727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1886e860f0324a30a9414b39aefd7e6a', 'request_id': 'req-47678602-24f2-4bfc-8bfd-328b04797dac'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.921062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7c7a8-a1bc-4b21-8461-ca8799d6de48 service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:05.970493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1886e860f0324a30a9414b39aefd7e6a', 'request_id': 'req-47678602-24f2-4bfc-8bfd-328b04797dac'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.991217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] The token cache is being invalidate because project 1886e860f0324a30a9414b39aefd7e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:05.991217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.991217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:05.992988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 906/1821] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:05 2022] DELETE /identity/v3/projects/1886e860f0324a30a9414b39aefd7e6a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:05.993606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:05.995567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:06.145242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678602-24f2-4bfc-8bfd-328b04797dac admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:06.177354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fabcc-fd2d-45f3-a5bf-e7220744a3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:06.178000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fabcc-fd2d-45f3-a5bf-e7220744a3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:06.178279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fabcc-fd2d-45f3-a5bf-e7220744a3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:06.178552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fabcc-fd2d-45f3-a5bf-e7220744a3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:06.179027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ddbcdd-fc5a-41dd-aa94-89c26302cae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:06.179927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddbcdd-fc5a-41dd-aa94-89c26302cae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:06.180216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddbcdd-fc5a-41dd-aa94-89c26302cae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:06.180529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddbcdd-fc5a-41dd-aa94-89c26302cae7 admin admin] PATH_INFO: `/v3/projects/28ba31782d2e442a8048dd74cd8166f7/users/a712c28355c34c69b041652ea3526f18/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:06.185273 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dd4fabcc-fd2d-45f3-a5bf-e7220744a3d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:06.203931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddbcdd-fc5a-41dd-aa94-89c26302cae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ba31782d2e442a8048dd74cd8166f7, user_id=a712c28355c34c69b041652ea3526f18, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:06.208038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ddbcdd-fc5a-41dd-aa94-89c26302cae7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:06.231290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fabcc-fd2d-45f3-a5bf-e7220744a3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:06.236562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fabcc-fd2d-45f3-a5bf-e7220744a3d9 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:06.277287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 916/1822] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:06.282920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fabcc-fd2d-45f3-a5bf-e7220744a3d9 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:06.283748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dd4fabcc-fd2d-45f3-a5bf-e7220744a3d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:06.314124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fabcc-fd2d-45f3-a5bf-e7220744a3d9 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:06.327579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:06.328243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:06.334019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:06.334447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] PATH_INFO: `/v3/users/887ed8602e2a4af4a63ab20d170b7dc4` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:06.336985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=887ed8602e2a4af4a63ab20d170b7dc4)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:06.343516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:06.378285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 907/1823] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:05 2022] PUT /identity/v3/projects/28ba31782d2e442a8048dd74cd8166f7/users/a712c28355c34c69b041652ea3526f18/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:06.396694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b0107-0770-4d02-a31e-3222c54c557f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:06.397016 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b0107-0770-4d02-a31e-3222c54c557f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:06.397285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b0107-0770-4d02-a31e-3222c54c557f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:06.448206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c72b0107-0770-4d02-a31e-3222c54c557f None None] MFA Rules not processed for user `a712c28355c34c69b041652ea3526f18`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:06.449575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c72b0107-0770-4d02-a31e-3222c54c557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:06.606906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 908/1824] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:06.608104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b0107-0770-4d02-a31e-3222c54c557f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:06.655376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '887ed8602e2a4af4a63ab20d170b7dc4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.669392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '887ed8602e2a4af4a63ab20d170b7dc4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.671552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '887ed8602e2a4af4a63ab20d170b7dc4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.778233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b0107-0770-4d02-a31e-3222c54c557f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:06.816652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fb43b-03ed-4a5e-84de-64618dd4070c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:06.819767 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fb43b-03ed-4a5e-84de-64618dd4070c admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:06.819767 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fb43b-03ed-4a5e-84de-64618dd4070c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:06.820081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '887ed8602e2a4af4a63ab20d170b7dc4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.820168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fb43b-03ed-4a5e-84de-64618dd4070c admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:06.821116 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '887ed8602e2a4af4a63ab20d170b7dc4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:06.822809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fb43b-03ed-4a5e-84de-64618dd4070c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:06.826564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fb43b-03ed-4a5e-84de-64618dd4070c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:06.862765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 917/1825] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:06 2022] DELETE /identity/v3/users/887ed8602e2a4af4a63ab20d170b7dc4 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:07.050278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 909/1826] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:06 2022] POST /identity/v3/projects => generated 377 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:07.056089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.064793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:07.210600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111a6b5-6d01-4356-805a-0220acc2a1a1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.266848 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fb43b-03ed-4a5e-84de-64618dd4070c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.272715 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-133fb43b-03ed-4a5e-84de-64618dd4070c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:07.439218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473e123-0e3b-4379-8cd5-540c0eb1837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.439218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473e123-0e3b-4379-8cd5-540c0eb1837b admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.439880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473e123-0e3b-4379-8cd5-540c0eb1837b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.440697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473e123-0e3b-4379-8cd5-540c0eb1837b admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.441509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473e123-0e3b-4379-8cd5-540c0eb1837b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.444912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473e123-0e3b-4379-8cd5-540c0eb1837b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.555024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fb43b-03ed-4a5e-84de-64618dd4070c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:07.565121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:07.566362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.567102 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.567893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] PATH_INFO: `/v3/projects/a14e519e5f684d45a27c74abcd62dc98` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.572528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14e519e5f684d45a27c74abcd62dc98)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:07.577422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:07.633224 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 918/1827] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:07 2022] POST /identity/v3/users => generated 295 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:07.633224 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd181-6a88-4ab0-bb73-56a6752fb47c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:07.633224 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd181-6a88-4ab0-bb73-56a6752fb47c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:07.633224 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cd181-6a88-4ab0-bb73-56a6752fb47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:07.669254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:07.695114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-da0cd181-6a88-4ab0-bb73-56a6752fb47c None None] MFA Rules not processed for user `ad1787af22c94bc8a3599abf7e8fbe39`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:07.696701 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-da0cd181-6a88-4ab0-bb73-56a6752fb47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:07.759550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14e519e5f684d45a27c74abcd62dc98', 'request_id': 'req-5108082f-64fb-4057-96d3-89423673bd89'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:07.784660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14e519e5f684d45a27c74abcd62dc98', 'request_id': 'req-5108082f-64fb-4057-96d3-89423673bd89'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:07.912800 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 919/1828] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:07.915538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd181-6a88-4ab0-bb73-56a6752fb47c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:07.918097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-da0cd181-6a88-4ab0-bb73-56a6752fb47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:07.957950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cd181-6a88-4ab0-bb73-56a6752fb47c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:08.010138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14e519e5f684d45a27c74abcd62dc98', 'request_id': 'req-5108082f-64fb-4057-96d3-89423673bd89'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:08.029642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] The token cache is being invalidate because project a14e519e5f684d45a27c74abcd62dc98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:08.030530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:08.037031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:08.047116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 910/1829] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:07 2022] DELETE /identity/v3/projects/a14e519e5f684d45a27c74abcd62dc98 => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:08.060583 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:08.073548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:08.114116 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:08.115334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:08.116093 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:08.116579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] PATH_INFO: `/v3/projects/c024d640fe094a13b337b51f9bcfdbe9` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.120655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c024d640fe094a13b337b51f9bcfdbe9)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:08.126112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:08.283546 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108082f-64fb-4057-96d3-89423673bd89 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:08.303009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c024d640fe094a13b337b51f9bcfdbe9', 'request_id': 'req-9a735697-89ea-4301-b11b-bea3eb91368c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:08.313313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c024d640fe094a13b337b51f9bcfdbe9', 'request_id': 'req-9a735697-89ea-4301-b11b-bea3eb91368c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:08.437353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c024d640fe094a13b337b51f9bcfdbe9', 'request_id': 'req-9a735697-89ea-4301-b11b-bea3eb91368c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:08.452449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e2ba8-59fc-43a9-a85a-0fa7cab56772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:08.453650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2ba8-59fc-43a9-a85a-0fa7cab56772 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:08.454146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2ba8-59fc-43a9-a85a-0fa7cab56772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:08.454645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e2ba8-59fc-43a9-a85a-0fa7cab56772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.455949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e2ba8-59fc-43a9-a85a-0fa7cab56772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:08.468593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] The token cache is being invalidate because project c024d640fe094a13b337b51f9bcfdbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:08.468890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:08.472652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:08.476198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e2ba8-59fc-43a9-a85a-0fa7cab56772 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:08.476804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 920/1830] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:07 2022] DELETE /identity/v3/projects/c024d640fe094a13b337b51f9bcfdbe9 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:08.478290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:08.481265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:08.505526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a735697-89ea-4301-b11b-bea3eb91368c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:08.519150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 911/1831] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:08.520986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e2ba8-59fc-43a9-a85a-0fa7cab56772 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:08.521327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85bcfc-c547-45d9-8394-c88537086154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:08.522537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85bcfc-c547-45d9-8394-c88537086154 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:08.522868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85bcfc-c547-45d9-8394-c88537086154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:08.523147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85bcfc-c547-45d9-8394-c88537086154 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.524000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85bcfc-c547-45d9-8394-c88537086154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:08.524629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-dd1e2ba8-59fc-43a9-a85a-0fa7cab56772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:08.526218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85bcfc-c547-45d9-8394-c88537086154 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:08.550212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e2ba8-59fc-43a9-a85a-0fa7cab56772 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:08.558736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:08.559999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:08.561087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:08.561604 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] PATH_INFO: `/v3/users/c712a9666cc94b14833f7abe212962b4` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.564066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c712a9666cc94b14833f7abe212962b4)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:08.568275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:08.693391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 921/1832] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:08 2022] POST /identity/v3/projects => generated 371 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:08.695015 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee02678-4d5e-4b32-8155-28b5268247d2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:08.695450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee02678-4d5e-4b32-8155-28b5268247d2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:08.696438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee02678-4d5e-4b32-8155-28b5268247d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.735583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fee02678-4d5e-4b32-8155-28b5268247d2 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:08.737267 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fee02678-4d5e-4b32-8155-28b5268247d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:08.815460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 922/1833] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:08.816327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee02678-4d5e-4b32-8155-28b5268247d2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:08.817871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fee02678-4d5e-4b32-8155-28b5268247d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:08.830802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee02678-4d5e-4b32-8155-28b5268247d2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:08.836928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f78d1-7192-4f5c-a55f-8f4f34e624c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:08.837629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f78d1-7192-4f5c-a55f-8f4f34e624c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:08.837913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f78d1-7192-4f5c-a55f-8f4f34e624c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:08.838192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f78d1-7192-4f5c-a55f-8f4f34e624c8 admin admin] PATH_INFO: `/v3/projects/59b8e2de1e2547348fc0814fda256dba/users/68ef5a96025442ce9d6984da28ad750c/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:08.858211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f78d1-7192-4f5c-a55f-8f4f34e624c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b8e2de1e2547348fc0814fda256dba, user_id=68ef5a96025442ce9d6984da28ad750c, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:08.863539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f78d1-7192-4f5c-a55f-8f4f34e624c8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:09.405639 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c712a9666cc94b14833f7abe212962b4'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:09.416572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c712a9666cc94b14833f7abe212962b4'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:09.417391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c712a9666cc94b14833f7abe212962b4'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:09.449525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 923/1834] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:08 2022] PUT /identity/v3/projects/59b8e2de1e2547348fc0814fda256dba/users/68ef5a96025442ce9d6984da28ad750c/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:09.455218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f78d1-7192-4f5c-a55f-8f4f34e624c8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:09.546414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f78d1-7192-4f5c-a55f-8f4f34e624c8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:09.551643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f01420-a92a-4055-8916-15b94f69042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:09.552367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01420-a92a-4055-8916-15b94f69042e admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.552782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01420-a92a-4055-8916-15b94f69042e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.553144 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f01420-a92a-4055-8916-15b94f69042e admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.553876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f01420-a92a-4055-8916-15b94f69042e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:09.555956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f01420-a92a-4055-8916-15b94f69042e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:09.580166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c712a9666cc94b14833f7abe212962b4'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:09.593567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-765e63d2-675a-4821-a169-89fa59d9e654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c712a9666cc94b14833f7abe212962b4'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:09.601365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 912/1835] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:08 2022] DELETE /identity/v3/users/c712a9666cc94b14833f7abe212962b4 => generated 0 bytes in 1082 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:09.602774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bdd3-366d-40ae-af53-3d2102783d51 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.603056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bdd3-366d-40ae-af53-3d2102783d51 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.603330 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bdd3-366d-40ae-af53-3d2102783d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.628785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-d3d3bdd3-366d-40ae-af53-3d2102783d51 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:09.630159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d3d3bdd3-366d-40ae-af53-3d2102783d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:09.696240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 924/1836] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:09 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:09.697233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f01420-a92a-4055-8916-15b94f69042e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:09.698875 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-73f01420-a92a-4055-8916-15b94f69042e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:09.703685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 913/1837] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:09.705151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bdd3-366d-40ae-af53-3d2102783d51 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:09.706952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d3d3bdd3-366d-40ae-af53-3d2102783d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:09.723510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f01420-a92a-4055-8916-15b94f69042e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:09.729537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bdd3-366d-40ae-af53-3d2102783d51 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:09.732594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354e8b5-cd88-4c92-b026-f459428840f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:09.734269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354e8b5-cd88-4c92-b026-f459428840f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.734852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354e8b5-cd88-4c92-b026-f459428840f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.735255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354e8b5-cd88-4c92-b026-f459428840f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.735416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54789b-b4c8-41de-9e30-58ac7e4cec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:09.736502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54789b-b4c8-41de-9e30-58ac7e4cec8e admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.736708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354e8b5-cd88-4c92-b026-f459428840f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:09.737062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54789b-b4c8-41de-9e30-58ac7e4cec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.737710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54789b-b4c8-41de-9e30-58ac7e4cec8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.738416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354e8b5-cd88-4c92-b026-f459428840f3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:09.738812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54789b-b4c8-41de-9e30-58ac7e4cec8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:09.741043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54789b-b4c8-41de-9e30-58ac7e4cec8e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:09.751117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 925/1838] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:09.752119 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354e8b5-cd88-4c92-b026-f459428840f3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:09.765202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 914/1839] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:09.775274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54789b-b4c8-41de-9e30-58ac7e4cec8e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:09.775439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354e8b5-cd88-4c92-b026-f459428840f3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:09.775439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58f0e-559f-471e-8e63-8f274ba72b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:09.775655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58f0e-559f-471e-8e63-8f274ba72b4b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.775888 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58f0e-559f-471e-8e63-8f274ba72b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.776199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58f0e-559f-471e-8e63-8f274ba72b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.776972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e58f0e-559f-471e-8e63-8f274ba72b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:09.777278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e58f0e-559f-471e-8e63-8f274ba72b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:09.779961 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e58f0e-559f-471e-8e63-8f274ba72b4b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:09.786447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54789b-b4c8-41de-9e30-58ac7e4cec8e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:09.797872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 926/1840] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:51:09.797872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58f0e-559f-471e-8e63-8f274ba72b4b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:09.799822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0242-ca0b-45d5-8eeb-f7942bb85e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:09.801287 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0242-ca0b-45d5-8eeb-f7942bb85e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.802874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0242-ca0b-45d5-8eeb-f7942bb85e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.802874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc0242-ca0b-45d5-8eeb-f7942bb85e14 admin admin] PATH_INFO: `/v3/projects/59b8e2de1e2547348fc0814fda256dba/users/68ef5a96025442ce9d6984da28ad750c/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.807423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58f0e-559f-471e-8e63-8f274ba72b4b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:09.809583 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0242-ca0b-45d5-8eeb-f7942bb85e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b8e2de1e2547348fc0814fda256dba, user_id=68ef5a96025442ce9d6984da28ad750c, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:09.813356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aea386-07c9-4073-809d-1464e8bc48b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:09.813565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc0242-ca0b-45d5-8eeb-f7942bb85e14 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:09.814577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aea386-07c9-4073-809d-1464e8bc48b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.814863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aea386-07c9-4073-809d-1464e8bc48b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.815141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aea386-07c9-4073-809d-1464e8bc48b2 admin admin] PATH_INFO: `/v3/projects/ffdecce8660041cc93143da0a051cf06/users/154ab53b40b1409a9b1f359933c8e018/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.829673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 915/1841] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:09 2022] PUT /identity/v3/projects/59b8e2de1e2547348fc0814fda256dba/users/68ef5a96025442ce9d6984da28ad750c/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:09.836099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0242-ca0b-45d5-8eeb-f7942bb85e14 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:09.838330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:09.842651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aea386-07c9-4073-809d-1464e8bc48b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdecce8660041cc93143da0a051cf06, user_id=154ab53b40b1409a9b1f359933c8e018, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:09.847331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aea386-07c9-4073-809d-1464e8bc48b2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:09.927127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc0242-ca0b-45d5-8eeb-f7942bb85e14 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:09.932793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1fe21-ecd0-4977-9f0a-20f66a0f277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:09.932793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1fe21-ecd0-4977-9f0a-20f66a0f277a admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:09.933080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1fe21-ecd0-4977-9f0a-20f66a0f277a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:09.933292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1fe21-ecd0-4977-9f0a-20f66a0f277a admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:09.933935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1fe21-ecd0-4977-9f0a-20f66a0f277a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:09.936381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1fe21-ecd0-4977-9f0a-20f66a0f277a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.106692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 927/1842] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:09 2022] PUT /identity/v3/projects/ffdecce8660041cc93143da0a051cf06/users/154ab53b40b1409a9b1f359933c8e018/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:10.108161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe310b7-51a2-4506-9a78-d597fb197e88 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.108597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe310b7-51a2-4506-9a78-d597fb197e88 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.108801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe310b7-51a2-4506-9a78-d597fb197e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.141791 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ffe310b7-51a2-4506-9a78-d597fb197e88 None None] MFA Rules not processed for user `68ef5a96025442ce9d6984da28ad750c`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:10.142939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ffe310b7-51a2-4506-9a78-d597fb197e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:10.167720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 916/1843] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:09 2022] POST /identity/v3/projects => generated 355 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:10.168654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1fe21-ecd0-4977-9f0a-20f66a0f277a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.251709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1fe21-ecd0-4977-9f0a-20f66a0f277a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.257565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7e685-37c1-45ec-9339-be0808d9d17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.258814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7e685-37c1-45ec-9339-be0808d9d17b admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.259467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7e685-37c1-45ec-9339-be0808d9d17b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.260135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7e685-37c1-45ec-9339-be0808d9d17b admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.261004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7e685-37c1-45ec-9339-be0808d9d17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.266153 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 928/1844] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:10.267938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe310b7-51a2-4506-9a78-d597fb197e88 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.269652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7e685-37c1-45ec-9339-be0808d9d17b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.294224 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 917/1845] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:10.295765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7e685-37c1-45ec-9339-be0808d9d17b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.302988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-55d7e685-37c1-45ec-9339-be0808d9d17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:10.382226 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe310b7-51a2-4506-9a78-d597fb197e88 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.387420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2024-9892-437d-9503-ae8ff05b00c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.387920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7e685-37c1-45ec-9339-be0808d9d17b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.388049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2024-9892-437d-9503-ae8ff05b00c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.388345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2024-9892-437d-9503-ae8ff05b00c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.388690 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43e2024-9892-437d-9503-ae8ff05b00c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.389337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e2024-9892-437d-9503-ae8ff05b00c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.391277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43e2024-9892-437d-9503-ae8ff05b00c3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.392973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511da28-7311-4aa0-97a2-8ef0ce0d923d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.393601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511da28-7311-4aa0-97a2-8ef0ce0d923d service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.393953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511da28-7311-4aa0-97a2-8ef0ce0d923d service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.394281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2511da28-7311-4aa0-97a2-8ef0ce0d923d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.396397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2511da28-7311-4aa0-97a2-8ef0ce0d923d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:10.472284 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511da28-7311-4aa0-97a2-8ef0ce0d923d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.473916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2511da28-7311-4aa0-97a2-8ef0ce0d923d service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.485244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 918/1846] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:10.486233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511da28-7311-4aa0-97a2-8ef0ce0d923d service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.487978 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2511da28-7311-4aa0-97a2-8ef0ce0d923d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:10.491643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 929/1847] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:10 2022] POST /identity/v3/users => generated 278 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:10.499053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2024-9892-437d-9503-ae8ff05b00c3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.504689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2511da28-7311-4aa0-97a2-8ef0ce0d923d service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.510839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.511868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.512384 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.512867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] PATH_INFO: `/v3/projects/55cecd1346bb43468bdbed7a8b23105d` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.514342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55cecd1346bb43468bdbed7a8b23105d)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.516602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.530357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43e2024-9892-437d-9503-ae8ff05b00c3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.546415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cabeb6-9e21-4cb4-99a0-afed4aaed680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.548346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cabeb6-9e21-4cb4-99a0-afed4aaed680 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.549089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cabeb6-9e21-4cb4-99a0-afed4aaed680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.549765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cabeb6-9e21-4cb4-99a0-afed4aaed680 admin admin] PATH_INFO: `/v3/projects/ffdecce8660041cc93143da0a051cf06/users/154ab53b40b1409a9b1f359933c8e018/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.555437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cabeb6-9e21-4cb4-99a0-afed4aaed680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdecce8660041cc93143da0a051cf06, user_id=154ab53b40b1409a9b1f359933c8e018, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.563047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cabeb6-9e21-4cb4-99a0-afed4aaed680 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.583115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 930/1848] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:10 2022] PUT /identity/v3/projects/ffdecce8660041cc93143da0a051cf06/users/154ab53b40b1409a9b1f359933c8e018/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:10.584734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cabeb6-9e21-4cb4-99a0-afed4aaed680 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.656139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55cecd1346bb43468bdbed7a8b23105d', 'request_id': 'req-7555ed41-5823-467d-9f98-f9ac6e91b0e9'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.665398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55cecd1346bb43468bdbed7a8b23105d', 'request_id': 'req-7555ed41-5823-467d-9f98-f9ac6e91b0e9'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.690528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:10.701830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cabeb6-9e21-4cb4-99a0-afed4aaed680 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.767906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab0812-32c3-442c-bbc2-f7eac2da7b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.768741 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0812-32c3-442c-bbc2-f7eac2da7b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.769027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0812-32c3-442c-bbc2-f7eac2da7b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.769299 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0812-32c3-442c-bbc2-f7eac2da7b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.769988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab0812-32c3-442c-bbc2-f7eac2da7b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.771641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab0812-32c3-442c-bbc2-f7eac2da7b5d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.788929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 931/1849] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:10.792154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab0812-32c3-442c-bbc2-f7eac2da7b5d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.807157 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab0812-32c3-442c-bbc2-f7eac2da7b5d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.814671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55cecd1346bb43468bdbed7a8b23105d', 'request_id': 'req-7555ed41-5823-467d-9f98-f9ac6e91b0e9'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.814829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b79f7-3001-4d7e-8ce9-26a5146b4e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.814829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b79f7-3001-4d7e-8ce9-26a5146b4e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.815138 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b79f7-3001-4d7e-8ce9-26a5146b4e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.815963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b79f7-3001-4d7e-8ce9-26a5146b4e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.816875 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b79f7-3001-4d7e-8ce9-26a5146b4e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.819660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b79f7-3001-4d7e-8ce9-26a5146b4e7c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.828076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] The token cache is being invalidate because project 55cecd1346bb43468bdbed7a8b23105d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:10.828570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.829417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555ed41-5823-467d-9f98-f9ac6e91b0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:10.830995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 919/1850] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:10 2022] DELETE /identity/v3/projects/55cecd1346bb43468bdbed7a8b23105d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:10.832444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 932/1851] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:10.838186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b79f7-3001-4d7e-8ce9-26a5146b4e7c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.839075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fceb0-581d-4b5c-b99e-29c43a60c66a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.839517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fceb0-581d-4b5c-b99e-29c43a60c66a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.839802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fceb0-581d-4b5c-b99e-29c43a60c66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.840264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f42b79f7-3001-4d7e-8ce9-26a5146b4e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:10.857415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b79f7-3001-4d7e-8ce9-26a5146b4e7c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.863666 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921cee3-81c8-4d5e-8427-49638be98bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.864741 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921cee3-81c8-4d5e-8427-49638be98bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.864927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921cee3-81c8-4d5e-8427-49638be98bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.865219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921cee3-81c8-4d5e-8427-49638be98bfb admin admin] PATH_INFO: `/v3/projects/5150b136d97047b490ffd1df8fd80693/users/00bcf20fe8cd44f0b95e013c9906a695/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.883359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-8d6fceb0-581d-4b5c-b99e-29c43a60c66a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:10.883359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8d6fceb0-581d-4b5c-b99e-29c43a60c66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:10.886875 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921cee3-81c8-4d5e-8427-49638be98bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5150b136d97047b490ffd1df8fd80693, user_id=00bcf20fe8cd44f0b95e013c9906a695, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.890163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921cee3-81c8-4d5e-8427-49638be98bfb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.893014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 920/1852] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:10.904099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afdbbb-0924-45ef-be9a-9a478f1d17a4 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.904969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afdbbb-0924-45ef-be9a-9a478f1d17a4 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.905316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afdbbb-0924-45ef-be9a-9a478f1d17a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.928310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-d7afdbbb-0924-45ef-be9a-9a478f1d17a4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:10.929694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d7afdbbb-0924-45ef-be9a-9a478f1d17a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:10.938055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 921/1853] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:10.949381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afdbbb-0924-45ef-be9a-9a478f1d17a4 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.955872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afdbbb-0924-45ef-be9a-9a478f1d17a4 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:10.960554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a495a4-7b8e-4ee4-bb07-19985be43a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:10.961188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a495a4-7b8e-4ee4-bb07-19985be43a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:10.961504 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a495a4-7b8e-4ee4-bb07-19985be43a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:10.961987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a495a4-7b8e-4ee4-bb07-19985be43a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:10.962653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a495a4-7b8e-4ee4-bb07-19985be43a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:10.962954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a495a4-7b8e-4ee4-bb07-19985be43a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:10.964580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a495a4-7b8e-4ee4-bb07-19985be43a4e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:10.977780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 922/1854] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:51:10.982387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a495a4-7b8e-4ee4-bb07-19985be43a4e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:10.995003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a495a4-7b8e-4ee4-bb07-19985be43a4e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.000159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a0629-2403-4bd4-b801-318e56fe688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.000842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0629-2403-4bd4-b801-318e56fe688f admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.001127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0629-2403-4bd4-b801-318e56fe688f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.001404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a0629-2403-4bd4-b801-318e56fe688f admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.002057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a0629-2403-4bd4-b801-318e56fe688f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.003999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a0629-2403-4bd4-b801-318e56fe688f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.038412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 933/1855] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:10 2022] PUT /identity/v3/projects/5150b136d97047b490ffd1df8fd80693/users/00bcf20fe8cd44f0b95e013c9906a695/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:11.050842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aea4b-4969-4a0f-9414-71fbb0098529 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.051171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aea4b-4969-4a0f-9414-71fbb0098529 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.051404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371aea4b-4969-4a0f-9414-71fbb0098529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.112314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-371aea4b-4969-4a0f-9414-71fbb0098529 None None] MFA Rules not processed for user `00bcf20fe8cd44f0b95e013c9906a695`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:11.113853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-371aea4b-4969-4a0f-9414-71fbb0098529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:11.188525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 934/1856] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:11.194026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aea4b-4969-4a0f-9414-71fbb0098529 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.199948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 923/1857] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:10 2022] POST /identity/v3/projects => generated 369 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:11.201239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a0629-2403-4bd4-b801-318e56fe688f admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.277190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371aea4b-4969-4a0f-9414-71fbb0098529 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.282368 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aed196-4ad8-4457-b84f-e069e9355525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.283003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aed196-4ad8-4457-b84f-e069e9355525 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.283229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a0629-2403-4bd4-b801-318e56fe688f admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.283416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aed196-4ad8-4457-b84f-e069e9355525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.283550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aed196-4ad8-4457-b84f-e069e9355525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.284174 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aed196-4ad8-4457-b84f-e069e9355525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.286109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aed196-4ad8-4457-b84f-e069e9355525 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.288171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260927a-0a6c-45a7-ae66-800b5431b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.288841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260927a-0a6c-45a7-ae66-800b5431b0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.289123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260927a-0a6c-45a7-ae66-800b5431b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.289405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260927a-0a6c-45a7-ae66-800b5431b0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.290045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260927a-0a6c-45a7-ae66-800b5431b0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.298164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260927a-0a6c-45a7-ae66-800b5431b0f6 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.500329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 924/1858] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:11 2022] POST /identity/v3/users => generated 285 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:11.502059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260927a-0a6c-45a7-ae66-800b5431b0f6 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.505101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 935/1859] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:11 2022] POST /identity/v3/projects => generated 357 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:11.509140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aed196-4ad8-4457-b84f-e069e9355525 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.518039 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260927a-0a6c-45a7-ae66-800b5431b0f6 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.610728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d2c71-393c-43a0-aa5c-133c14020725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.611445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d2c71-393c-43a0-aa5c-133c14020725 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.611785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d2c71-393c-43a0-aa5c-133c14020725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.612058 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d2c71-393c-43a0-aa5c-133c14020725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.612895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d2c71-393c-43a0-aa5c-133c14020725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.614663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d2c71-393c-43a0-aa5c-133c14020725 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.623257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aed196-4ad8-4457-b84f-e069e9355525 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.625845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 925/1860] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:11.628941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6532432-eee4-4233-abbd-f5ceef2e6105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.629848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532432-eee4-4233-abbd-f5ceef2e6105 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.630127 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532432-eee4-4233-abbd-f5ceef2e6105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.630344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d2c71-393c-43a0-aa5c-133c14020725 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.630450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6532432-eee4-4233-abbd-f5ceef2e6105 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.631063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6532432-eee4-4233-abbd-f5ceef2e6105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.633185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6532432-eee4-4233-abbd-f5ceef2e6105 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.641658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d2c71-393c-43a0-aa5c-133c14020725 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.647794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55372e3-2df3-41b5-a333-8ac77d6e0801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.648855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55372e3-2df3-41b5-a333-8ac77d6e0801 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.649143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55372e3-2df3-41b5-a333-8ac77d6e0801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.649480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55372e3-2df3-41b5-a333-8ac77d6e0801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.650215 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55372e3-2df3-41b5-a333-8ac77d6e0801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.651879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55372e3-2df3-41b5-a333-8ac77d6e0801 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.676323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 926/1861] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:11.676323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55372e3-2df3-41b5-a333-8ac77d6e0801 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.697648 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55372e3-2df3-41b5-a333-8ac77d6e0801 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.706389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf397a46-d720-4346-bee5-27d74006c1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.707455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397a46-d720-4346-bee5-27d74006c1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.707948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397a46-d720-4346-bee5-27d74006c1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.708717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf397a46-d720-4346-bee5-27d74006c1f7 admin admin] PATH_INFO: `/v3/projects/6da6a0cd88ef49dab36aae96d700cc79/users/350b3fc884e84dc8973bbeca0edf57db/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.746366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397a46-d720-4346-bee5-27d74006c1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da6a0cd88ef49dab36aae96d700cc79, user_id=350b3fc884e84dc8973bbeca0edf57db, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.753079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf397a46-d720-4346-bee5-27d74006c1f7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.802169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 936/1862] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:11 2022] POST /identity/v3/users => generated 285 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:11.805600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6532432-eee4-4233-abbd-f5ceef2e6105 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.833636 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6532432-eee4-4233-abbd-f5ceef2e6105 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.841146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06bc1f-7755-4c6d-87c5-72986d70254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:11.841910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06bc1f-7755-4c6d-87c5-72986d70254a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.842218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06bc1f-7755-4c6d-87c5-72986d70254a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.842615 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06bc1f-7755-4c6d-87c5-72986d70254a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.843795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06bc1f-7755-4c6d-87c5-72986d70254a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:11.845873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06bc1f-7755-4c6d-87c5-72986d70254a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:11.859710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 937/1863] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:11.872005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06bc1f-7755-4c6d-87c5-72986d70254a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:11.886680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 927/1864] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:11 2022] PUT /identity/v3/projects/6da6a0cd88ef49dab36aae96d700cc79/users/350b3fc884e84dc8973bbeca0edf57db/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:11.899382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06bc1f-7755-4c6d-87c5-72986d70254a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:11.911265 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531bccc-7277-45ba-bba3-2a725e9e5d32 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:11.913336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531bccc-7277-45ba-bba3-2a725e9e5d32 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:11.913336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531bccc-7277-45ba-bba3-2a725e9e5d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:11.970161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-6531bccc-7277-45ba-bba3-2a725e9e5d32 None None] MFA Rules not processed for user `350b3fc884e84dc8973bbeca0edf57db`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:11.971494 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6531bccc-7277-45ba-bba3-2a725e9e5d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:12.034170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba30480-82d5-4e74-9b19-9a762783f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:12.034843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba30480-82d5-4e74-9b19-9a762783f8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.035121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba30480-82d5-4e74-9b19-9a762783f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.035392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba30480-82d5-4e74-9b19-9a762783f8f0 admin admin] PATH_INFO: `/v3/projects/426918075f4041aba95558379ba42c9f/users/c3b889d0796c47d2aa04c427505db344/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.055348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba30480-82d5-4e74-9b19-9a762783f8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=426918075f4041aba95558379ba42c9f, user_id=c3b889d0796c47d2aa04c427505db344, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:12.059494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba30480-82d5-4e74-9b19-9a762783f8f0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:12.093654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 928/1865] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:12.105217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531bccc-7277-45ba-bba3-2a725e9e5d32 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:12.106790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6531bccc-7277-45ba-bba3-2a725e9e5d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:12.194055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531bccc-7277-45ba-bba3-2a725e9e5d32 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:12.198121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90456e16-0774-4f80-a451-5a33338df810 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07be3fbf45dc407ba3b6ad4d1e6ea042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:12.198761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90456e16-0774-4f80-a451-5a33338df810 service glance] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.199000 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90456e16-0774-4f80-a451-5a33338df810 service glance] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.199265 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90456e16-0774-4f80-a451-5a33338df810 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.209494 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90456e16-0774-4f80-a451-5a33338df810 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:12.210984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90456e16-0774-4f80-a451-5a33338df810 service glance] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:12.222078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 929/1866] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:12.272337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 938/1867] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:11 2022] PUT /identity/v3/projects/426918075f4041aba95558379ba42c9f/users/c3b889d0796c47d2aa04c427505db344/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:12.278802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90456e16-0774-4f80-a451-5a33338df810 service glance] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:12.304589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90456e16-0774-4f80-a451-5a33338df810 service glance] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:12.374478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e39125-e842-4e98-9c7a-6973ef1aaa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:12.375227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e39125-e842-4e98-9c7a-6973ef1aaa2b admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.375558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e39125-e842-4e98-9c7a-6973ef1aaa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.375882 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e39125-e842-4e98-9c7a-6973ef1aaa2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.376520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e39125-e842-4e98-9c7a-6973ef1aaa2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:12.378148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e39125-e842-4e98-9c7a-6973ef1aaa2b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:12.390257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 930/1868] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:12.394671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba30480-82d5-4e74-9b19-9a762783f8f0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:12.406460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba30480-82d5-4e74-9b19-9a762783f8f0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:12.411461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bc968-3076-4dfe-a9f1-b52b15c9dc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:12.412152 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bc968-3076-4dfe-a9f1-b52b15c9dc6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.412473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bc968-3076-4dfe-a9f1-b52b15c9dc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.412714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bc968-3076-4dfe-a9f1-b52b15c9dc6c admin admin] PATH_INFO: `/v3/projects/426918075f4041aba95558379ba42c9f/users/c3b889d0796c47d2aa04c427505db344/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.414696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bc968-3076-4dfe-a9f1-b52b15c9dc6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=426918075f4041aba95558379ba42c9f, user_id=c3b889d0796c47d2aa04c427505db344, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:12.417468 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bc968-3076-4dfe-a9f1-b52b15c9dc6c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:12.433052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 939/1869] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:12 2022] PUT /identity/v3/projects/426918075f4041aba95558379ba42c9f/users/c3b889d0796c47d2aa04c427505db344/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:12.444270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fc38-7760-49a2-9ee2-fb34c477c3e0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.446782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fc38-7760-49a2-9ee2-fb34c477c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.446782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0fc38-7760-49a2-9ee2-fb34c477c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.478493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-18e0fc38-7760-49a2-9ee2-fb34c477c3e0 None None] MFA Rules not processed for user `c3b889d0796c47d2aa04c427505db344`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:12.479854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-18e0fc38-7760-49a2-9ee2-fb34c477c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:12.570780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 931/1870] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:12.621323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bc968-3076-4dfe-a9f1-b52b15c9dc6c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:12.623333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0e4bc968-3076-4dfe-a9f1-b52b15c9dc6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:12.712528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bc968-3076-4dfe-a9f1-b52b15c9dc6c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:12.715912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dedb9-7330-47a5-a661-9ed751e0a418 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.715912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dedb9-7330-47a5-a661-9ed751e0a418 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.716383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dedb9-7330-47a5-a661-9ed751e0a418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.719170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8ee88-70bc-4ca6-beb0-774509dc6ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:12.720048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ee88-70bc-4ca6-beb0-774509dc6ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.720472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ee88-70bc-4ca6-beb0-774509dc6ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.720984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8ee88-70bc-4ca6-beb0-774509dc6ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.741374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ee88-70bc-4ca6-beb0-774509dc6ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:12.743520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8ee88-70bc-4ca6-beb0-774509dc6ec7 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:12.763164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 940/1871] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:12.784051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-888dedb9-7330-47a5-a661-9ed751e0a418 None None] MFA Rules not processed for user `154ab53b40b1409a9b1f359933c8e018`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:12.787588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-888dedb9-7330-47a5-a661-9ed751e0a418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:12.880834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 932/1872] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:12.894093 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62958956-2676-4bc5-9653-aaefffbb0c02 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:12.898886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62958956-2676-4bc5-9653-aaefffbb0c02 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:12.898886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62958956-2676-4bc5-9653-aaefffbb0c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:12.915075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-62958956-2676-4bc5-9653-aaefffbb0c02 None None] MFA Rules not processed for user `ad1787af22c94bc8a3599abf7e8fbe39`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:12.916365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-62958956-2676-4bc5-9653-aaefffbb0c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:12.975502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 941/1873] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:12.987439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dedb9-7330-47a5-a661-9ed751e0a418 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:12.990681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-888dedb9-7330-47a5-a661-9ed751e0a418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:13.088728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dedb9-7330-47a5-a661-9ed751e0a418 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:13.095266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:13.097432 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df1789-f65c-41ad-b67c-47e7c47b5eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:13.098208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df1789-f65c-41ad-b67c-47e7c47b5eef service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:13.098571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df1789-f65c-41ad-b67c-47e7c47b5eef service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:13.098961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df1789-f65c-41ad-b67c-47e7c47b5eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:13.101091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-37df1789-f65c-41ad-b67c-47e7c47b5eef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:13.121726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df1789-f65c-41ad-b67c-47e7c47b5eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:13.123565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df1789-f65c-41ad-b67c-47e7c47b5eef service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:13.133539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 933/1874] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:13.182029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:13.589493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62958956-2676-4bc5-9653-aaefffbb0c02 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:13.624883 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62958956-2676-4bc5-9653-aaefffbb0c02 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:13.637239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa78e17-0381-4528-89f6-eb4fb48bd80b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:13.638021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78e17-0381-4528-89f6-eb4fb48bd80b service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:13.638308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78e17-0381-4528-89f6-eb4fb48bd80b service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:13.638611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78e17-0381-4528-89f6-eb4fb48bd80b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:13.713124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa78e17-0381-4528-89f6-eb4fb48bd80b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:13.714886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa78e17-0381-4528-89f6-eb4fb48bd80b service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:13.728168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 942/1875] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:16.776246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df1789-f65c-41ad-b67c-47e7c47b5eef service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:16.777983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-37df1789-f65c-41ad-b67c-47e7c47b5eef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:16.790858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df1789-f65c-41ad-b67c-47e7c47b5eef service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:16.794635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174742e-cd0a-440e-9d0e-0c747462b156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:16.795694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174742e-cd0a-440e-9d0e-0c747462b156 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:16.795971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174742e-cd0a-440e-9d0e-0c747462b156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:16.796242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174742e-cd0a-440e-9d0e-0c747462b156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:16.798686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8174742e-cd0a-440e-9d0e-0c747462b156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:16.896945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174742e-cd0a-440e-9d0e-0c747462b156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:16.900115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174742e-cd0a-440e-9d0e-0c747462b156 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:16.933958 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 934/1876] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:18.158027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f9576-553e-4cbc-9f0e-bfd0cf5549ba None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:18.159664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f9576-553e-4cbc-9f0e-bfd0cf5549ba None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:18.162250 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f9576-553e-4cbc-9f0e-bfd0cf5549ba None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:18.174696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 943/1877] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:51:18 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:51:18.177179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d45864-16bb-4e4e-b44a-407aa9f3957b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:18.177179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d45864-16bb-4e4e-b44a-407aa9f3957b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:18.177792 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d45864-16bb-4e4e-b44a-407aa9f3957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:18.205079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-98d45864-16bb-4e4e-b44a-407aa9f3957b None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:18.207353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-98d45864-16bb-4e4e-b44a-407aa9f3957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:18.224930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 935/1878] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:51:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:18.239594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f9576-553e-4cbc-9f0e-bfd0cf5549ba None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:18.255133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f9576-553e-4cbc-9f0e-bfd0cf5549ba None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:18.270772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85850c-bdd4-41ba-aceb-1654148e5fdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:18.271477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85850c-bdd4-41ba-aceb-1654148e5fdb service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:18.271683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85850c-bdd4-41ba-aceb-1654148e5fdb service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:18.271963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85850c-bdd4-41ba-aceb-1654148e5fdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:18.288858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85850c-bdd4-41ba-aceb-1654148e5fdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:18.290742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85850c-bdd4-41ba-aceb-1654148e5fdb service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:18.307128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 944/1879] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:18.884071 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:18.926736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:23.225198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:23.466308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:26.195180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d45864-16bb-4e4e-b44a-407aa9f3957b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:26.198200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-98d45864-16bb-4e4e-b44a-407aa9f3957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:26.291861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d45864-16bb-4e4e-b44a-407aa9f3957b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:26.300842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:26.301741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:26.302130 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:26.302575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] PATH_INFO: `/v3/users/a422824315984d02841ba7a8cc1fb93f` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:26.303975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a422824315984d02841ba7a8cc1fb93f)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:26.307807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:26.478191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:26.669314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a422824315984d02841ba7a8cc1fb93f'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:26.696414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a422824315984d02841ba7a8cc1fb93f'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:26.697247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a422824315984d02841ba7a8cc1fb93f'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:26.780972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a422824315984d02841ba7a8cc1fb93f'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:26.801108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a422824315984d02841ba7a8cc1fb93f'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:26.810247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 936/1880] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:26 2022] DELETE /identity/v3/users/a422824315984d02841ba7a8cc1fb93f => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:26.816745 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84be9-d8de-4b26-b712-00957a5bb23c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:26.817399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84be9-d8de-4b26-b712-00957a5bb23c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:26.818033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c84be9-d8de-4b26-b712-00957a5bb23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:26.842191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-71c84be9-d8de-4b26-b712-00957a5bb23c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:26.844006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-71c84be9-d8de-4b26-b712-00957a5bb23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:26.955627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 945/1881] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:27.040057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:27.042108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:27.153143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf5d82-b0f3-499a-a32a-4bc29c88564e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:27.159602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb07921-0921-490c-9978-5d39d6845902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:27.160241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb07921-0921-490c-9978-5d39d6845902 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:27.160620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb07921-0921-490c-9978-5d39d6845902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:27.161001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb07921-0921-490c-9978-5d39d6845902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:27.173804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb07921-0921-490c-9978-5d39d6845902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:27.181535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb07921-0921-490c-9978-5d39d6845902 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:27.188303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 937/1882] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:27.999976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:INSERT=1,keystone:DELETE=10 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:28.332329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84be9-d8de-4b26-b712-00957a5bb23c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:28.333865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-71c84be9-d8de-4b26-b712-00957a5bb23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:28.379279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c84be9-d8de-4b26-b712-00957a5bb23c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:28.399578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:28.400245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:28.402801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:28.403113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] PATH_INFO: `/v3/projects/d257be319764437297be6cbd99df8279` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:28.405318 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d257be319764437297be6cbd99df8279)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:28.407674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:28.613646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd257be319764437297be6cbd99df8279', 'request_id': 'req-128fd473-eb49-448f-87f8-3cccfce9f3ad'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:28.622707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd257be319764437297be6cbd99df8279', 'request_id': 'req-128fd473-eb49-448f-87f8-3cccfce9f3ad'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:28.735585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd257be319764437297be6cbd99df8279', 'request_id': 'req-128fd473-eb49-448f-87f8-3cccfce9f3ad'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:28.758650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] The token cache is being invalidate because project d257be319764437297be6cbd99df8279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:28.759196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:28.760467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:28.765975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 946/1883] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:28 2022] DELETE /identity/v3/projects/d257be319764437297be6cbd99df8279 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:28.767081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb07921-0921-490c-9978-5d39d6845902 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:28.777189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb07921-0921-490c-9978-5d39d6845902 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:28.850529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:28.851775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:28.854871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:28.854871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] PATH_INFO: `/v3/users/69850b6b4f434dd9a59b2c90c6d11f98` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:28.854871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69850b6b4f434dd9a59b2c90c6d11f98)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:28.856799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:29.223007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69850b6b4f434dd9a59b2c90c6d11f98'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:29.244113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69850b6b4f434dd9a59b2c90c6d11f98'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:29.249219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69850b6b4f434dd9a59b2c90c6d11f98'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:29.397070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69850b6b4f434dd9a59b2c90c6d11f98'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:29.423299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fcf26903-c83e-488f-a48c-ba80b395f700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69850b6b4f434dd9a59b2c90c6d11f98'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:29.431595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 938/1884] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:28 2022] DELETE /identity/v3/users/69850b6b4f434dd9a59b2c90c6d11f98 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:29.557236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:29.981068 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:29.983052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:30.023704 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fd473-eb49-448f-87f8-3cccfce9f3ad admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:30.098051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:30.098697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:30.098975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:30.099250 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] PATH_INFO: `/v3/projects/bffb7903745340aab0cc174c79f5ba96` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:30.100419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bffb7903745340aab0cc174c79f5ba96)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:30.102411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:30.300623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bffb7903745340aab0cc174c79f5ba96', 'request_id': 'req-4fdcfb41-4534-4a48-8121-70d5991dee12'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:30.307506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bffb7903745340aab0cc174c79f5ba96', 'request_id': 'req-4fdcfb41-4534-4a48-8121-70d5991dee12'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:30.386362 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bffb7903745340aab0cc174c79f5ba96', 'request_id': 'req-4fdcfb41-4534-4a48-8121-70d5991dee12'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:30.404732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] The token cache is being invalidate because project bffb7903745340aab0cc174c79f5ba96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:30.405184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:30.406128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4fdcfb41-4534-4a48-8121-70d5991dee12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:30.407990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 947/1885] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:29 2022] DELETE /identity/v3/projects/bffb7903745340aab0cc174c79f5ba96 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:30.415403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aeed9-981f-4acf-b54f-33743e743c01 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:30.416532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aeed9-981f-4acf-b54f-33743e743c01 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:30.417100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aeed9-981f-4acf-b54f-33743e743c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:30.476010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5f9aeed9-981f-4acf-b54f-33743e743c01 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:30.478262 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5f9aeed9-981f-4acf-b54f-33743e743c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:30.574256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 939/1886] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:30.581618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d3f2-d159-4684-b2c8-8a8c247b03c4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:30.583250 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d3f2-d159-4684-b2c8-8a8c247b03c4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:30.583616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8d3f2-d159-4684-b2c8-8a8c247b03c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:30.609044 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9da8d3f2-d159-4684-b2c8-8a8c247b03c4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:30.611411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9da8d3f2-d159-4684-b2c8-8a8c247b03c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:30.625939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 948/1887] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:30.629971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aeed9-981f-4acf-b54f-33743e743c01 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:30.640326 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aeed9-981f-4acf-b54f-33743e743c01 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:30.646289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f2bc-1dc7-4b25-b8e9-cfb1aab5b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:30.647369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f2bc-1dc7-4b25-b8e9-cfb1aab5b3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:30.647645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f2bc-1dc7-4b25-b8e9-cfb1aab5b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:30.647913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12f2bc-1dc7-4b25-b8e9-cfb1aab5b3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:30.648925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12f2bc-1dc7-4b25-b8e9-cfb1aab5b3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:30.649232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12f2bc-1dc7-4b25-b8e9-cfb1aab5b3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:30.650856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12f2bc-1dc7-4b25-b8e9-cfb1aab5b3d1 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:30.674055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 940/1888] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:51:30.676364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8d3f2-d159-4684-b2c8-8a8c247b03c4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:30.699444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8d3f2-d159-4684-b2c8-8a8c247b03c4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:30.712099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806399b-4fc3-443c-86fa-165e59bc996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:30.712960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806399b-4fc3-443c-86fa-165e59bc996f admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:30.713418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806399b-4fc3-443c-86fa-165e59bc996f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:30.713699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806399b-4fc3-443c-86fa-165e59bc996f admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:30.714534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806399b-4fc3-443c-86fa-165e59bc996f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:30.718580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b806399b-4fc3-443c-86fa-165e59bc996f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:30.882058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 949/1889] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:30 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:30.886116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f2bc-1dc7-4b25-b8e9-cfb1aab5b3d1 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:30.899538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12f2bc-1dc7-4b25-b8e9-cfb1aab5b3d1 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:30.994979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec704de3-a7b5-4ada-8253-f36d8b943582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:30.995447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec704de3-a7b5-4ada-8253-f36d8b943582 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:30.995555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec704de3-a7b5-4ada-8253-f36d8b943582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:30.995892 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec704de3-a7b5-4ada-8253-f36d8b943582 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:31.000053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec704de3-a7b5-4ada-8253-f36d8b943582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:31.000053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec704de3-a7b5-4ada-8253-f36d8b943582 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:31.248374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 941/1890] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:30 2022] POST /identity/v3/users => generated 293 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:31.249469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806399b-4fc3-443c-86fa-165e59bc996f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:31.261973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b806399b-4fc3-443c-86fa-165e59bc996f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:31.267789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4aa90-2d5a-4542-8b24-8fad0a923d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:31.268420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4aa90-2d5a-4542-8b24-8fad0a923d49 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:31.268738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4aa90-2d5a-4542-8b24-8fad0a923d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:31.269032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4aa90-2d5a-4542-8b24-8fad0a923d49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:31.269799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4aa90-2d5a-4542-8b24-8fad0a923d49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:31.271494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4aa90-2d5a-4542-8b24-8fad0a923d49 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:31.283424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 950/1891] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:31.289473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec704de3-a7b5-4ada-8253-f36d8b943582 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:31.301093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec704de3-a7b5-4ada-8253-f36d8b943582 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:31.306567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf31a6-4860-4686-8a2c-09271c29c242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:31.307192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf31a6-4860-4686-8a2c-09271c29c242 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:31.307472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf31a6-4860-4686-8a2c-09271c29c242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:31.307744 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf31a6-4860-4686-8a2c-09271c29c242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:31.308393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf31a6-4860-4686-8a2c-09271c29c242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:31.313896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf31a6-4860-4686-8a2c-09271c29c242 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:31.327390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 942/1892] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:31.332109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4aa90-2d5a-4542-8b24-8fad0a923d49 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:31.349340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4aa90-2d5a-4542-8b24-8fad0a923d49 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:31.360460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a027cfc-84ea-4dc9-9ec8-1f72fa34cbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:31.361461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a027cfc-84ea-4dc9-9ec8-1f72fa34cbdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:31.361894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a027cfc-84ea-4dc9-9ec8-1f72fa34cbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:31.362975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a027cfc-84ea-4dc9-9ec8-1f72fa34cbdc admin admin] PATH_INFO: `/v3/projects/b6b2de4b8b9d498d9ee793ebf46893e7/users/36c7cb44f1504d37bf6db9bdcb5a64f1/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:31.401207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a027cfc-84ea-4dc9-9ec8-1f72fa34cbdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b2de4b8b9d498d9ee793ebf46893e7, user_id=36c7cb44f1504d37bf6db9bdcb5a64f1, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:31.406582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a027cfc-84ea-4dc9-9ec8-1f72fa34cbdc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:31.545254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 951/1893] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:31 2022] PUT /identity/v3/projects/b6b2de4b8b9d498d9ee793ebf46893e7/users/36c7cb44f1504d37bf6db9bdcb5a64f1/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:31.547168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50015ed3-6d9f-490c-b51e-a905f2842e9e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:31.547697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50015ed3-6d9f-490c-b51e-a905f2842e9e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:31.547697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50015ed3-6d9f-490c-b51e-a905f2842e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:31.584234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-50015ed3-6d9f-490c-b51e-a905f2842e9e None None] MFA Rules not processed for user `36c7cb44f1504d37bf6db9bdcb5a64f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:31.585794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-50015ed3-6d9f-490c-b51e-a905f2842e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:31.681819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 943/1894] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:31.709578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a027cfc-84ea-4dc9-9ec8-1f72fa34cbdc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:31.794058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a027cfc-84ea-4dc9-9ec8-1f72fa34cbdc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:31.802074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc8dac-c4cb-43f6-bae0-6725e7fa1c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:31.803089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc8dac-c4cb-43f6-bae0-6725e7fa1c0d admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:31.803547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc8dac-c4cb-43f6-bae0-6725e7fa1c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:31.803905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc8dac-c4cb-43f6-bae0-6725e7fa1c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:31.805176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc8dac-c4cb-43f6-bae0-6725e7fa1c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:31.807809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc8dac-c4cb-43f6-bae0-6725e7fa1c0d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:31.960661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 952/1895] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:31 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:31.965050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50015ed3-6d9f-490c-b51e-a905f2842e9e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:31.978006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50015ed3-6d9f-490c-b51e-a905f2842e9e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:32.045371 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32554d3d-e79a-4a3c-ba0b-bb45e452553e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:32.045981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32554d3d-e79a-4a3c-ba0b-bb45e452553e admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:32.046254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32554d3d-e79a-4a3c-ba0b-bb45e452553e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:32.046519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32554d3d-e79a-4a3c-ba0b-bb45e452553e admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:32.047152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32554d3d-e79a-4a3c-ba0b-bb45e452553e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:32.049111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32554d3d-e79a-4a3c-ba0b-bb45e452553e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:32.171466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 944/1896] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:31 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:32.172385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc8dac-c4cb-43f6-bae0-6725e7fa1c0d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:32.181627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc8dac-c4cb-43f6-bae0-6725e7fa1c0d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:32.187130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374c55d-59f5-497d-9bbc-9ec005c123fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:32.187768 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c55d-59f5-497d-9bbc-9ec005c123fb admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:32.188064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c55d-59f5-497d-9bbc-9ec005c123fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:32.188305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374c55d-59f5-497d-9bbc-9ec005c123fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:32.188988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374c55d-59f5-497d-9bbc-9ec005c123fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:32.190807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374c55d-59f5-497d-9bbc-9ec005c123fb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:32.203631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 953/1897] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:32.215582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32554d3d-e79a-4a3c-ba0b-bb45e452553e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:32.228692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32554d3d-e79a-4a3c-ba0b-bb45e452553e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:32.236335 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5050-6688-4b6b-90ac-635ac33bb532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:32.243582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5050-6688-4b6b-90ac-635ac33bb532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:32.243582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5050-6688-4b6b-90ac-635ac33bb532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:32.243582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a5050-6688-4b6b-90ac-635ac33bb532 admin admin] PATH_INFO: `/v3/projects/566306e936244321bfe5b50fe01213ee/users/73b36f3a6a554fcc901d49d1f88ac469/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:32.258223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a5050-6688-4b6b-90ac-635ac33bb532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566306e936244321bfe5b50fe01213ee, user_id=73b36f3a6a554fcc901d49d1f88ac469, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:32.261067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a5050-6688-4b6b-90ac-635ac33bb532 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:32.358411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:32.364310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 945/1898] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:32 2022] PUT /identity/v3/projects/566306e936244321bfe5b50fe01213ee/users/73b36f3a6a554fcc901d49d1f88ac469/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:32.374919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374c55d-59f5-497d-9bbc-9ec005c123fb admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:32.411575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374c55d-59f5-497d-9bbc-9ec005c123fb admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:32.504360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50731c-e601-4258-ad84-c532b89d0998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:32.504996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50731c-e601-4258-ad84-c532b89d0998 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:32.505272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50731c-e601-4258-ad84-c532b89d0998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:32.505562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50731c-e601-4258-ad84-c532b89d0998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:32.506314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50731c-e601-4258-ad84-c532b89d0998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:32.508541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd50731c-e601-4258-ad84-c532b89d0998 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:32.520919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 954/1899] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:32.526462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5050-6688-4b6b-90ac-635ac33bb532 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:32.541339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a5050-6688-4b6b-90ac-635ac33bb532 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:32.553744 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421200a0-ec30-4760-81d7-2b6ece4ca300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:32.555006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421200a0-ec30-4760-81d7-2b6ece4ca300 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:32.555459 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421200a0-ec30-4760-81d7-2b6ece4ca300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:32.557354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421200a0-ec30-4760-81d7-2b6ece4ca300 admin admin] PATH_INFO: `/v3/projects/566306e936244321bfe5b50fe01213ee/users/73b36f3a6a554fcc901d49d1f88ac469/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:32.562249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421200a0-ec30-4760-81d7-2b6ece4ca300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566306e936244321bfe5b50fe01213ee, user_id=73b36f3a6a554fcc901d49d1f88ac469, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:32.567980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421200a0-ec30-4760-81d7-2b6ece4ca300 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:32.583470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 946/1900] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:32 2022] PUT /identity/v3/projects/566306e936244321bfe5b50fe01213ee/users/73b36f3a6a554fcc901d49d1f88ac469/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:32.596111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71675f-c753-46c8-8241-c63d7664fd2f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:32.596423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71675f-c753-46c8-8241-c63d7664fd2f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:32.596744 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71675f-c753-46c8-8241-c63d7664fd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:32.639874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6d71675f-c753-46c8-8241-c63d7664fd2f None None] MFA Rules not processed for user `73b36f3a6a554fcc901d49d1f88ac469`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:32.641258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6d71675f-c753-46c8-8241-c63d7664fd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:32.744599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 955/1901] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:32.752888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421200a0-ec30-4760-81d7-2b6ece4ca300 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:32.754698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-421200a0-ec30-4760-81d7-2b6ece4ca300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:32.820065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421200a0-ec30-4760-81d7-2b6ece4ca300 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:32.823905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83210488-9dc2-49f3-8f8e-5600e6cdee46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:32.824562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210488-9dc2-49f3-8f8e-5600e6cdee46 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:32.824842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210488-9dc2-49f3-8f8e-5600e6cdee46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:32.825111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210488-9dc2-49f3-8f8e-5600e6cdee46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:32.837416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83210488-9dc2-49f3-8f8e-5600e6cdee46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:32.838980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83210488-9dc2-49f3-8f8e-5600e6cdee46 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:32.853123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 947/1902] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:33.646622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:34.404087 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71675f-c753-46c8-8241-c63d7664fd2f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:34.469696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71675f-c753-46c8-8241-c63d7664fd2f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:34.474795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:34.475443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:34.475722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:34.475996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] PATH_INFO: `/v3/users/36c7cb44f1504d37bf6db9bdcb5a64f1` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:34.477379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=36c7cb44f1504d37bf6db9bdcb5a64f1)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:34.479345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:34.811497 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36c7cb44f1504d37bf6db9bdcb5a64f1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:34.821341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36c7cb44f1504d37bf6db9bdcb5a64f1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:34.822149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36c7cb44f1504d37bf6db9bdcb5a64f1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:34.922935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36c7cb44f1504d37bf6db9bdcb5a64f1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:34.923749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36c7cb44f1504d37bf6db9bdcb5a64f1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:34.943418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 956/1903] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:34 2022] DELETE /identity/v3/users/36c7cb44f1504d37bf6db9bdcb5a64f1 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:34.948285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9190f17-16f8-4ce5-a52f-e6470638cc1e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:34.948880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9190f17-16f8-4ce5-a52f-e6470638cc1e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:34.948976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9190f17-16f8-4ce5-a52f-e6470638cc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:34.974116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b9190f17-16f8-4ce5-a52f-e6470638cc1e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:34.975345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b9190f17-16f8-4ce5-a52f-e6470638cc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:35.075041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 948/1904] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:35.090341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:35.092295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:35.152577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7408d7-6de1-4aef-bfa8-5526058794ca admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:35.156847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb2fd3-1928-4c75-ba05-7ab2b8b6b363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:35.157500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb2fd3-1928-4c75-ba05-7ab2b8b6b363 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:35.164973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb2fd3-1928-4c75-ba05-7ab2b8b6b363 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:35.164973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb2fd3-1928-4c75-ba05-7ab2b8b6b363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:35.167992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb2fd3-1928-4c75-ba05-7ab2b8b6b363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:35.170357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb2fd3-1928-4c75-ba05-7ab2b8b6b363 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:35.180029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 957/1905] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:35.697676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9190f17-16f8-4ce5-a52f-e6470638cc1e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:35.699304 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b9190f17-16f8-4ce5-a52f-e6470638cc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:35.718275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9190f17-16f8-4ce5-a52f-e6470638cc1e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:35.723253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:35.724359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:35.724359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:35.724562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] PATH_INFO: `/v3/projects/b6b2de4b8b9d498d9ee793ebf46893e7` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:35.725850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b2de4b8b9d498d9ee793ebf46893e7)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:35.727805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:35.882305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b2de4b8b9d498d9ee793ebf46893e7', 'request_id': 'req-eea25840-46ce-4278-93ec-a598ae96b6ac'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:35.894901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b2de4b8b9d498d9ee793ebf46893e7', 'request_id': 'req-eea25840-46ce-4278-93ec-a598ae96b6ac'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:35.996093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:35.998401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b2de4b8b9d498d9ee793ebf46893e7', 'request_id': 'req-eea25840-46ce-4278-93ec-a598ae96b6ac'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:36.014460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] The token cache is being invalidate because project b6b2de4b8b9d498d9ee793ebf46893e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:36.014460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:36.014788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:36.016861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 949/1906] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:35 2022] DELETE /identity/v3/projects/b6b2de4b8b9d498d9ee793ebf46893e7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:36.022352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb2fd3-1928-4c75-ba05-7ab2b8b6b363 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:36.034484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb2fd3-1928-4c75-ba05-7ab2b8b6b363 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:36.129851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:36.130642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:36.130930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:36.131207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] PATH_INFO: `/v3/users/73b36f3a6a554fcc901d49d1f88ac469` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:36.138641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b36f3a6a554fcc901d49d1f88ac469)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:36.138641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:36.609734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b36f3a6a554fcc901d49d1f88ac469'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:36.616556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b36f3a6a554fcc901d49d1f88ac469'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:36.617245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b36f3a6a554fcc901d49d1f88ac469'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:36.727014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b36f3a6a554fcc901d49d1f88ac469'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:36.727638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4c9101c5-3e73-47ca-8ca5-e557f0f73961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b36f3a6a554fcc901d49d1f88ac469'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:36.747845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 958/1907] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:36 2022] DELETE /identity/v3/users/73b36f3a6a554fcc901d49d1f88ac469 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:37.331745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:37.333328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:37.348732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea25840-46ce-4278-93ec-a598ae96b6ac admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:37.431401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:37.432327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:37.432672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:37.432952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] PATH_INFO: `/v3/projects/566306e936244321bfe5b50fe01213ee` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:37.434397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566306e936244321bfe5b50fe01213ee)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:37.436644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:37.517273 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:37.570804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566306e936244321bfe5b50fe01213ee', 'request_id': 'req-2f374821-6f92-4d0c-afc6-076d8703f978'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:37.578446 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566306e936244321bfe5b50fe01213ee', 'request_id': 'req-2f374821-6f92-4d0c-afc6-076d8703f978'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:37.710803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566306e936244321bfe5b50fe01213ee', 'request_id': 'req-2f374821-6f92-4d0c-afc6-076d8703f978'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:37.722856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] The token cache is being invalidate because project 566306e936244321bfe5b50fe01213ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:37.723145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:37.723812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2f374821-6f92-4d0c-afc6-076d8703f978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:37.725368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 950/1908] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:37 2022] DELETE /identity/v3/projects/566306e936244321bfe5b50fe01213ee => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:37.731670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec63b7-e258-4dde-a758-e668fd6cba4d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:37.732076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec63b7-e258-4dde-a758-e668fd6cba4d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:37.732419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec63b7-e258-4dde-a758-e668fd6cba4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:37.764969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-75ec63b7-e258-4dde-a758-e668fd6cba4d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:37.766997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-75ec63b7-e258-4dde-a758-e668fd6cba4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:37.854520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 959/1909] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:37.866804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846e919-533d-42de-a179-689201eba574 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:37.867560 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846e919-533d-42de-a179-689201eba574 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:37.867929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846e919-533d-42de-a179-689201eba574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:37.904008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-a846e919-533d-42de-a179-689201eba574 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:37.905822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a846e919-533d-42de-a179-689201eba574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:37.915281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 951/1910] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:37.920020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec63b7-e258-4dde-a758-e668fd6cba4d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:37.935286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec63b7-e258-4dde-a758-e668fd6cba4d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:37.944654 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33eec8-7b2f-43e8-8019-27c89562b5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:37.945736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33eec8-7b2f-43e8-8019-27c89562b5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:37.946243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33eec8-7b2f-43e8-8019-27c89562b5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:37.946746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33eec8-7b2f-43e8-8019-27c89562b5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:37.947986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33eec8-7b2f-43e8-8019-27c89562b5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:37.948584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33eec8-7b2f-43e8-8019-27c89562b5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:37.952216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33eec8-7b2f-43e8-8019-27c89562b5e8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:37.974828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 960/1911] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:51:37.981827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846e919-533d-42de-a179-689201eba574 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:37.992281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846e919-533d-42de-a179-689201eba574 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:37.998293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47908d34-0f04-4f85-b590-7534f5ed205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:37.998981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47908d34-0f04-4f85-b590-7534f5ed205b admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:37.999269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47908d34-0f04-4f85-b590-7534f5ed205b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:37.999710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47908d34-0f04-4f85-b590-7534f5ed205b admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:38.000461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47908d34-0f04-4f85-b590-7534f5ed205b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:38.002720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47908d34-0f04-4f85-b590-7534f5ed205b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:38.116256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 952/1912] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:37 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:38.117673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33eec8-7b2f-43e8-8019-27c89562b5e8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:38.129695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33eec8-7b2f-43e8-8019-27c89562b5e8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:38.207790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f8ddb-5c74-4bea-95d8-33cae15569f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:38.208442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f8ddb-5c74-4bea-95d8-33cae15569f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:38.208676 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f8ddb-5c74-4bea-95d8-33cae15569f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:38.208977 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f8ddb-5c74-4bea-95d8-33cae15569f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:38.209763 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f8ddb-5c74-4bea-95d8-33cae15569f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:38.212102 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f8ddb-5c74-4bea-95d8-33cae15569f9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:38.249054 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:38.381464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 961/1913] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:38 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:38.381677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47908d34-0f04-4f85-b590-7534f5ed205b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:38.394361 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47908d34-0f04-4f85-b590-7534f5ed205b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:38.402430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157327e-ceb5-4e8b-8a66-fabe1192941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:38.403250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157327e-ceb5-4e8b-8a66-fabe1192941f admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:38.403593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157327e-ceb5-4e8b-8a66-fabe1192941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:38.403935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157327e-ceb5-4e8b-8a66-fabe1192941f admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:38.404709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157327e-ceb5-4e8b-8a66-fabe1192941f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:38.406508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157327e-ceb5-4e8b-8a66-fabe1192941f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:38.420258 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 953/1914] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:38.425050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f8ddb-5c74-4bea-95d8-33cae15569f9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:38.437055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f8ddb-5c74-4bea-95d8-33cae15569f9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:38.442574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf83a42-15f4-4224-bf3d-66b7daae18ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:38.443203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83a42-15f4-4224-bf3d-66b7daae18ef admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:38.443479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83a42-15f4-4224-bf3d-66b7daae18ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:38.443747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf83a42-15f4-4224-bf3d-66b7daae18ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:38.444575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf83a42-15f4-4224-bf3d-66b7daae18ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:38.446341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf83a42-15f4-4224-bf3d-66b7daae18ef admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:38.464493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 962/1915] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:38.469668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157327e-ceb5-4e8b-8a66-fabe1192941f admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:38.489938 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157327e-ceb5-4e8b-8a66-fabe1192941f admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:38.497187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd4da5-7996-4a6e-8d26-0d8a2fd025e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:38.498175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4da5-7996-4a6e-8d26-0d8a2fd025e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:38.498634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4da5-7996-4a6e-8d26-0d8a2fd025e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:38.498914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd4da5-7996-4a6e-8d26-0d8a2fd025e7 admin admin] PATH_INFO: `/v3/projects/2c5ef3c716bb43cb96f4d237d410a998/users/75b69ecf90da4b91a10ef71ee77be2b9/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:38.521073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd4da5-7996-4a6e-8d26-0d8a2fd025e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5ef3c716bb43cb96f4d237d410a998, user_id=75b69ecf90da4b91a10ef71ee77be2b9, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:38.527060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd4da5-7996-4a6e-8d26-0d8a2fd025e7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:38.624532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 954/1916] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:38 2022] PUT /identity/v3/projects/2c5ef3c716bb43cb96f4d237d410a998/users/75b69ecf90da4b91a10ef71ee77be2b9/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:38.648533 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7a0b-3a50-4943-b47c-a85e60a75d1b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:38.648984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7a0b-3a50-4943-b47c-a85e60a75d1b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:38.649280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7a0b-3a50-4943-b47c-a85e60a75d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:38.683127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd4da5-7996-4a6e-8d26-0d8a2fd025e7 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:38.683127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a2dd4da5-7996-4a6e-8d26-0d8a2fd025e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:38.702458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b18f7a0b-3a50-4943-b47c-a85e60a75d1b None None] MFA Rules not processed for user `75b69ecf90da4b91a10ef71ee77be2b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:38.704530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b18f7a0b-3a50-4943-b47c-a85e60a75d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:38.749824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd4da5-7996-4a6e-8d26-0d8a2fd025e7 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:38.754786 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:38.755435 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:38.755705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:38.755975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] PATH_INFO: `/v3/users/a712c28355c34c69b041652ea3526f18` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:38.757244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a712c28355c34c69b041652ea3526f18)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:38.759195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:38.799117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 963/1917] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:38.810686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7a0b-3a50-4943-b47c-a85e60a75d1b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:38.812347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b18f7a0b-3a50-4943-b47c-a85e60a75d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:38.883747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7a0b-3a50-4943-b47c-a85e60a75d1b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:38.890530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ea115-6323-4927-b4e5-1a02f9c31c27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07be3fbf45dc407ba3b6ad4d1e6ea042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:38.891572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ea115-6323-4927-b4e5-1a02f9c31c27 service glance] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:38.892043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ea115-6323-4927-b4e5-1a02f9c31c27 service glance] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:38.894932 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ea115-6323-4927-b4e5-1a02f9c31c27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:38.909500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ea115-6323-4927-b4e5-1a02f9c31c27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:38.912852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ea115-6323-4927-b4e5-1a02f9c31c27 service glance] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:38.932159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 964/1918] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:39.089540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a712c28355c34c69b041652ea3526f18'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:39.106704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a712c28355c34c69b041652ea3526f18'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:39.111964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a712c28355c34c69b041652ea3526f18'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:39.227734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a712c28355c34c69b041652ea3526f18'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:39.258002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a712c28355c34c69b041652ea3526f18'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:39.273473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 955/1919] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:38 2022] DELETE /identity/v3/users/a712c28355c34c69b041652ea3526f18 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:39.275856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735e937-2db9-443c-b0bf-aad7f0cb9a08 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:39.275856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735e937-2db9-443c-b0bf-aad7f0cb9a08 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:39.276175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735e937-2db9-443c-b0bf-aad7f0cb9a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:39.311598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6735e937-2db9-443c-b0bf-aad7f0cb9a08 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:39.313463 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6735e937-2db9-443c-b0bf-aad7f0cb9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:39.424984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 965/1920] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:39.437337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:39.439595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:39.533261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58c9ef-8187-456a-88a5-a1913cf061a4 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:39.540427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ce42b-b0df-4021-9082-b327e3443d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:39.541632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ce42b-b0df-4021-9082-b327e3443d98 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:39.542213 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ce42b-b0df-4021-9082-b327e3443d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:39.542669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ce42b-b0df-4021-9082-b327e3443d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:39.560831 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ce42b-b0df-4021-9082-b327e3443d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:39.563568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ce42b-b0df-4021-9082-b327e3443d98 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:39.582218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 956/1921] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:40.240990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735e937-2db9-443c-b0bf-aad7f0cb9a08 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:40.246192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6735e937-2db9-443c-b0bf-aad7f0cb9a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:40.290033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735e937-2db9-443c-b0bf-aad7f0cb9a08 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:40.301884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:40.306648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:40.307506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:40.309068 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] PATH_INFO: `/v3/projects/28ba31782d2e442a8048dd74cd8166f7` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:40.311785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ba31782d2e442a8048dd74cd8166f7)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:40.318513 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:40.730922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ba31782d2e442a8048dd74cd8166f7', 'request_id': 'req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:40.737307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ba31782d2e442a8048dd74cd8166f7', 'request_id': 'req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:40.757652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:40.843604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ba31782d2e442a8048dd74cd8166f7', 'request_id': 'req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:40.864955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] The token cache is being invalidate because project 28ba31782d2e442a8048dd74cd8166f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:40.865542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:40.867084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:40.869282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 966/1922] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:40 2022] DELETE /identity/v3/projects/28ba31782d2e442a8048dd74cd8166f7 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:40.876313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ce42b-b0df-4021-9082-b327e3443d98 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:40.903429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ce42b-b0df-4021-9082-b327e3443d98 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:40.928501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:41.028775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:41.028775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:41.028775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:41.028775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] PATH_INFO: `/v3/users/68ef5a96025442ce9d6984da28ad750c` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:41.034939 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ef5a96025442ce9d6984da28ad750c)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:41.040649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:41.330301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ef5a96025442ce9d6984da28ad750c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:41.339584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ef5a96025442ce9d6984da28ad750c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:41.340368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ef5a96025442ce9d6984da28ad750c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:41.498353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ef5a96025442ce9d6984da28ad750c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:41.514722 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-28e1a694-b76a-4f80-a6d1-5f0b8aef1304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ef5a96025442ce9d6984da28ad750c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:41.521400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 957/1923] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:40 2022] DELETE /identity/v3/users/68ef5a96025442ce9d6984da28ad750c => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:41.767592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:42.156161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:42.158087 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:42.174970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557c049-67f7-4a0c-877d-0bdfc2b30e3b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:42.261734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:42.262390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:42.262674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:42.262943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] PATH_INFO: `/v3/projects/59b8e2de1e2547348fc0814fda256dba` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:42.264185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b8e2de1e2547348fc0814fda256dba)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:42.266365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:42.505658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b8e2de1e2547348fc0814fda256dba', 'request_id': 'req-a53323f0-6421-497f-9203-488f1e1261b6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:42.515220 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b8e2de1e2547348fc0814fda256dba', 'request_id': 'req-a53323f0-6421-497f-9203-488f1e1261b6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:42.624352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b8e2de1e2547348fc0814fda256dba', 'request_id': 'req-a53323f0-6421-497f-9203-488f1e1261b6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:42.639454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] The token cache is being invalidate because project 59b8e2de1e2547348fc0814fda256dba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:42.639789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:42.640878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:42.642452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 967/1924] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:42 2022] DELETE /identity/v3/projects/59b8e2de1e2547348fc0814fda256dba => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:42.648266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342786e2-f994-4b80-a856-146476af3a1c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:42.648602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342786e2-f994-4b80-a856-146476af3a1c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:42.648880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342786e2-f994-4b80-a856-146476af3a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:42.671331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-342786e2-f994-4b80-a856-146476af3a1c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:42.672586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-342786e2-f994-4b80-a856-146476af3a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:42.739034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:42.740927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:42.755570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 958/1925] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:42.769465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb508966-70cd-4dbf-bf4d-e06bd5f902e3 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:42.770112 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb508966-70cd-4dbf-bf4d-e06bd5f902e3 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:42.770112 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb508966-70cd-4dbf-bf4d-e06bd5f902e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:42.797280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-eb508966-70cd-4dbf-bf4d-e06bd5f902e3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:42.798551 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-eb508966-70cd-4dbf-bf4d-e06bd5f902e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:42.815210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 959/1926] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:42.816380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb508966-70cd-4dbf-bf4d-e06bd5f902e3 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:42.819224 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53323f0-6421-497f-9203-488f1e1261b6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:42.824621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:42.825332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:42.825635 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:42.825909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] PATH_INFO: `/v3/users/00bcf20fe8cd44f0b95e013c9906a695` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:42.827257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00bcf20fe8cd44f0b95e013c9906a695)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:42.827433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb508966-70cd-4dbf-bf4d-e06bd5f902e3 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:42.829268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:42.833927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbfc18-13c6-494e-b240-30a1257e3805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:42.835424 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbfc18-13c6-494e-b240-30a1257e3805 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:42.835716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbfc18-13c6-494e-b240-30a1257e3805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:42.835985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dbfc18-13c6-494e-b240-30a1257e3805 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:42.836874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbfc18-13c6-494e-b240-30a1257e3805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:42.841764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbfc18-13c6-494e-b240-30a1257e3805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:42.841764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dbfc18-13c6-494e-b240-30a1257e3805 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:42.853379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 960/1927] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:51:42.859872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbfc18-13c6-494e-b240-30a1257e3805 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:42.877865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dbfc18-13c6-494e-b240-30a1257e3805 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:42.886765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f567c03-061c-4172-a0b1-c3849d4b732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:42.887902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f567c03-061c-4172-a0b1-c3849d4b732c admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:42.888194 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f567c03-061c-4172-a0b1-c3849d4b732c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:42.888477 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f567c03-061c-4172-a0b1-c3849d4b732c admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:42.889152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f567c03-061c-4172-a0b1-c3849d4b732c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:42.891067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f567c03-061c-4172-a0b1-c3849d4b732c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:43.086851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 961/1928] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:42 2022] POST /identity/v3/projects => generated 401 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:43.091859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f567c03-061c-4172-a0b1-c3849d4b732c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:43.177504 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00bcf20fe8cd44f0b95e013c9906a695'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:43.185258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00bcf20fe8cd44f0b95e013c9906a695'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:43.185979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00bcf20fe8cd44f0b95e013c9906a695'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:43.187353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f567c03-061c-4172-a0b1-c3849d4b732c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:43.195612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f364e3-476b-4c84-be55-8475bd18272e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:43.196723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f364e3-476b-4c84-be55-8475bd18272e admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:43.197231 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f364e3-476b-4c84-be55-8475bd18272e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:43.197710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f364e3-476b-4c84-be55-8475bd18272e admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:43.198840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f364e3-476b-4c84-be55-8475bd18272e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:43.203272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f364e3-476b-4c84-be55-8475bd18272e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:43.356812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00bcf20fe8cd44f0b95e013c9906a695'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:43.359010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-40a1ac14-3127-4700-ad6f-b0ce83f9faa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00bcf20fe8cd44f0b95e013c9906a695'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:43.365345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 962/1929] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:43 2022] POST /identity/v3/users => generated 301 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:43.369799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f364e3-476b-4c84-be55-8475bd18272e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:43.373377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-64f364e3-476b-4c84-be55-8475bd18272e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:43.392028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 968/1930] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:42 2022] DELETE /identity/v3/users/00bcf20fe8cd44f0b95e013c9906a695 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:43.396852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f364e3-476b-4c84-be55-8475bd18272e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:43.398187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d25a5-24cb-44a1-9876-646845deda3e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:43.398482 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d25a5-24cb-44a1-9876-646845deda3e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:43.398742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d25a5-24cb-44a1-9876-646845deda3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:43.431467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4c0d25a5-24cb-44a1-9876-646845deda3e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:43.433604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4c0d25a5-24cb-44a1-9876-646845deda3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:43.491151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc48ad-657e-46f8-acb3-d2ef832d200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:43.491780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc48ad-657e-46f8-acb3-d2ef832d200f admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:43.492203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc48ad-657e-46f8-acb3-d2ef832d200f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:43.492474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc48ad-657e-46f8-acb3-d2ef832d200f admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:43.493169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc48ad-657e-46f8-acb3-d2ef832d200f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:43.494831 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc48ad-657e-46f8-acb3-d2ef832d200f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:43.511422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 963/1931] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:43.516881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc48ad-657e-46f8-acb3-d2ef832d200f admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:43.533251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 969/1932] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:43.537468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc48ad-657e-46f8-acb3-d2ef832d200f admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:43.537468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280184d3-1b68-422c-b58e-3569a798c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:43.537468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280184d3-1b68-422c-b58e-3569a798c29b admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:43.537468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280184d3-1b68-422c-b58e-3569a798c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:43.538177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280184d3-1b68-422c-b58e-3569a798c29b admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:43.538177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280184d3-1b68-422c-b58e-3569a798c29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:43.538606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d25a5-24cb-44a1-9876-646845deda3e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:43.538961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280184d3-1b68-422c-b58e-3569a798c29b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:43.540112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4c0d25a5-24cb-44a1-9876-646845deda3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:43.554517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 964/1933] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:43.555537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280184d3-1b68-422c-b58e-3569a798c29b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:43.566963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280184d3-1b68-422c-b58e-3569a798c29b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:43.577034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64a87a-b5bf-4863-a0d4-9320cf377038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:43.577034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64a87a-b5bf-4863-a0d4-9320cf377038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:43.577034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64a87a-b5bf-4863-a0d4-9320cf377038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:43.577034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64a87a-b5bf-4863-a0d4-9320cf377038 admin admin] PATH_INFO: `/v3/projects/5644c3c12ed84cf5844ba8a002eed0e5/users/55bf97ab7ac74eb097bda6060a134b56/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:43.596091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64a87a-b5bf-4863-a0d4-9320cf377038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5644c3c12ed84cf5844ba8a002eed0e5, user_id=55bf97ab7ac74eb097bda6060a134b56, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:43.600318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64a87a-b5bf-4863-a0d4-9320cf377038 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:43.628554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d25a5-24cb-44a1-9876-646845deda3e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:43.632592 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed249a4-54a0-410c-bfc8-34321ecd4759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:43.633283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed249a4-54a0-410c-bfc8-34321ecd4759 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:43.633723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed249a4-54a0-410c-bfc8-34321ecd4759 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:43.634032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed249a4-54a0-410c-bfc8-34321ecd4759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:43.646799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed249a4-54a0-410c-bfc8-34321ecd4759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:43.648372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed249a4-54a0-410c-bfc8-34321ecd4759 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:43.659402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 970/1934] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:43.685488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 965/1935] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:43 2022] PUT /identity/v3/projects/5644c3c12ed84cf5844ba8a002eed0e5/users/55bf97ab7ac74eb097bda6060a134b56/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:43.702944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e3381-201f-44f3-84f9-24bfd37af2a6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:43.703228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e3381-201f-44f3-84f9-24bfd37af2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:43.703486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2e3381-201f-44f3-84f9-24bfd37af2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:43.742315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fd2e3381-201f-44f3-84f9-24bfd37af2a6 None None] MFA Rules not processed for user `55bf97ab7ac74eb097bda6060a134b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:43.744678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fd2e3381-201f-44f3-84f9-24bfd37af2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:43.846404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 971/1936] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:43 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:43.851187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64a87a-b5bf-4863-a0d4-9320cf377038 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:43.962007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64a87a-b5bf-4863-a0d4-9320cf377038 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:43.968514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b51b01-d2ce-4d89-8f2a-c0e118e7cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:43.969596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b51b01-d2ce-4d89-8f2a-c0e118e7cba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:43.969978 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b51b01-d2ce-4d89-8f2a-c0e118e7cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:43.970502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b51b01-d2ce-4d89-8f2a-c0e118e7cba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:43.971306 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b51b01-d2ce-4d89-8f2a-c0e118e7cba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:43.973646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b51b01-d2ce-4d89-8f2a-c0e118e7cba7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:44.006901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:44.140915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 966/1937] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:43 2022] POST /identity/v3/projects => generated 399 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:44.147094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e3381-201f-44f3-84f9-24bfd37af2a6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:44.159099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2e3381-201f-44f3-84f9-24bfd37af2a6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:44.234467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e466b-3656-44f7-970b-bd633395bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:44.235280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e466b-3656-44f7-970b-bd633395bd25 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:44.235470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e466b-3656-44f7-970b-bd633395bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:44.235741 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e466b-3656-44f7-970b-bd633395bd25 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:44.236377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e466b-3656-44f7-970b-bd633395bd25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:44.238339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e466b-3656-44f7-970b-bd633395bd25 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:44.255729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b51b01-d2ce-4d89-8f2a-c0e118e7cba7 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:44.257835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-05b51b01-d2ce-4d89-8f2a-c0e118e7cba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:44.272044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b51b01-d2ce-4d89-8f2a-c0e118e7cba7 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:44.277283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:44.278028 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:44.278805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:44.279099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] PATH_INFO: `/v3/projects/5150b136d97047b490ffd1df8fd80693` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:44.280416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5150b136d97047b490ffd1df8fd80693)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:44.282706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:44.356566 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 972/1938] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:44 2022] POST /identity/v3/users => generated 306 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:44.363601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e466b-3656-44f7-970b-bd633395bd25 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:44.373804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e466b-3656-44f7-970b-bd633395bd25 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:44.378726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bbf82-c3f4-4939-b4cd-43c42029dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:44.379359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bbf82-c3f4-4939-b4cd-43c42029dfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:44.379641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bbf82-c3f4-4939-b4cd-43c42029dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:44.379919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bbf82-c3f4-4939-b4cd-43c42029dfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:44.380614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bbf82-c3f4-4939-b4cd-43c42029dfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:44.382395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bbf82-c3f4-4939-b4cd-43c42029dfe7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:44.396884 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 973/1939] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:44.397920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bbf82-c3f4-4939-b4cd-43c42029dfe7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:44.409461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bbf82-c3f4-4939-b4cd-43c42029dfe7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:44.414725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ea2c7-d0ce-407f-829c-c9f4bb5c2aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:44.415679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ea2c7-d0ce-407f-829c-c9f4bb5c2aee admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:44.422906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ea2c7-d0ce-407f-829c-c9f4bb5c2aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:44.423442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ea2c7-d0ce-407f-829c-c9f4bb5c2aee admin admin] PATH_INFO: `/v3/projects/78113160641442c6b245eae4e29cff46/users/2a84cad612ef4a268c893bdc557cb873/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:44.445578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ea2c7-d0ce-407f-829c-c9f4bb5c2aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=78113160641442c6b245eae4e29cff46, user_id=2a84cad612ef4a268c893bdc557cb873, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:44.451864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ea2c7-d0ce-407f-829c-c9f4bb5c2aee admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:44.457010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5150b136d97047b490ffd1df8fd80693', 'request_id': 'req-e21da080-db47-4536-bd64-6e5bb49a7090'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:44.472076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5150b136d97047b490ffd1df8fd80693', 'request_id': 'req-e21da080-db47-4536-bd64-6e5bb49a7090'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:44.614431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5150b136d97047b490ffd1df8fd80693', 'request_id': 'req-e21da080-db47-4536-bd64-6e5bb49a7090'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:44.623317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 974/1940] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:44 2022] PUT /identity/v3/projects/78113160641442c6b245eae4e29cff46/users/2a84cad612ef4a268c893bdc557cb873/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:44.627701 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ea2c7-d0ce-407f-829c-c9f4bb5c2aee admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:44.627701 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e94ea2c7-d0ce-407f-829c-c9f4bb5c2aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:44.633582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] The token cache is being invalidate because project 5150b136d97047b490ffd1df8fd80693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:44.634020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:44.634717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:44.637090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 967/1941] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:44 2022] DELETE /identity/v3/projects/5150b136d97047b490ffd1df8fd80693 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:44.639407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:44.641919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:44.720521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ea2c7-d0ce-407f-829c-c9f4bb5c2aee admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:44.726378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf2373-fff8-44db-b629-e8f6e48d5141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:44.727397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf2373-fff8-44db-b629-e8f6e48d5141 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:44.734279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf2373-fff8-44db-b629-e8f6e48d5141 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:44.734279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf2373-fff8-44db-b629-e8f6e48d5141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:44.734279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-28bf2373-fff8-44db-b629-e8f6e48d5141 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:44.747268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21da080-db47-4536-bd64-6e5bb49a7090 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:44.822471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7811-92e5-44f9-9e84-e34d4d70cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:44.823338 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7811-92e5-44f9-9e84-e34d4d70cdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:44.823850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7811-92e5-44f9-9e84-e34d4d70cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:44.824634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf7811-92e5-44f9-9e84-e34d4d70cdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:44.828322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf7811-92e5-44f9-9e84-e34d4d70cdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:44.828747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf7811-92e5-44f9-9e84-e34d4d70cdd7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:44.840830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf2373-fff8-44db-b629-e8f6e48d5141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:44.841126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 968/1942] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:44.842391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7811-92e5-44f9-9e84-e34d4d70cdd7 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:44.842589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf2373-fff8-44db-b629-e8f6e48d5141 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:44.846621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e6bf7811-92e5-44f9-9e84-e34d4d70cdd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:44.856269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 975/1943] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:44.856939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf2373-fff8-44db-b629-e8f6e48d5141 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:44.872322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf7811-92e5-44f9-9e84-e34d4d70cdd7 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:44.872948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf2373-fff8-44db-b629-e8f6e48d5141 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:44.875341 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:44.875603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3270023b-6475-44ec-a9dc-1c31268ff058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:44.876077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:44.876187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270023b-6475-44ec-a9dc-1c31268ff058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:44.876364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:44.876537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270023b-6475-44ec-a9dc-1c31268ff058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:44.876766 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3270023b-6475-44ec-a9dc-1c31268ff058 admin admin] PATH_INFO: `/v3/projects/78113160641442c6b245eae4e29cff46/users/2a84cad612ef4a268c893bdc557cb873/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:44.876889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] PATH_INFO: `/v3/users/c3b889d0796c47d2aa04c427505db344` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:44.878181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b889d0796c47d2aa04c427505db344)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:44.878898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270023b-6475-44ec-a9dc-1c31268ff058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78113160641442c6b245eae4e29cff46, user_id=2a84cad612ef4a268c893bdc557cb873, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:44.886423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:44.886728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3270023b-6475-44ec-a9dc-1c31268ff058 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:44.889844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:44.901802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 976/1944] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:44 2022] PUT /identity/v3/projects/78113160641442c6b245eae4e29cff46/users/2a84cad612ef4a268c893bdc557cb873/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:44.920301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6942c-5d5e-4269-b022-47cddc8aa4cd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:44.920687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6942c-5d5e-4269-b022-47cddc8aa4cd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:44.920891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6942c-5d5e-4269-b022-47cddc8aa4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:44.961927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e9b6942c-5d5e-4269-b022-47cddc8aa4cd None None] MFA Rules not processed for user `2a84cad612ef4a268c893bdc557cb873`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:44.963162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e9b6942c-5d5e-4269-b022-47cddc8aa4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:45.058366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 977/1945] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:44 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:45.071570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6942c-5d5e-4269-b022-47cddc8aa4cd None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:45.073076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e9b6942c-5d5e-4269-b022-47cddc8aa4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:45.146599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b889d0796c47d2aa04c427505db344'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:45.164059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b889d0796c47d2aa04c427505db344'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:45.164853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b889d0796c47d2aa04c427505db344'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:45.165760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6942c-5d5e-4269-b022-47cddc8aa4cd None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:45.170117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19976a9d-03bb-4a0f-b8b3-d0f911072d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:45.170738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19976a9d-03bb-4a0f-b8b3-d0f911072d80 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:45.171011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19976a9d-03bb-4a0f-b8b3-d0f911072d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:45.171283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19976a9d-03bb-4a0f-b8b3-d0f911072d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:45.181668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19976a9d-03bb-4a0f-b8b3-d0f911072d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:45.183107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19976a9d-03bb-4a0f-b8b3-d0f911072d80 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:45.195186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 978/1946] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:45 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:45.271317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b889d0796c47d2aa04c427505db344'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:45.296291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b889d0796c47d2aa04c427505db344'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:45.310894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 969/1947] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:44 2022] DELETE /identity/v3/users/c3b889d0796c47d2aa04c427505db344 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:45.831358 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:46.042644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19976a9d-03bb-4a0f-b8b3-d0f911072d80 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:46.054580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19976a9d-03bb-4a0f-b8b3-d0f911072d80 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:46.120444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692e276-d9cf-4bd5-9287-7bcda8dd6516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:46.121136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e276-d9cf-4bd5-9287-7bcda8dd6516 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:46.121457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e276-d9cf-4bd5-9287-7bcda8dd6516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:46.122400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692e276-d9cf-4bd5-9287-7bcda8dd6516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:46.126572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2692e276-d9cf-4bd5-9287-7bcda8dd6516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:46.237801 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:46.239298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:46.259894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692e276-d9cf-4bd5-9287-7bcda8dd6516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:46.259894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692e276-d9cf-4bd5-9287-7bcda8dd6516 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:46.292793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 979/1948] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:46.393970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f63a2e-50fc-45b8-90d7-7f209be23947 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:46.401946 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:46.404010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:46.404374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:46.404750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] PATH_INFO: `/v3/projects/426918075f4041aba95558379ba42c9f` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:46.407230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426918075f4041aba95558379ba42c9f)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:46.409936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:46.630899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426918075f4041aba95558379ba42c9f', 'request_id': 'req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:46.640183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426918075f4041aba95558379ba42c9f', 'request_id': 'req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:46.883751 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426918075f4041aba95558379ba42c9f', 'request_id': 'req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:46.919246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] The token cache is being invalidate because project 426918075f4041aba95558379ba42c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:46.919246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:46.920062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f91d42ae-913d-42fb-8ff1-b6d1a28f12a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:46.922072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 970/1949] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:46 2022] DELETE /identity/v3/projects/426918075f4041aba95558379ba42c9f => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:46.926788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7bb44-f838-4d69-abb6-6f1891798720 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:46.927990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7bb44-f838-4d69-abb6-6f1891798720 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:46.928862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c7bb44-f838-4d69-abb6-6f1891798720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:46.960906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-27c7bb44-f838-4d69-abb6-6f1891798720 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:46.962159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-27c7bb44-f838-4d69-abb6-6f1891798720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:47.057241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 980/1950] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:47.067769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251206-2989-470b-b842-d05215aa8ed5 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:47.068434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251206-2989-470b-b842-d05215aa8ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:47.069133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37251206-2989-470b-b842-d05215aa8ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:47.107315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-37251206-2989-470b-b842-d05215aa8ed5 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:47.107315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-37251206-2989-470b-b842-d05215aa8ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:47.116031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 971/1951] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:47.120723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7bb44-f838-4d69-abb6-6f1891798720 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:47.136078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c7bb44-f838-4d69-abb6-6f1891798720 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:47.142510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45629149-b915-48d9-a22d-3c97fb36feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:47.143204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45629149-b915-48d9-a22d-3c97fb36feb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:47.143431 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45629149-b915-48d9-a22d-3c97fb36feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:47.143705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45629149-b915-48d9-a22d-3c97fb36feb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:47.144431 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45629149-b915-48d9-a22d-3c97fb36feb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:47.144778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45629149-b915-48d9-a22d-3c97fb36feb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:47.146424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45629149-b915-48d9-a22d-3c97fb36feb1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:47.173160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 981/1952] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:51:47.174787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37251206-2989-470b-b842-d05215aa8ed5 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:47.200224 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37251206-2989-470b-b842-d05215aa8ed5 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:47.206078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018e1f6-72f6-47a3-b69b-b6c41bdee692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:47.206514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018e1f6-72f6-47a3-b69b-b6c41bdee692 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:47.206851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018e1f6-72f6-47a3-b69b-b6c41bdee692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:47.207892 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018e1f6-72f6-47a3-b69b-b6c41bdee692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:47.208754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018e1f6-72f6-47a3-b69b-b6c41bdee692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:47.211596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018e1f6-72f6-47a3-b69b-b6c41bdee692 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:47.398778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 972/1953] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:47 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:47.405480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45629149-b915-48d9-a22d-3c97fb36feb1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:47.422405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45629149-b915-48d9-a22d-3c97fb36feb1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:47.477219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:47.494919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f20353-35e3-403e-ae86-4f3c67025d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:47.494919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f20353-35e3-403e-ae86-4f3c67025d67 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:47.494919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f20353-35e3-403e-ae86-4f3c67025d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:47.494919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f20353-35e3-403e-ae86-4f3c67025d67 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:47.495443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f20353-35e3-403e-ae86-4f3c67025d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:47.497549 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f20353-35e3-403e-ae86-4f3c67025d67 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:47.621214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 982/1954] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:47 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:47.622436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018e1f6-72f6-47a3-b69b-b6c41bdee692 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:47.634458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018e1f6-72f6-47a3-b69b-b6c41bdee692 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:47.639928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8a1fd-47d6-4721-9b6e-6827d7d70182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:47.640835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8a1fd-47d6-4721-9b6e-6827d7d70182 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:47.641253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8a1fd-47d6-4721-9b6e-6827d7d70182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:47.643563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8a1fd-47d6-4721-9b6e-6827d7d70182 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:47.643563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8a1fd-47d6-4721-9b6e-6827d7d70182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:47.644252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8a1fd-47d6-4721-9b6e-6827d7d70182 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:47.659315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 973/1955] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:47.664109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f20353-35e3-403e-ae86-4f3c67025d67 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:47.679045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f20353-35e3-403e-ae86-4f3c67025d67 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:47.684253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea512f5-4feb-4528-b5b1-c0fdb36dcc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:47.684932 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea512f5-4feb-4528-b5b1-c0fdb36dcc44 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:47.685386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea512f5-4feb-4528-b5b1-c0fdb36dcc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:47.685818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea512f5-4feb-4528-b5b1-c0fdb36dcc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:47.686754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea512f5-4feb-4528-b5b1-c0fdb36dcc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:47.688460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea512f5-4feb-4528-b5b1-c0fdb36dcc44 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:47.704340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 983/1956] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:47.705776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8a1fd-47d6-4721-9b6e-6827d7d70182 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:47.719752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8a1fd-47d6-4721-9b6e-6827d7d70182 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:47.726012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce07c0d-ab41-499f-b5e5-7fa974d179d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:47.726782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07c0d-ab41-499f-b5e5-7fa974d179d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:47.727127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07c0d-ab41-499f-b5e5-7fa974d179d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:47.727402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce07c0d-ab41-499f-b5e5-7fa974d179d0 admin admin] PATH_INFO: `/v3/projects/925d9cad5d8d4efaa4cbcc2ee459df25/users/7ba37618713243bfbebb405c5d4e20ab/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:47.744168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce07c0d-ab41-499f-b5e5-7fa974d179d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925d9cad5d8d4efaa4cbcc2ee459df25, user_id=7ba37618713243bfbebb405c5d4e20ab, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:47.747547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce07c0d-ab41-499f-b5e5-7fa974d179d0 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:47.842674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 974/1957] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:47 2022] PUT /identity/v3/projects/925d9cad5d8d4efaa4cbcc2ee459df25/users/7ba37618713243bfbebb405c5d4e20ab/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:47.853313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a0d81-4453-4529-9ff1-9f2d8a6ec8ce None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:47.853505 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a0d81-4453-4529-9ff1-9f2d8a6ec8ce None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:47.853779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a0d81-4453-4529-9ff1-9f2d8a6ec8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:47.883437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7a3a0d81-4453-4529-9ff1-9f2d8a6ec8ce None None] MFA Rules not processed for user `7ba37618713243bfbebb405c5d4e20ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:47.884715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7a3a0d81-4453-4529-9ff1-9f2d8a6ec8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:47.968214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 984/1958] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:47.969430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce07c0d-ab41-499f-b5e5-7fa974d179d0 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:48.066088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce07c0d-ab41-499f-b5e5-7fa974d179d0 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:48.072202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31aa8d-ed47-4a0f-80a0-820e91f97fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:48.073267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31aa8d-ed47-4a0f-80a0-820e91f97fdb admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:48.073743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31aa8d-ed47-4a0f-80a0-820e91f97fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:48.074348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31aa8d-ed47-4a0f-80a0-820e91f97fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:48.075720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31aa8d-ed47-4a0f-80a0-820e91f97fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:48.077789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31aa8d-ed47-4a0f-80a0-820e91f97fdb admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:48.083082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:48.223812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 975/1959] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:47 2022] POST /identity/v3/projects => generated 365 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:48.229354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a0d81-4453-4529-9ff1-9f2d8a6ec8ce None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:48.255679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a0d81-4453-4529-9ff1-9f2d8a6ec8ce None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:48.323772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbda7d-31ec-49ea-84cb-f9bba3515ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:48.327325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbda7d-31ec-49ea-84cb-f9bba3515ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:48.327915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbda7d-31ec-49ea-84cb-f9bba3515ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:48.331135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbda7d-31ec-49ea-84cb-f9bba3515ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:48.331135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbda7d-31ec-49ea-84cb-f9bba3515ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:48.334021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbda7d-31ec-49ea-84cb-f9bba3515ed9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:48.477368 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 985/1960] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:48 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:48.480693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31aa8d-ed47-4a0f-80a0-820e91f97fdb admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:48.511123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31aa8d-ed47-4a0f-80a0-820e91f97fdb admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:48.527309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b75710-874c-402c-811d-b967e3d38851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:48.529045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75710-874c-402c-811d-b967e3d38851 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:48.529700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75710-874c-402c-811d-b967e3d38851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:48.530980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b75710-874c-402c-811d-b967e3d38851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:48.544728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b75710-874c-402c-811d-b967e3d38851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:48.549397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b75710-874c-402c-811d-b967e3d38851 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:48.576104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 976/1961] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:48.578675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbda7d-31ec-49ea-84cb-f9bba3515ed9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:48.590128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbda7d-31ec-49ea-84cb-f9bba3515ed9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:48.597029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0506995-0189-403e-b52a-eecc34a531ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:48.597721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0506995-0189-403e-b52a-eecc34a531ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:48.598005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0506995-0189-403e-b52a-eecc34a531ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:48.598284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0506995-0189-403e-b52a-eecc34a531ec admin admin] PATH_INFO: `/v3/projects/d93f178be1e343238ebfa373d36a6cfd/users/9f71c2d904a84cd28f9c13a25de06d03/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:48.626050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0506995-0189-403e-b52a-eecc34a531ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93f178be1e343238ebfa373d36a6cfd, user_id=9f71c2d904a84cd28f9c13a25de06d03, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:48.628935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0506995-0189-403e-b52a-eecc34a531ec admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:48.773327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 986/1962] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:48 2022] PUT /identity/v3/projects/d93f178be1e343238ebfa373d36a6cfd/users/9f71c2d904a84cd28f9c13a25de06d03/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:48.777636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b75710-874c-402c-811d-b967e3d38851 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:48.789370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b75710-874c-402c-811d-b967e3d38851 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:48.863941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9792ab5-4b2e-4cfa-9697-6acdd4b03e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:48.864696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9792ab5-4b2e-4cfa-9697-6acdd4b03e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:48.865004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9792ab5-4b2e-4cfa-9697-6acdd4b03e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:48.865299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9792ab5-4b2e-4cfa-9697-6acdd4b03e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:48.865952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9792ab5-4b2e-4cfa-9697-6acdd4b03e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:48.867588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9792ab5-4b2e-4cfa-9697-6acdd4b03e5d admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:48.878894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 977/1963] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:48.882988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0506995-0189-403e-b52a-eecc34a531ec admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:48.894365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0506995-0189-403e-b52a-eecc34a531ec admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:48.899166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564706-c38f-40a1-816c-666e61b80d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:48.899830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564706-c38f-40a1-816c-666e61b80d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:48.900108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564706-c38f-40a1-816c-666e61b80d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:48.900391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de564706-c38f-40a1-816c-666e61b80d77 admin admin] PATH_INFO: `/v3/projects/d93f178be1e343238ebfa373d36a6cfd/users/9f71c2d904a84cd28f9c13a25de06d03/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:48.902427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564706-c38f-40a1-816c-666e61b80d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d93f178be1e343238ebfa373d36a6cfd, user_id=9f71c2d904a84cd28f9c13a25de06d03, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:48.905657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de564706-c38f-40a1-816c-666e61b80d77 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:48.916415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 987/1964] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:48 2022] PUT /identity/v3/projects/d93f178be1e343238ebfa373d36a6cfd/users/9f71c2d904a84cd28f9c13a25de06d03/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:48.927780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbdedb-2bf1-414a-815c-29d415a2fe9b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:48.928159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbdedb-2bf1-414a-815c-29d415a2fe9b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:48.928526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbdedb-2bf1-414a-815c-29d415a2fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:48.957524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c9cbdedb-2bf1-414a-815c-29d415a2fe9b None None] MFA Rules not processed for user `9f71c2d904a84cd28f9c13a25de06d03`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:48.958746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c9cbdedb-2bf1-414a-815c-29d415a2fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:49.088592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 978/1965] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:49.104655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564706-c38f-40a1-816c-666e61b80d77 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:49.111014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-de564706-c38f-40a1-816c-666e61b80d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:49.203208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de564706-c38f-40a1-816c-666e61b80d77 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:49.214626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d388ad4-a5e6-4523-9c42-8b7cf3261e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:49.215578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d388ad4-a5e6-4523-9c42-8b7cf3261e21 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:49.216618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d388ad4-a5e6-4523-9c42-8b7cf3261e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:49.216916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d388ad4-a5e6-4523-9c42-8b7cf3261e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:49.229701 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d388ad4-a5e6-4523-9c42-8b7cf3261e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:49.231157 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d388ad4-a5e6-4523-9c42-8b7cf3261e21 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:49.243707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 988/1966] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:49.556072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:49.736534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbdedb-2bf1-414a-815c-29d415a2fe9b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:49.759572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbdedb-2bf1-414a-815c-29d415a2fe9b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:49.771104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca6d6-1029-4440-8099-98cc9d10dd0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:49.772109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca6d6-1029-4440-8099-98cc9d10dd0d service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:49.772360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca6d6-1029-4440-8099-98cc9d10dd0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:49.772943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca6d6-1029-4440-8099-98cc9d10dd0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:49.901322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfca6d6-1029-4440-8099-98cc9d10dd0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:49.903605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfca6d6-1029-4440-8099-98cc9d10dd0d service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:49.914227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 979/1967] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:50.654548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:50.874073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d388ad4-a5e6-4523-9c42-8b7cf3261e21 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:50.875903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3d388ad4-a5e6-4523-9c42-8b7cf3261e21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:50.967248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d388ad4-a5e6-4523-9c42-8b7cf3261e21 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:50.970898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:50.971577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:50.971854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:50.972120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] PATH_INFO: `/v3/users/2698bc78f2e3432faf8fd2a1d16d3b3a` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:50.973340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2698bc78f2e3432faf8fd2a1d16d3b3a)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:50.975350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:51.463983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2698bc78f2e3432faf8fd2a1d16d3b3a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:51.471938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2698bc78f2e3432faf8fd2a1d16d3b3a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:51.472924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2698bc78f2e3432faf8fd2a1d16d3b3a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:51.550689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2698bc78f2e3432faf8fd2a1d16d3b3a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:51.551320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-eb132060-59da-442c-81eb-bf1ffa35b58b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2698bc78f2e3432faf8fd2a1d16d3b3a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:51.571339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 989/1968] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:50 2022] DELETE /identity/v3/users/2698bc78f2e3432faf8fd2a1d16d3b3a => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:51.882941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca6d6-1029-4440-8099-98cc9d10dd0d service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:51.899902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfca6d6-1029-4440-8099-98cc9d10dd0d service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:51.965172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:51.965877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:51.966226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:51.966568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] PATH_INFO: `/v3/projects/be7f29d3c82242b7bdc4ead9fa6f4afc` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:51.968020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7f29d3c82242b7bdc4ead9fa6f4afc)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:51.970123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:52.307797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'request_id': 'req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:52.314743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'request_id': 'req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:52.471075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7f29d3c82242b7bdc4ead9fa6f4afc', 'request_id': 'req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:52.484152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] The token cache is being invalidate because project be7f29d3c82242b7bdc4ead9fa6f4afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:52.484152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:52.484152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-1d9e9c67-87f9-40cf-8bab-40aa314f1c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:52.485653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 980/1969] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:51 2022] DELETE /identity/v3/projects/be7f29d3c82242b7bdc4ead9fa6f4afc => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:52.490797 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a5bf-6f58-49aa-ab7c-76b861580602 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:52.491323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a5bf-6f58-49aa-ab7c-76b861580602 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:52.491323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1a5bf-6f58-49aa-ab7c-76b861580602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:52.512812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-28f1a5bf-6f58-49aa-ab7c-76b861580602 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:52.514064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-28f1a5bf-6f58-49aa-ab7c-76b861580602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:52.576274 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 990/1970] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:52.586566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bebf2c-7a76-4532-915b-03fe20bc60a0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:52.586819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bebf2c-7a76-4532-915b-03fe20bc60a0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:52.587095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bebf2c-7a76-4532-915b-03fe20bc60a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:52.612644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c3bebf2c-7a76-4532-915b-03fe20bc60a0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:52.613889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c3bebf2c-7a76-4532-915b-03fe20bc60a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:52.622290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 981/1971] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:52.626794 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1a5bf-6f58-49aa-ab7c-76b861580602 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:52.637655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1a5bf-6f58-49aa-ab7c-76b861580602 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:52.642500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d578-d22e-4dd3-a8d0-eea18720a68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:52.643118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d578-d22e-4dd3-a8d0-eea18720a68b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:52.643440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d578-d22e-4dd3-a8d0-eea18720a68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:52.643743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d578-d22e-4dd3-a8d0-eea18720a68b admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:52.644393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d578-d22e-4dd3-a8d0-eea18720a68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:52.644729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d578-d22e-4dd3-a8d0-eea18720a68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:52.646564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e34d578-d22e-4dd3-a8d0-eea18720a68b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:52.659877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 991/1972] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:51:52.665309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bebf2c-7a76-4532-915b-03fe20bc60a0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:52.675221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bebf2c-7a76-4532-915b-03fe20bc60a0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:52.679864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c6dc8-0c65-4bed-a8dc-49f1b4b5b385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:52.680466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c6dc8-0c65-4bed-a8dc-49f1b4b5b385 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:52.680796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c6dc8-0c65-4bed-a8dc-49f1b4b5b385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:52.681109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c6dc8-0c65-4bed-a8dc-49f1b4b5b385 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:52.681877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c6dc8-0c65-4bed-a8dc-49f1b4b5b385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:52.683781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c6dc8-0c65-4bed-a8dc-49f1b4b5b385 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:52.802138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 982/1973] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:52 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:52.807616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d578-d22e-4dd3-a8d0-eea18720a68b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:52.817995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d578-d22e-4dd3-a8d0-eea18720a68b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:52.881244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6751285-6e39-424c-b799-eb5779aa88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:52.881879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751285-6e39-424c-b799-eb5779aa88e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:52.882156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751285-6e39-424c-b799-eb5779aa88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:52.882443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6751285-6e39-424c-b799-eb5779aa88e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:52.883081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6751285-6e39-424c-b799-eb5779aa88e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:52.885079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6751285-6e39-424c-b799-eb5779aa88e8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:53.031454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 992/1974] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:52 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:53.035674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c6dc8-0c65-4bed-a8dc-49f1b4b5b385 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:53.046468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c6dc8-0c65-4bed-a8dc-49f1b4b5b385 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:53.051391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfe2f8-1174-455a-a8b1-f4e1811b4e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:53.052017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfe2f8-1174-455a-a8b1-f4e1811b4e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:53.052298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfe2f8-1174-455a-a8b1-f4e1811b4e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:53.052637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfe2f8-1174-455a-a8b1-f4e1811b4e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:53.053269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfe2f8-1174-455a-a8b1-f4e1811b4e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:53.054912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bfe2f8-1174-455a-a8b1-f4e1811b4e46 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:53.066814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 983/1975] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:53.071166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6751285-6e39-424c-b799-eb5779aa88e8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:53.084157 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6751285-6e39-424c-b799-eb5779aa88e8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:53.095560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1785b8-08bc-49d5-b96a-b04fd30822e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:53.095560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1785b8-08bc-49d5-b96a-b04fd30822e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:53.095560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1785b8-08bc-49d5-b96a-b04fd30822e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:53.095560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1785b8-08bc-49d5-b96a-b04fd30822e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:53.096251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1785b8-08bc-49d5-b96a-b04fd30822e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:53.097344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1785b8-08bc-49d5-b96a-b04fd30822e8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:53.112979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 993/1976] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:53.117416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfe2f8-1174-455a-a8b1-f4e1811b4e46 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:53.129119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bfe2f8-1174-455a-a8b1-f4e1811b4e46 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:53.135480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c8dd-3206-4fef-9107-19b755d83a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:53.136151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c8dd-3206-4fef-9107-19b755d83a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:53.136433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c8dd-3206-4fef-9107-19b755d83a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:53.136747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c8dd-3206-4fef-9107-19b755d83a09 admin admin] PATH_INFO: `/v3/projects/f8ca070dc59e4a69bdaca0150f92bcc4/users/3575098818954a949e202397a1b20a6a/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:53.154099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19c8dd-3206-4fef-9107-19b755d83a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ca070dc59e4a69bdaca0150f92bcc4, user_id=3575098818954a949e202397a1b20a6a, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:53.157283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19c8dd-3206-4fef-9107-19b755d83a09 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:53.301199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1785b8-08bc-49d5-b96a-b04fd30822e8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:53.302963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1a1785b8-08bc-49d5-b96a-b04fd30822e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:53.316643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1785b8-08bc-49d5-b96a-b04fd30822e8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:53.321518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:53.322187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:53.322479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:53.330117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] PATH_INFO: `/v3/users/55bf97ab7ac74eb097bda6060a134b56` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:53.330117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bf97ab7ac74eb097bda6060a134b56)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:53.330117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:53.341246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 984/1977] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:53 2022] PUT /identity/v3/projects/f8ca070dc59e4a69bdaca0150f92bcc4/users/3575098818954a949e202397a1b20a6a/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:53.347314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213249fa-f4e2-4b44-b475-c3877a54e953 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:53.347785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213249fa-f4e2-4b44-b475-c3877a54e953 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:53.348173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213249fa-f4e2-4b44-b475-c3877a54e953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:53.370713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-213249fa-f4e2-4b44-b475-c3877a54e953 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:53.372574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-213249fa-f4e2-4b44-b475-c3877a54e953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:53.435472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 985/1978] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:53.445453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213249fa-f4e2-4b44-b475-c3877a54e953 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:53.447467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-213249fa-f4e2-4b44-b475-c3877a54e953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:53.505717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213249fa-f4e2-4b44-b475-c3877a54e953 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:53.509431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da7954-7907-4fb8-8d0f-89ae6df0403e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:53.510068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da7954-7907-4fb8-8d0f-89ae6df0403e service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:53.510349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da7954-7907-4fb8-8d0f-89ae6df0403e service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:53.510624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da7954-7907-4fb8-8d0f-89ae6df0403e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:53.520013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da7954-7907-4fb8-8d0f-89ae6df0403e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:53.521626 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da7954-7907-4fb8-8d0f-89ae6df0403e service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:53.531613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 986/1979] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:53.632499 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bf97ab7ac74eb097bda6060a134b56'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:53.639858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bf97ab7ac74eb097bda6060a134b56'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:53.641071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bf97ab7ac74eb097bda6060a134b56'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:53.688766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:53.756516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bf97ab7ac74eb097bda6060a134b56'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:53.757257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bf97ab7ac74eb097bda6060a134b56'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:53.777327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 994/1980] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:53 2022] DELETE /identity/v3/users/55bf97ab7ac74eb097bda6060a134b56 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:53.782659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a472517-fc6a-4f65-adbb-e4b9a5a7b910 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:53.782917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a472517-fc6a-4f65-adbb-e4b9a5a7b910 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:53.783208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a472517-fc6a-4f65-adbb-e4b9a5a7b910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:53.804246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7a472517-fc6a-4f65-adbb-e4b9a5a7b910 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:53.805518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7a472517-fc6a-4f65-adbb-e4b9a5a7b910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:53.869130 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 987/1981] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:53.883331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:53.885041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:53.958062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4766ebf-efe6-40a7-b34c-966cac4fc4a1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:53.967958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75d3c5-06b1-48db-b81d-ce8dc7c09761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:53.969772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75d3c5-06b1-48db-b81d-ce8dc7c09761 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:53.970130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75d3c5-06b1-48db-b81d-ce8dc7c09761 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:53.970472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75d3c5-06b1-48db-b81d-ce8dc7c09761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:53.982945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75d3c5-06b1-48db-b81d-ce8dc7c09761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:53.983696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75d3c5-06b1-48db-b81d-ce8dc7c09761 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:53.994679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 995/1982] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:54.556994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a472517-fc6a-4f65-adbb-e4b9a5a7b910 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:54.558722 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7a472517-fc6a-4f65-adbb-e4b9a5a7b910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:54.578187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a472517-fc6a-4f65-adbb-e4b9a5a7b910 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:54.585687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:54.586770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:54.587258 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:54.587745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] PATH_INFO: `/v3/projects/5644c3c12ed84cf5844ba8a002eed0e5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:54.589793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5644c3c12ed84cf5844ba8a002eed0e5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:54.591889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:54.769399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5644c3c12ed84cf5844ba8a002eed0e5', 'request_id': 'req-6b3caa8a-699b-4540-bb3e-5287aa4328a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:54.775826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5644c3c12ed84cf5844ba8a002eed0e5', 'request_id': 'req-6b3caa8a-699b-4540-bb3e-5287aa4328a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:54.904846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5644c3c12ed84cf5844ba8a002eed0e5', 'request_id': 'req-6b3caa8a-699b-4540-bb3e-5287aa4328a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:54.905919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:54.916203 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] The token cache is being invalidate because project 5644c3c12ed84cf5844ba8a002eed0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:54.917115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:54.917216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:54.919245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 988/1983] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:54 2022] DELETE /identity/v3/projects/5644c3c12ed84cf5844ba8a002eed0e5 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:54.923582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75d3c5-06b1-48db-b81d-ce8dc7c09761 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:54.934581 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75d3c5-06b1-48db-b81d-ce8dc7c09761 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:54.993978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:54.994641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:54.994917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:54.995236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] PATH_INFO: `/v3/users/2a84cad612ef4a268c893bdc557cb873` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:54.997268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a84cad612ef4a268c893bdc557cb873)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:54.999132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:55.256414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a84cad612ef4a268c893bdc557cb873'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.266158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a84cad612ef4a268c893bdc557cb873'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.267236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a84cad612ef4a268c893bdc557cb873'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.398250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:55.400463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:55.416030 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3caa8a-699b-4540-bb3e-5287aa4328a3 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:55.421355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:55.422149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:55.422505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:55.423541 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] PATH_INFO: `/v3/users/350b3fc884e84dc8973bbeca0edf57db` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:55.424268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=350b3fc884e84dc8973bbeca0edf57db)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:55.426431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:55.462115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a84cad612ef4a268c893bdc557cb873'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.462115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-83f550ee-3c47-4253-b5c1-734f2e5c5f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a84cad612ef4a268c893bdc557cb873'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.473729 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 996/1984] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:54 2022] DELETE /identity/v3/users/2a84cad612ef4a268c893bdc557cb873 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:55.756721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350b3fc884e84dc8973bbeca0edf57db'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.790069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350b3fc884e84dc8973bbeca0edf57db'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.791467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350b3fc884e84dc8973bbeca0edf57db'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.916538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350b3fc884e84dc8973bbeca0edf57db'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.938026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350b3fc884e84dc8973bbeca0edf57db'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:55.950513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 989/1985] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:51:55 2022] DELETE /identity/v3/users/350b3fc884e84dc8973bbeca0edf57db => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:55.952367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251194-bdfc-48a1-aa4f-509208ac0e6c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:55.952894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251194-bdfc-48a1-aa4f-509208ac0e6c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:55.953130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87251194-bdfc-48a1-aa4f-509208ac0e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:55.986553 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-87251194-bdfc-48a1-aa4f-509208ac0e6c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:55.988056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-87251194-bdfc-48a1-aa4f-509208ac0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:56.089691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 997/1986] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:56.105877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:56.105877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:56.167746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251194-bdfc-48a1-aa4f-509208ac0e6c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:56.172131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-87251194-bdfc-48a1-aa4f-509208ac0e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:56.175363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaf175-e423-4941-bcf4-839603cd4f5d admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:56.180375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01222e1f-e5f5-435e-bee4-e0ddaad56140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:56.181599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01222e1f-e5f5-435e-bee4-e0ddaad56140 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.182143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01222e1f-e5f5-435e-bee4-e0ddaad56140 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.182619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01222e1f-e5f5-435e-bee4-e0ddaad56140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.222699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87251194-bdfc-48a1-aa4f-509208ac0e6c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:56.232999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01222e1f-e5f5-435e-bee4-e0ddaad56140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:56.241061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01222e1f-e5f5-435e-bee4-e0ddaad56140 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:56.248045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:56.248993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.251340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.253321 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] PATH_INFO: `/v3/projects/78113160641442c6b245eae4e29cff46` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.258143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78113160641442c6b245eae4e29cff46)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:56.260106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:56.289404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 990/1987] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:51:56.572616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78113160641442c6b245eae4e29cff46', 'request_id': 'req-c32f34ed-a63e-4d26-ad8e-25721270f415'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:56.581222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78113160641442c6b245eae4e29cff46', 'request_id': 'req-c32f34ed-a63e-4d26-ad8e-25721270f415'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:56.729116 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78113160641442c6b245eae4e29cff46', 'request_id': 'req-c32f34ed-a63e-4d26-ad8e-25721270f415'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:56.759225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] The token cache is being invalidate because project 78113160641442c6b245eae4e29cff46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:56.760416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:56.773047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c32f34ed-a63e-4d26-ad8e-25721270f415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:56.782734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 998/1988] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:56 2022] DELETE /identity/v3/projects/78113160641442c6b245eae4e29cff46 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:56.790147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999792cc-db32-4dd0-b7fd-fa3f9dd3ef6a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.790817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999792cc-db32-4dd0-b7fd-fa3f9dd3ef6a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.791386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999792cc-db32-4dd0-b7fd-fa3f9dd3ef6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.836659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-999792cc-db32-4dd0-b7fd-fa3f9dd3ef6a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:56.838019 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-999792cc-db32-4dd0-b7fd-fa3f9dd3ef6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:56.875804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:56.926251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 991/1989] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:56.938389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a89c1-3d43-4902-8100-d3cff91f411f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:56.938894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a89c1-3d43-4902-8100-d3cff91f411f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:56.939428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a89c1-3d43-4902-8100-d3cff91f411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:56.981511 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-949a89c1-3d43-4902-8100-d3cff91f411f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:56.983383 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-949a89c1-3d43-4902-8100-d3cff91f411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:56.998480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 999/1990] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:57.002778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999792cc-db32-4dd0-b7fd-fa3f9dd3ef6a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:57.022468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999792cc-db32-4dd0-b7fd-fa3f9dd3ef6a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:57.031152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eaf7e-5a27-4e25-979b-7107e9b51037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:57.032136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eaf7e-5a27-4e25-979b-7107e9b51037 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.040165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eaf7e-5a27-4e25-979b-7107e9b51037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.040165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987eaf7e-5a27-4e25-979b-7107e9b51037 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.040165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987eaf7e-5a27-4e25-979b-7107e9b51037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:57.040165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987eaf7e-5a27-4e25-979b-7107e9b51037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:57.040165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987eaf7e-5a27-4e25-979b-7107e9b51037 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:57.057264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 992/1991] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:51:57.062166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a89c1-3d43-4902-8100-d3cff91f411f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:57.095940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eaf7e-5a27-4e25-979b-7107e9b51037 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:57.098600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a89c1-3d43-4902-8100-d3cff91f411f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:57.105461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-987eaf7e-5a27-4e25-979b-7107e9b51037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:57.128670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267252e5-17c1-42d8-ab92-5f8f5946882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:57.129562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267252e5-17c1-42d8-ab92-5f8f5946882e admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.130049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267252e5-17c1-42d8-ab92-5f8f5946882e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.130546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267252e5-17c1-42d8-ab92-5f8f5946882e admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.131738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267252e5-17c1-42d8-ab92-5f8f5946882e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:57.133643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987eaf7e-5a27-4e25-979b-7107e9b51037 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:57.135537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267252e5-17c1-42d8-ab92-5f8f5946882e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:57.140877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:57.141769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.143006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.143006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] PATH_INFO: `/v3/projects/6da6a0cd88ef49dab36aae96d700cc79` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.144518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da6a0cd88ef49dab36aae96d700cc79)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:57.146901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:57.378828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1000/1992] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:57 2022] POST /identity/v3/projects => generated 367 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:51:57.382005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267252e5-17c1-42d8-ab92-5f8f5946882e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:57.414724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da6a0cd88ef49dab36aae96d700cc79', 'request_id': 'req-f6199896-35cc-446a-8559-5ed894197449'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:57.426665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da6a0cd88ef49dab36aae96d700cc79', 'request_id': 'req-f6199896-35cc-446a-8559-5ed894197449'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:57.486926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267252e5-17c1-42d8-ab92-5f8f5946882e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:57.491892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a960236-0549-49e3-a184-fe38ca9ee3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:57.492557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a960236-0549-49e3-a184-fe38ca9ee3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.492983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a960236-0549-49e3-a184-fe38ca9ee3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.493268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a960236-0549-49e3-a184-fe38ca9ee3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.493911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a960236-0549-49e3-a184-fe38ca9ee3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:57.496078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a960236-0549-49e3-a184-fe38ca9ee3a8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:57.602057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da6a0cd88ef49dab36aae96d700cc79', 'request_id': 'req-f6199896-35cc-446a-8559-5ed894197449'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:57.607962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1001/1993] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:57 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:57.613662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a960236-0549-49e3-a184-fe38ca9ee3a8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:57.628717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a960236-0549-49e3-a184-fe38ca9ee3a8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:57.636551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c610c29-3687-41b7-9746-6622adb27f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:57.638319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c610c29-3687-41b7-9746-6622adb27f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.638768 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c610c29-3687-41b7-9746-6622adb27f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.639333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c610c29-3687-41b7-9746-6622adb27f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.640449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c610c29-3687-41b7-9746-6622adb27f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:57.644917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] The token cache is being invalidate because project 6da6a0cd88ef49dab36aae96d700cc79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:51:57.644917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:57.648580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f6199896-35cc-446a-8559-5ed894197449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:51:57.650978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c610c29-3687-41b7-9746-6622adb27f3c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:57.659110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 993/1994] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:51:57 2022] DELETE /identity/v3/projects/6da6a0cd88ef49dab36aae96d700cc79 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:57.665301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e5b5-f2ff-416b-ab88-75c8bbf368f6 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.666350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e5b5-f2ff-416b-ab88-75c8bbf368f6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.666702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1002/1995] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:57.667636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973e5b5-f2ff-416b-ab88-75c8bbf368f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.672795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c610c29-3687-41b7-9746-6622adb27f3c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:57.674958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8c610c29-3687-41b7-9746-6622adb27f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:57.717048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c610c29-3687-41b7-9746-6622adb27f3c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:57.724456 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-4973e5b5-f2ff-416b-ab88-75c8bbf368f6 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:57.727897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4973e5b5-f2ff-416b-ab88-75c8bbf368f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:57.730580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc1966-2890-4136-b498-39907a33f6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:57.731999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc1966-2890-4136-b498-39907a33f6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.732765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc1966-2890-4136-b498-39907a33f6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.733422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc1966-2890-4136-b498-39907a33f6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.735385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc1966-2890-4136-b498-39907a33f6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:57.739028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc1966-2890-4136-b498-39907a33f6c4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:57.744587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 994/1996] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:57.752384 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27034-0c17-4a78-9125-5b15f7ecf3d3 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.755968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27034-0c17-4a78-9125-5b15f7ecf3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.756511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd27034-0c17-4a78-9125-5b15f7ecf3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.768661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1003/1997] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:57.771173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc1966-2890-4136-b498-39907a33f6c4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:57.798972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc1966-2890-4136-b498-39907a33f6c4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:57.809086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-2cd27034-0c17-4a78-9125-5b15f7ecf3d3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:57.811038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2cd27034-0c17-4a78-9125-5b15f7ecf3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:57.818627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08942f34-5050-4de3-aa99-799833df1551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:57.831223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 995/1998] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:57.833297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08942f34-5050-4de3-aa99-799833df1551 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.833766 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08942f34-5050-4de3-aa99-799833df1551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.834203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08942f34-5050-4de3-aa99-799833df1551 admin admin] PATH_INFO: `/v3/projects/ccabda91714c4b60ad20f50026f201ef/users/27f6e29b983a4e949d2c6764afb68fc1/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.836687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd27034-0c17-4a78-9125-5b15f7ecf3d3 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:57.859682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd27034-0c17-4a78-9125-5b15f7ecf3d3 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:57.860923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08942f34-5050-4de3-aa99-799833df1551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccabda91714c4b60ad20f50026f201ef, user_id=27f6e29b983a4e949d2c6764afb68fc1, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:57.869763 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08942f34-5050-4de3-aa99-799833df1551 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:57.873431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092b08c-25f7-4840-853f-5910b87aa5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:57.874077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092b08c-25f7-4840-853f-5910b87aa5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.874855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092b08c-25f7-4840-853f-5910b87aa5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.874855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092b08c-25f7-4840-853f-5910b87aa5cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.875365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092b08c-25f7-4840-853f-5910b87aa5cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:51:57.875643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092b08c-25f7-4840-853f-5910b87aa5cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:57.877354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092b08c-25f7-4840-853f-5910b87aa5cc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:57.896056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 996/1999] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:51:57.901563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092b08c-25f7-4840-853f-5910b87aa5cc admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:57.920401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092b08c-25f7-4840-853f-5910b87aa5cc admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:57.926759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939262d-6a6e-416f-a08e-cf0371d01a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:57.927936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939262d-6a6e-416f-a08e-cf0371d01a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.928275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939262d-6a6e-416f-a08e-cf0371d01a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.928649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939262d-6a6e-416f-a08e-cf0371d01a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:57.929843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939262d-6a6e-416f-a08e-cf0371d01a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:57.932308 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939262d-6a6e-416f-a08e-cf0371d01a12 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:57.975595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1004/2000] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:57 2022] PUT /identity/v3/projects/ccabda91714c4b60ad20f50026f201ef/users/27f6e29b983a4e949d2c6764afb68fc1/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:57.978230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c623b79-8f1a-437d-9e5e-d061f1f6a480 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:57.978634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c623b79-8f1a-437d-9e5e-d061f1f6a480 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:57.979041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c623b79-8f1a-437d-9e5e-d061f1f6a480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:58.019126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-5c623b79-8f1a-437d-9e5e-d061f1f6a480 None None] MFA Rules not processed for user `27f6e29b983a4e949d2c6764afb68fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:58.020922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5c623b79-8f1a-437d-9e5e-d061f1f6a480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:58.098305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:51:58.123233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 997/2001] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:57 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:58.129748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939262d-6a6e-416f-a08e-cf0371d01a12 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:58.153632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1005/2002] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:58.157382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c623b79-8f1a-437d-9e5e-d061f1f6a480 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:58.271043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c623b79-8f1a-437d-9e5e-d061f1f6a480 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:58.277070 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be08f86-0002-4dfd-a829-ebed0bcaf593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:58.278237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be08f86-0002-4dfd-a829-ebed0bcaf593 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:58.278521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be08f86-0002-4dfd-a829-ebed0bcaf593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:58.278836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be08f86-0002-4dfd-a829-ebed0bcaf593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:58.279452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be08f86-0002-4dfd-a829-ebed0bcaf593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:58.280403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939262d-6a6e-416f-a08e-cf0371d01a12 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:58.281756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be08f86-0002-4dfd-a829-ebed0bcaf593 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:58.305679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe76e-d9cb-41c1-8cc7-b26dc0c43475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:58.306950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe76e-d9cb-41c1-8cc7-b26dc0c43475 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:58.307570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe76e-d9cb-41c1-8cc7-b26dc0c43475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:58.308229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fe76e-d9cb-41c1-8cc7-b26dc0c43475 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:58.311175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fe76e-d9cb-41c1-8cc7-b26dc0c43475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:58.315762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fe76e-d9cb-41c1-8cc7-b26dc0c43475 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:58.454185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1006/2003] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:51:58 2022] POST /identity/v3/projects => generated 367 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:58.459655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be08f86-0002-4dfd-a829-ebed0bcaf593 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:58.511281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 998/2004] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:58 2022] POST /identity/v3/users => generated 292 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:58.511920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe76e-d9cb-41c1-8cc7-b26dc0c43475 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:58.531659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fe76e-d9cb-41c1-8cc7-b26dc0c43475 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:58.620164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be08f86-0002-4dfd-a829-ebed0bcaf593 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:58.635152 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d5893-9c67-4470-bf6b-500946ed7144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:58.635924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d5893-9c67-4470-bf6b-500946ed7144 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:58.636208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d5893-9c67-4470-bf6b-500946ed7144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:58.636499 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d5893-9c67-4470-bf6b-500946ed7144 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:58.637184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d5893-9c67-4470-bf6b-500946ed7144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:58.639132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d5893-9c67-4470-bf6b-500946ed7144 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:58.647846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c53a-0c62-4e11-b235-7fc3e5bf59d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:58.648520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c53a-0c62-4e11-b235-7fc3e5bf59d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:58.649056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c53a-0c62-4e11-b235-7fc3e5bf59d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:58.649597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c53a-0c62-4e11-b235-7fc3e5bf59d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:58.650520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0c53a-0c62-4e11-b235-7fc3e5bf59d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:58.657523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0c53a-0c62-4e11-b235-7fc3e5bf59d0 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:58.692593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 999/2005] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:58.700529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c53a-0c62-4e11-b235-7fc3e5bf59d0 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:58.718259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c53a-0c62-4e11-b235-7fc3e5bf59d0 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:58.724686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dfe91-eb1c-4ae2-8c85-1804a338704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:58.725365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dfe91-eb1c-4ae2-8c85-1804a338704f admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:58.725640 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dfe91-eb1c-4ae2-8c85-1804a338704f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:58.725918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08dfe91-eb1c-4ae2-8c85-1804a338704f admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:58.726615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dfe91-eb1c-4ae2-8c85-1804a338704f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:58.728202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08dfe91-eb1c-4ae2-8c85-1804a338704f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:58.741058 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1000/2006] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:58.745865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dfe91-eb1c-4ae2-8c85-1804a338704f admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:58.756991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08dfe91-eb1c-4ae2-8c85-1804a338704f admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:58.763728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf3037-24f8-4e0d-bbd1-3c1f7ffd74ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:58.772691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf3037-24f8-4e0d-bbd1-3c1f7ffd74ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:58.772691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf3037-24f8-4e0d-bbd1-3c1f7ffd74ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:58.772691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf3037-24f8-4e0d-bbd1-3c1f7ffd74ff admin admin] PATH_INFO: `/v3/projects/f8cf5f34d677447da5b7daaef1a81c31/users/53b30dda8a30427a990293391950bf1d/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:58.781785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf3037-24f8-4e0d-bbd1-3c1f7ffd74ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8cf5f34d677447da5b7daaef1a81c31, user_id=53b30dda8a30427a990293391950bf1d, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:58.784449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf3037-24f8-4e0d-bbd1-3c1f7ffd74ff admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:58.859572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1007/2007] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:51:58 2022] POST /identity/v3/users => generated 290 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:51:58.860852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d5893-9c67-4470-bf6b-500946ed7144 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:58.870830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d5893-9c67-4470-bf6b-500946ed7144 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:58.875868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fe384-b825-4d51-a6f0-34a46d514a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:58.876510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fe384-b825-4d51-a6f0-34a46d514a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:58.876805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fe384-b825-4d51-a6f0-34a46d514a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:58.877074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fe384-b825-4d51-a6f0-34a46d514a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:58.877759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fe384-b825-4d51-a6f0-34a46d514a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:58.879477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573fe384-b825-4d51-a6f0-34a46d514a93 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:58.890340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1008/2008] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:51:58.894465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fe384-b825-4d51-a6f0-34a46d514a93 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:58.905722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573fe384-b825-4d51-a6f0-34a46d514a93 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:58.915920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504aca6-48a4-4a2c-a229-a1d41b509905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:58.915920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504aca6-48a4-4a2c-a229-a1d41b509905 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:58.915920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504aca6-48a4-4a2c-a229-a1d41b509905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:58.915920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504aca6-48a4-4a2c-a229-a1d41b509905 admin admin] PATH_INFO: `/v3/projects/41c830ad025d47ee9cf48fcaf3ebe320/users/ee5b0a19f2364872bc5d5e12e4a1a4a3/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:58.930516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504aca6-48a4-4a2c-a229-a1d41b509905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c830ad025d47ee9cf48fcaf3ebe320, user_id=ee5b0a19f2364872bc5d5e12e4a1a4a3, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:58.933635 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504aca6-48a4-4a2c-a229-a1d41b509905 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:58.966262 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1001/2009] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:58 2022] PUT /identity/v3/projects/f8cf5f34d677447da5b7daaef1a81c31/users/53b30dda8a30427a990293391950bf1d/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:58.987745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8473e8-9d95-4a12-8187-c45ad3c76d60 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:58.988093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8473e8-9d95-4a12-8187-c45ad3c76d60 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:58.988385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8473e8-9d95-4a12-8187-c45ad3c76d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:59.020764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0a8473e8-9d95-4a12-8187-c45ad3c76d60 None None] MFA Rules not processed for user `53b30dda8a30427a990293391950bf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:59.022195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0a8473e8-9d95-4a12-8187-c45ad3c76d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:59.087717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1009/2010] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:58 2022] PUT /identity/v3/projects/41c830ad025d47ee9cf48fcaf3ebe320/users/ee5b0a19f2364872bc5d5e12e4a1a4a3/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:51:59.093969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504aca6-48a4-4a2c-a229-a1d41b509905 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:59.108668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1002/2011] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:51:59.120463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8473e8-9d95-4a12-8187-c45ad3c76d60 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:59.122128 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0a8473e8-9d95-4a12-8187-c45ad3c76d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:59.192638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504aca6-48a4-4a2c-a229-a1d41b509905 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:59.201829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d30a5-dc45-45e6-82f6-ddcea1ecbc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:59.202766 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d30a5-dc45-45e6-82f6-ddcea1ecbc08 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:59.203407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d30a5-dc45-45e6-82f6-ddcea1ecbc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:59.204310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d30a5-dc45-45e6-82f6-ddcea1ecbc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:59.205376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d30a5-dc45-45e6-82f6-ddcea1ecbc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:59.207860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d30a5-dc45-45e6-82f6-ddcea1ecbc08 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:59.227061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1010/2012] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:51:59.238135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d30a5-dc45-45e6-82f6-ddcea1ecbc08 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:59.248624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8473e8-9d95-4a12-8187-c45ad3c76d60 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:59.260196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d30a5-dc45-45e6-82f6-ddcea1ecbc08 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:59.273491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83999a69-8ab9-4e40-a783-0e82ace045ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:59.275019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83999a69-8ab9-4e40-a783-0e82ace045ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:59.275019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83999a69-8ab9-4e40-a783-0e82ace045ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:59.275019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83999a69-8ab9-4e40-a783-0e82ace045ec admin admin] PATH_INFO: `/v3/projects/41c830ad025d47ee9cf48fcaf3ebe320/users/ee5b0a19f2364872bc5d5e12e4a1a4a3/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:59.279037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83999a69-8ab9-4e40-a783-0e82ace045ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c830ad025d47ee9cf48fcaf3ebe320, user_id=ee5b0a19f2364872bc5d5e12e4a1a4a3, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:59.285802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83999a69-8ab9-4e40-a783-0e82ace045ec admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:59.325451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1011/2013] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:51:59 2022] PUT /identity/v3/projects/41c830ad025d47ee9cf48fcaf3ebe320/users/ee5b0a19f2364872bc5d5e12e4a1a4a3/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:51:59.326071 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299443a-d52a-49b3-ab3e-ae5adee49e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:59.326849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299443a-d52a-49b3-ab3e-ae5adee49e49 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:59.327219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299443a-d52a-49b3-ab3e-ae5adee49e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:59.327353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0991-71f1-492b-b27e-b65805de3d0f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:59.327565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0991-71f1-492b-b27e-b65805de3d0f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:59.327668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299443a-d52a-49b3-ab3e-ae5adee49e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:59.327844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e0991-71f1-492b-b27e-b65805de3d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:59.387828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ee8e0991-71f1-492b-b27e-b65805de3d0f None None] MFA Rules not processed for user `ee5b0a19f2364872bc5d5e12e4a1a4a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:51:59.389190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ee8e0991-71f1-492b-b27e-b65805de3d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:59.426855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299443a-d52a-49b3-ab3e-ae5adee49e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:59.428773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299443a-d52a-49b3-ab3e-ae5adee49e49 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:59.445686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1003/2014] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:51:59.501059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1012/2015] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:51:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:51:59.508980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299443a-d52a-49b3-ab3e-ae5adee49e49 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:51:59.510803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b299443a-d52a-49b3-ab3e-ae5adee49e49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:51:59.528166 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299443a-d52a-49b3-ab3e-ae5adee49e49 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:51:59.612735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75305f63-124c-4e47-b5e6-54fbc92e559a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:51:59.613575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75305f63-124c-4e47-b5e6-54fbc92e559a service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:51:59.613955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75305f63-124c-4e47-b5e6-54fbc92e559a service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:51:59.615119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75305f63-124c-4e47-b5e6-54fbc92e559a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:51:59.626534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75305f63-124c-4e47-b5e6-54fbc92e559a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:51:59.629427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75305f63-124c-4e47-b5e6-54fbc92e559a service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:51:59.653425 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1004/2016] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:51:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:00.070043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e0991-71f1-492b-b27e-b65805de3d0f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:00.081350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e0991-71f1-492b-b27e-b65805de3d0f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:00.086098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43765fcc-7c43-4bf3-82d1-7e8de381cbef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:00.086758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43765fcc-7c43-4bf3-82d1-7e8de381cbef service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:00.087034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43765fcc-7c43-4bf3-82d1-7e8de381cbef service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:00.087371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43765fcc-7c43-4bf3-82d1-7e8de381cbef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:00.164765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43765fcc-7c43-4bf3-82d1-7e8de381cbef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:00.166469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43765fcc-7c43-4bf3-82d1-7e8de381cbef service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:00.190578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1013/2017] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:00.689050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:01.495844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e1582-7008-4bdc-b51c-1a5be541abf3 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:01.497492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e1582-7008-4bdc-b51c-1a5be541abf3 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:01.498035 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e1582-7008-4bdc-b51c-1a5be541abf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:01.548984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-571e1582-7008-4bdc-b51c-1a5be541abf3 None None] MFA Rules not processed for user `3575098818954a949e202397a1b20a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:01.550974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-571e1582-7008-4bdc-b51c-1a5be541abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:01.629537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1005/2018] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:01.641657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3d895-bb0e-40a2-ba52-832354e16a3e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:01.642168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3d895-bb0e-40a2-ba52-832354e16a3e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:01.642352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3d895-bb0e-40a2-ba52-832354e16a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:01.663788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6ea3d895-bb0e-40a2-ba52-832354e16a3e None None] MFA Rules not processed for user `3575098818954a949e202397a1b20a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:01.665034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6ea3d895-bb0e-40a2-ba52-832354e16a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:01.672557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1014/2019] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:01.687810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e1582-7008-4bdc-b51c-1a5be541abf3 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:01.690688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-571e1582-7008-4bdc-b51c-1a5be541abf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:01.789723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e1582-7008-4bdc-b51c-1a5be541abf3 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:01.796622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0d817-536b-4b89-b358-4ec65522faa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:01.797369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d817-536b-4b89-b358-4ec65522faa8 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:01.797673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d817-536b-4b89-b358-4ec65522faa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:01.804475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d817-536b-4b89-b358-4ec65522faa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:01.807484 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0d817-536b-4b89-b358-4ec65522faa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:01.809692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0d817-536b-4b89-b358-4ec65522faa8 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:01.822557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1006/2020] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:01 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:01.833893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:02.771728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2163c-1336-47c3-93b3-4dbf40588949 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:02.772336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2163c-1336-47c3-93b3-4dbf40588949 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:02.772336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2163c-1336-47c3-93b3-4dbf40588949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:02.822881 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-0fa2163c-1336-47c3-93b3-4dbf40588949 None None] MFA Rules not processed for user `3575098818954a949e202397a1b20a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:02.822881 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0fa2163c-1336-47c3-93b3-4dbf40588949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:02.822881 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1015/2021] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:03.486981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:04.645680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0d817-536b-4b89-b358-4ec65522faa8 service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:04.821353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0d817-536b-4b89-b358-4ec65522faa8 service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:04.831272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:04.832068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:04.832468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:04.833050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] PATH_INFO: `/v3/users/53b30dda8a30427a990293391950bf1d` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:04.835257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b30dda8a30427a990293391950bf1d)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:04.837539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:05.099534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b30dda8a30427a990293391950bf1d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:05.108893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b30dda8a30427a990293391950bf1d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:05.109659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b30dda8a30427a990293391950bf1d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:05.260434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2163c-1336-47c3-93b3-4dbf40588949 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:05.262612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0fa2163c-1336-47c3-93b3-4dbf40588949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:05.277760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2163c-1336-47c3-93b3-4dbf40588949 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:05.282385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b30dda8a30427a990293391950bf1d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:05.285936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:05.287029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:05.287311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:05.287612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] PATH_INFO: `/v3/users/7ba37618713243bfbebb405c5d4e20ab` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:05.290596 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba37618713243bfbebb405c5d4e20ab)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:05.292806 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:05.299268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b8e642e4-f4d9-4e6e-bc35-c3c6d4778a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b30dda8a30427a990293391950bf1d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:05.306724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1007/2022] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:04 2022] DELETE /identity/v3/users/53b30dda8a30427a990293391950bf1d => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:05.313673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b04a80-4be3-4fbb-99d8-1f2f7cab24bf None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:05.314127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b04a80-4be3-4fbb-99d8-1f2f7cab24bf None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:05.314474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b04a80-4be3-4fbb-99d8-1f2f7cab24bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:05.338273 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-19b04a80-4be3-4fbb-99d8-1f2f7cab24bf None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:05.339531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-19b04a80-4be3-4fbb-99d8-1f2f7cab24bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:05.345313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:05.436765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1008/2023] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:05.451320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b04a80-4be3-4fbb-99d8-1f2f7cab24bf None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:05.453115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-19b04a80-4be3-4fbb-99d8-1f2f7cab24bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:05.531935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b04a80-4be3-4fbb-99d8-1f2f7cab24bf None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:05.536555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593d6b4-cbce-4708-9bbc-4c4821ab4d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:05.536737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593d6b4-cbce-4708-9bbc-4c4821ab4d53 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:05.537018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593d6b4-cbce-4708-9bbc-4c4821ab4d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:05.537294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593d6b4-cbce-4708-9bbc-4c4821ab4d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:05.548660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593d6b4-cbce-4708-9bbc-4c4821ab4d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:05.550177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593d6b4-cbce-4708-9bbc-4c4821ab4d53 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:05.563458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1009/2024] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:05.576995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba37618713243bfbebb405c5d4e20ab'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:05.588279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba37618713243bfbebb405c5d4e20ab'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:05.589692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba37618713243bfbebb405c5d4e20ab'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:05.708974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba37618713243bfbebb405c5d4e20ab'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:05.710032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba37618713243bfbebb405c5d4e20ab'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:05.744570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1016/2025] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:05 2022] DELETE /identity/v3/users/7ba37618713243bfbebb405c5d4e20ab => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:52:05.747557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b644-d6b0-49d2-a314-3f46476372b3 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:05.755185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b644-d6b0-49d2-a314-3f46476372b3 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:05.755185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7b644-d6b0-49d2-a314-3f46476372b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:05.770372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-8db7b644-d6b0-49d2-a314-3f46476372b3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:05.771702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8db7b644-d6b0-49d2-a314-3f46476372b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:05.927122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1010/2026] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:05.939065 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:05.940648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:06.033129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a73866-f1dc-42c6-b5a2-a6aec43b57f5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:06.038857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2ca6-86f2-426e-b7af-aa92c3a08cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:06.039509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2ca6-86f2-426e-b7af-aa92c3a08cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:06.039792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2ca6-86f2-426e-b7af-aa92c3a08cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:06.045809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2ca6-86f2-426e-b7af-aa92c3a08cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:06.051535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2ca6-86f2-426e-b7af-aa92c3a08cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:06.053059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2ca6-86f2-426e-b7af-aa92c3a08cc9 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:06.064381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1017/2027] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:06.112127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7b644-d6b0-49d2-a314-3f46476372b3 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:06.114232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8db7b644-d6b0-49d2-a314-3f46476372b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:06.139517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7b644-d6b0-49d2-a314-3f46476372b3 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:06.149964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:06.151206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:06.152010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:06.152010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] PATH_INFO: `/v3/projects/f8cf5f34d677447da5b7daaef1a81c31` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:06.155780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8cf5f34d677447da5b7daaef1a81c31)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:06.159491 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:06.428608 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8cf5f34d677447da5b7daaef1a81c31', 'request_id': 'req-70efafdc-a689-4b9c-be30-066b067835ac'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:06.439750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8cf5f34d677447da5b7daaef1a81c31', 'request_id': 'req-70efafdc-a689-4b9c-be30-066b067835ac'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:06.538835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8cf5f34d677447da5b7daaef1a81c31', 'request_id': 'req-70efafdc-a689-4b9c-be30-066b067835ac'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:06.552160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] The token cache is being invalidate because project f8cf5f34d677447da5b7daaef1a81c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:06.552447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:06.553146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-70efafdc-a689-4b9c-be30-066b067835ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:06.554819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1011/2028] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:06 2022] DELETE /identity/v3/projects/f8cf5f34d677447da5b7daaef1a81c31 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:06.558166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2ca6-86f2-426e-b7af-aa92c3a08cc9 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:06.559713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1fcf2ca6-86f2-426e-b7af-aa92c3a08cc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:06.559858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f106f1-7381-4375-80f3-cb0f61dfd2ff None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:06.560094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f106f1-7381-4375-80f3-cb0f61dfd2ff None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:06.560441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f106f1-7381-4375-80f3-cb0f61dfd2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:06.573273 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2ca6-86f2-426e-b7af-aa92c3a08cc9 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:06.584214 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-09f106f1-7381-4375-80f3-cb0f61dfd2ff None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:06.585569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-09f106f1-7381-4375-80f3-cb0f61dfd2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:06.699166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:06.700317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:06.700691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:06.701008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] PATH_INFO: `/v3/users/75b69ecf90da4b91a10ef71ee77be2b9` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:06.702117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=75b69ecf90da4b91a10ef71ee77be2b9)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:06.704618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:06.709212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1012/2029] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:06.710614 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f106f1-7381-4375-80f3-cb0f61dfd2ff None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:06.713283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-09f106f1-7381-4375-80f3-cb0f61dfd2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:06.742935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f106f1-7381-4375-80f3-cb0f61dfd2ff None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:06.751189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:06.751862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:06.752318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:06.752784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] PATH_INFO: `/v3/projects/925d9cad5d8d4efaa4cbcc2ee459df25` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:06.754202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925d9cad5d8d4efaa4cbcc2ee459df25)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:06.756660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:07.112248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925d9cad5d8d4efaa4cbcc2ee459df25', 'request_id': 'req-dc9c540c-55bd-4505-a8e4-d855502ec994'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.119098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75b69ecf90da4b91a10ef71ee77be2b9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.119316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925d9cad5d8d4efaa4cbcc2ee459df25', 'request_id': 'req-dc9c540c-55bd-4505-a8e4-d855502ec994'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.130080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75b69ecf90da4b91a10ef71ee77be2b9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.131048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75b69ecf90da4b91a10ef71ee77be2b9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.208146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925d9cad5d8d4efaa4cbcc2ee459df25', 'request_id': 'req-dc9c540c-55bd-4505-a8e4-d855502ec994'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.222764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] The token cache is being invalidate because project 925d9cad5d8d4efaa4cbcc2ee459df25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:07.223538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.224312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-dc9c540c-55bd-4505-a8e4-d855502ec994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.225983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1013/2030] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:06 2022] DELETE /identity/v3/projects/925d9cad5d8d4efaa4cbcc2ee459df25 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:07.227450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e195563-abc2-4200-a08f-eef00ad6c7de None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:07.227732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e195563-abc2-4200-a08f-eef00ad6c7de None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:07.228155 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e195563-abc2-4200-a08f-eef00ad6c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:07.250031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-4e195563-abc2-4200-a08f-eef00ad6c7de None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:07.251639 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4e195563-abc2-4200-a08f-eef00ad6c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:07.345143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1014/2031] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:07.346221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e195563-abc2-4200-a08f-eef00ad6c7de None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:07.347894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4e195563-abc2-4200-a08f-eef00ad6c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:07.361255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e195563-abc2-4200-a08f-eef00ad6c7de None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:07.367821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:07.369160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:07.369441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:07.369717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] PATH_INFO: `/v3/users/9f71c2d904a84cd28f9c13a25de06d03` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:07.371064 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f71c2d904a84cd28f9c13a25de06d03)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:07.373186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:07.413314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75b69ecf90da4b91a10ef71ee77be2b9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.414242 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75b69ecf90da4b91a10ef71ee77be2b9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.448456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1018/2032] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:06 2022] DELETE /identity/v3/users/75b69ecf90da4b91a10ef71ee77be2b9 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:52:07.448456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:07.448456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:07.533155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495330f-c42e-4802-b790-981ba1c7f8dc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:07.542230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a52240-d93d-44c0-b1ac-b891911fbdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:07.542230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a52240-d93d-44c0-b1ac-b891911fbdae admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:07.542230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a52240-d93d-44c0-b1ac-b891911fbdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:07.542230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a52240-d93d-44c0-b1ac-b891911fbdae admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:07.543162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a52240-d93d-44c0-b1ac-b891911fbdae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:07.543162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a52240-d93d-44c0-b1ac-b891911fbdae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:07.545752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a52240-d93d-44c0-b1ac-b891911fbdae admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:07.561484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1019/2033] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:07.563829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47331b-b966-402a-8bc5-d5ab00711a0d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:07.564312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47331b-b966-402a-8bc5-d5ab00711a0d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:07.564792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47331b-b966-402a-8bc5-d5ab00711a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:07.593414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7a47331b-b966-402a-8bc5-d5ab00711a0d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:07.594841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7a47331b-b966-402a-8bc5-d5ab00711a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:07.604373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1020/2034] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:07.606065 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47331b-b966-402a-8bc5-d5ab00711a0d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:07.624450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47331b-b966-402a-8bc5-d5ab00711a0d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:07.630325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6710967-63d7-4581-a8ce-10f903f9beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:07.631208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6710967-63d7-4581-a8ce-10f903f9beec admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:07.631533 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6710967-63d7-4581-a8ce-10f903f9beec admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:07.631836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6710967-63d7-4581-a8ce-10f903f9beec admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:07.632772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6710967-63d7-4581-a8ce-10f903f9beec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:07.634870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6710967-63d7-4581-a8ce-10f903f9beec admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:07.736818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f71c2d904a84cd28f9c13a25de06d03'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.750836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1021/2035] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:07 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:07.752124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6710967-63d7-4581-a8ce-10f903f9beec admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:07.756774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a6710967-63d7-4581-a8ce-10f903f9beec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:07.761170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f71c2d904a84cd28f9c13a25de06d03'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.762710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f71c2d904a84cd28f9c13a25de06d03'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.826162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f71c2d904a84cd28f9c13a25de06d03'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.849468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f71c2d904a84cd28f9c13a25de06d03'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:07.852012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6710967-63d7-4581-a8ce-10f903f9beec admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:07.856886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4eddfa-8159-4165-a4fa-52aeb313c4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:07.857533 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4eddfa-8159-4165-a4fa-52aeb313c4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:07.857815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4eddfa-8159-4165-a4fa-52aeb313c4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:07.858089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4eddfa-8159-4165-a4fa-52aeb313c4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:07.860062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0a4eddfa-8159-4165-a4fa-52aeb313c4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:07.864696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1015/2036] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:07 2022] DELETE /identity/v3/users/9f71c2d904a84cd28f9c13a25de06d03 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:07.868054 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:07.870376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:08.021276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4eddfa-8159-4165-a4fa-52aeb313c4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:08.034684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4eddfa-8159-4165-a4fa-52aeb313c4b4 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:08.042003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa03f2-2959-48d2-8ce8-004bc01fe909 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:08.053369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085eb20-fd2c-44bb-a576-1924845fa170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:08.054359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085eb20-fd2c-44bb-a576-1924845fa170 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:08.054823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085eb20-fd2c-44bb-a576-1924845fa170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:08.055278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085eb20-fd2c-44bb-a576-1924845fa170 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:08.056630 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085eb20-fd2c-44bb-a576-1924845fa170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:08.062245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085eb20-fd2c-44bb-a576-1924845fa170 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:08.064801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1022/2037] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:08.190897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1016/2038] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:07 2022] POST /identity/v3/users => generated 286 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:08.195916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4eddfa-8159-4165-a4fa-52aeb313c4b4 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:08.228274 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4eddfa-8159-4165-a4fa-52aeb313c4b4 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:08.261093 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7643382-2332-4169-8ff8-48764fc10a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:08.262369 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643382-2332-4169-8ff8-48764fc10a89 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:08.265078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643382-2332-4169-8ff8-48764fc10a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:08.265400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7643382-2332-4169-8ff8-48764fc10a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:08.267812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7643382-2332-4169-8ff8-48764fc10a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:08.270724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7643382-2332-4169-8ff8-48764fc10a89 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:08.299037 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1023/2039] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:08.303700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085eb20-fd2c-44bb-a576-1924845fa170 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:08.317318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085eb20-fd2c-44bb-a576-1924845fa170 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:08.325043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cd8d2-72b5-4418-bbc8-f1988fe0f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:08.326253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cd8d2-72b5-4418-bbc8-f1988fe0f74b admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:08.326802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cd8d2-72b5-4418-bbc8-f1988fe0f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:08.327281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cd8d2-72b5-4418-bbc8-f1988fe0f74b admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:08.328159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cd8d2-72b5-4418-bbc8-f1988fe0f74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:08.330333 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cd8d2-72b5-4418-bbc8-f1988fe0f74b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:08.359680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1017/2040] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:08.360885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7643382-2332-4169-8ff8-48764fc10a89 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:08.386115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7643382-2332-4169-8ff8-48764fc10a89 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:08.392354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204de8f-155f-42fc-9cd2-736b7080ed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:08.393146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204de8f-155f-42fc-9cd2-736b7080ed2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:08.393483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204de8f-155f-42fc-9cd2-736b7080ed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:08.393750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204de8f-155f-42fc-9cd2-736b7080ed2d admin admin] PATH_INFO: `/v3/projects/cb1b3f7642914e14bb6205f439e59178/users/6416b1756bf649c697f0b97810d08a7c/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:08.408970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:08.426700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204de8f-155f-42fc-9cd2-736b7080ed2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1b3f7642914e14bb6205f439e59178, user_id=6416b1756bf649c697f0b97810d08a7c, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:08.436359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204de8f-155f-42fc-9cd2-736b7080ed2d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:08.505303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:08.613508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1024/2041] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:08 2022] PUT /identity/v3/projects/cb1b3f7642914e14bb6205f439e59178/users/6416b1756bf649c697f0b97810d08a7c/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:52:08.625802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286b49d-5251-45f8-ac34-3614f7504e5d None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:08.626071 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286b49d-5251-45f8-ac34-3614f7504e5d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:08.626355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286b49d-5251-45f8-ac34-3614f7504e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:08.701532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-8286b49d-5251-45f8-ac34-3614f7504e5d None None] MFA Rules not processed for user `6416b1756bf649c697f0b97810d08a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:08.705068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8286b49d-5251-45f8-ac34-3614f7504e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:08.810012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1018/2042] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:08.826172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204de8f-155f-42fc-9cd2-736b7080ed2d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:08.828456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8204de8f-155f-42fc-9cd2-736b7080ed2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:08.898573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286b49d-5251-45f8-ac34-3614f7504e5d None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:08.900975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8286b49d-5251-45f8-ac34-3614f7504e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:08.955516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204de8f-155f-42fc-9cd2-736b7080ed2d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:08.962591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4964d41-fb02-4006-886f-fe46afe4423c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:08.963672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4964d41-fb02-4006-886f-fe46afe4423c service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:08.964158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4964d41-fb02-4006-886f-fe46afe4423c service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:08.965517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4964d41-fb02-4006-886f-fe46afe4423c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:08.983569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4964d41-fb02-4006-886f-fe46afe4423c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:08.986587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4964d41-fb02-4006-886f-fe46afe4423c service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:09.007504 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1025/2043] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:52:09.047568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4964d41-fb02-4006-886f-fe46afe4423c service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:09.065208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286b49d-5251-45f8-ac34-3614f7504e5d None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:09.069695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4964d41-fb02-4006-886f-fe46afe4423c service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:09.077556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:09.084236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:09.084236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:09.084236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] PATH_INFO: `/v3/projects/d93f178be1e343238ebfa373d36a6cfd` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:09.084236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d93f178be1e343238ebfa373d36a6cfd)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:09.085968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:09.091170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:09.093653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:09.094687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:09.096573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] PATH_INFO: `/v3/users/6416b1756bf649c697f0b97810d08a7c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:09.098970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6416b1756bf649c697f0b97810d08a7c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:09.102712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:09.612595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93f178be1e343238ebfa373d36a6cfd', 'request_id': 'req-2b17935e-3f02-495b-9c49-65b5675cf1ed'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:09.631815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93f178be1e343238ebfa373d36a6cfd', 'request_id': 'req-2b17935e-3f02-495b-9c49-65b5675cf1ed'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:09.756351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6416b1756bf649c697f0b97810d08a7c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:09.766530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93f178be1e343238ebfa373d36a6cfd', 'request_id': 'req-2b17935e-3f02-495b-9c49-65b5675cf1ed'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:09.769339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6416b1756bf649c697f0b97810d08a7c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:09.770699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6416b1756bf649c697f0b97810d08a7c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:09.782324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] The token cache is being invalidate because project d93f178be1e343238ebfa373d36a6cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:09.782875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:09.784156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:09.786996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1019/2044] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:08 2022] DELETE /identity/v3/projects/d93f178be1e343238ebfa373d36a6cfd => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:09.788460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:09.794031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:09.889268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17935e-3f02-495b-9c49-65b5675cf1ed admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:09.895379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:09.896081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:09.896361 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:09.896646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] PATH_INFO: `/v3/projects/2c5ef3c716bb43cb96f4d237d410a998` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:09.897889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5ef3c716bb43cb96f4d237d410a998)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:09.899834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:09.906850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6416b1756bf649c697f0b97810d08a7c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:09.913611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c747b3c-8313-4a3d-803c-f17e7ff7bc08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6416b1756bf649c697f0b97810d08a7c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:09.948700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1026/2045] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:09 2022] DELETE /identity/v3/users/6416b1756bf649c697f0b97810d08a7c => generated 0 bytes in 902 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:09.950873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421108-8d2b-4a19-938b-716b486f12a1 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:09.951236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421108-8d2b-4a19-938b-716b486f12a1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:09.951588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18421108-8d2b-4a19-938b-716b486f12a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:09.974770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-18421108-8d2b-4a19-938b-716b486f12a1 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:09.975994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-18421108-8d2b-4a19-938b-716b486f12a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:10.058746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1027/2046] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:10.058746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de846f-34a4-41f3-9d67-a5867ca4c4b0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.058746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de846f-34a4-41f3-9d67-a5867ca4c4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.058746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de846f-34a4-41f3-9d67-a5867ca4c4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.082086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-48de846f-34a4-41f3-9d67-a5867ca4c4b0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:10.083620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-48de846f-34a4-41f3-9d67-a5867ca4c4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:10.099288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5ef3c716bb43cb96f4d237d410a998', 'request_id': 'req-3adfefbd-1af4-4320-b239-4c10c1cd69ff'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:10.109327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5ef3c716bb43cb96f4d237d410a998', 'request_id': 'req-3adfefbd-1af4-4320-b239-4c10c1cd69ff'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:10.169794 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1028/2047] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:10.170909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de846f-34a4-41f3-9d67-a5867ca4c4b0 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:10.172245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-48de846f-34a4-41f3-9d67-a5867ca4c4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:10.186715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de846f-34a4-41f3-9d67-a5867ca4c4b0 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:10.192073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:10.192751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.193026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.193297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] PATH_INFO: `/v3/users/27f6e29b983a4e949d2c6764afb68fc1` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.194439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f6e29b983a4e949d2c6764afb68fc1)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:10.196471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:10.275154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5ef3c716bb43cb96f4d237d410a998', 'request_id': 'req-3adfefbd-1af4-4320-b239-4c10c1cd69ff'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:10.289336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] The token cache is being invalidate because project 2c5ef3c716bb43cb96f4d237d410a998 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:10.289671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:10.290361 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3adfefbd-1af4-4320-b239-4c10c1cd69ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:10.291887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1020/2048] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:09 2022] DELETE /identity/v3/projects/2c5ef3c716bb43cb96f4d237d410a998 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:10.293730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029574c4-b87a-45b9-b340-c2891c17fde2 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.294015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029574c4-b87a-45b9-b340-c2891c17fde2 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.294290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029574c4-b87a-45b9-b340-c2891c17fde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.315062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-029574c4-b87a-45b9-b340-c2891c17fde2 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:10.316322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-029574c4-b87a-45b9-b340-c2891c17fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:10.325741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1021/2049] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:10.326691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029574c4-b87a-45b9-b340-c2891c17fde2 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:10.330419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-029574c4-b87a-45b9-b340-c2891c17fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:10.393049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029574c4-b87a-45b9-b340-c2891c17fde2 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:10.398007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a79862-b2e8-482a-8aeb-3cb956a6c3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:10.398911 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79862-b2e8-482a-8aeb-3cb956a6c3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.399313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79862-b2e8-482a-8aeb-3cb956a6c3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.399754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a79862-b2e8-482a-8aeb-3cb956a6c3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.401929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-53a79862-b2e8-482a-8aeb-3cb956a6c3b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:10.416025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a79862-b2e8-482a-8aeb-3cb956a6c3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:10.417656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a79862-b2e8-482a-8aeb-3cb956a6c3b4 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:10.430212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1022/2050] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:10.442248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828cf8c-2e99-4989-b4b4-eff187aac427 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.442801 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828cf8c-2e99-4989-b4b4-eff187aac427 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.443367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828cf8c-2e99-4989-b4b4-eff187aac427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.498292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f6e29b983a4e949d2c6764afb68fc1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:10.518254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f6e29b983a4e949d2c6764afb68fc1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:10.519128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f6e29b983a4e949d2c6764afb68fc1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:10.525192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-6828cf8c-2e99-4989-b4b4-eff187aac427 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:10.526725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6828cf8c-2e99-4989-b4b4-eff187aac427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:10.552552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1023/2051] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:10.552552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828cf8c-2e99-4989-b4b4-eff187aac427 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:10.570668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828cf8c-2e99-4989-b4b4-eff187aac427 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:10.577192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a53fcc-26ac-481c-8ec9-6065366d52c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:10.577951 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a53fcc-26ac-481c-8ec9-6065366d52c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.578674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a53fcc-26ac-481c-8ec9-6065366d52c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.578962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a53fcc-26ac-481c-8ec9-6065366d52c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.579837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a53fcc-26ac-481c-8ec9-6065366d52c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:10.580154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a53fcc-26ac-481c-8ec9-6065366d52c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:10.582264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a53fcc-26ac-481c-8ec9-6065366d52c8 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:10.609434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1024/2052] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:10.609865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9e35-2d18-4aa7-bcca-b01e10a22e9f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.610104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9e35-2d18-4aa7-bcca-b01e10a22e9f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.610408 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d9e35-2d18-4aa7-bcca-b01e10a22e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.636942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f6e29b983a4e949d2c6764afb68fc1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:10.637875 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f6e29b983a4e949d2c6764afb68fc1'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:10.640911 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-071d9e35-2d18-4aa7-bcca-b01e10a22e9f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:10.643788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-071d9e35-2d18-4aa7-bcca-b01e10a22e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:10.655270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1025/2053] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:10.659045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d9e35-2d18-4aa7-bcca-b01e10a22e9f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:10.659045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-071d9e35-2d18-4aa7-bcca-b01e10a22e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:10.679804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d9e35-2d18-4aa7-bcca-b01e10a22e9f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:10.689347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09b5c9-c342-4909-843d-77fb67f12027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:10.690070 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1029/2054] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:10 2022] DELETE /identity/v3/users/27f6e29b983a4e949d2c6764afb68fc1 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:10.690400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09b5c9-c342-4909-843d-77fb67f12027 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.691223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09b5c9-c342-4909-843d-77fb67f12027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.691827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09b5c9-c342-4909-843d-77fb67f12027 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.692877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09b5c9-c342-4909-843d-77fb67f12027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:10.693133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:10.697133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09b5c9-c342-4909-843d-77fb67f12027 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:10.819795 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1026/2055] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:10 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:10.821597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380d55-b3be-4a89-982e-fac240774900 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.821885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380d55-b3be-4a89-982e-fac240774900 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.822163 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2380d55-b3be-4a89-982e-fac240774900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.839261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc3d7-14e7-4f60-944d-16e9d875598f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:10.861834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c2380d55-b3be-4a89-982e-fac240774900 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:10.863063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c2380d55-b3be-4a89-982e-fac240774900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:10.930133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993945c-d930-42af-8149-9178a19402fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:10.931118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993945c-d930-42af-8149-9178a19402fc admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.931477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993945c-d930-42af-8149-9178a19402fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.932202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993945c-d930-42af-8149-9178a19402fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.933182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993945c-d930-42af-8149-9178a19402fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:10.933522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993945c-d930-42af-8149-9178a19402fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:10.935715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993945c-d930-42af-8149-9178a19402fc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:10.960188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1030/2056] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:10.960188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993945c-d930-42af-8149-9178a19402fc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:10.969269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993945c-d930-42af-8149-9178a19402fc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:10.977291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1027/2057] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:10.977291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2380d55-b3be-4a89-982e-fac240774900 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:10.984308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d69be-16ed-49d1-8bd2-8ecb3d54212c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:10.985090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d69be-16ed-49d1-8bd2-8ecb3d54212c admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:10.985388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d69be-16ed-49d1-8bd2-8ecb3d54212c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:10.985775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d69be-16ed-49d1-8bd2-8ecb3d54212c admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:10.991273 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d69be-16ed-49d1-8bd2-8ecb3d54212c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:10.996336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d69be-16ed-49d1-8bd2-8ecb3d54212c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:10.996692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2380d55-b3be-4a89-982e-fac240774900 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:11.003286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358b84e-f0b2-4e4a-a5c1-3dffab78c78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:11.004878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358b84e-f0b2-4e4a-a5c1-3dffab78c78a admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:11.005340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358b84e-f0b2-4e4a-a5c1-3dffab78c78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:11.011750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358b84e-f0b2-4e4a-a5c1-3dffab78c78a admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:11.011750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358b84e-f0b2-4e4a-a5c1-3dffab78c78a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:11.011750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358b84e-f0b2-4e4a-a5c1-3dffab78c78a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:11.107890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1031/2058] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:10 2022] POST /identity/v3/users => generated 297 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:11.109571 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d69be-16ed-49d1-8bd2-8ecb3d54212c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:11.111484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f23d69be-16ed-49d1-8bd2-8ecb3d54212c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:11.149251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1028/2059] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:10 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:11.151185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358b84e-f0b2-4e4a-a5c1-3dffab78c78a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:11.209540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d69be-16ed-49d1-8bd2-8ecb3d54212c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:11.259602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358b84e-f0b2-4e4a-a5c1-3dffab78c78a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:11.272501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d5a7-b5e0-41b0-90e6-3ce32da2cab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:11.273556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d5a7-b5e0-41b0-90e6-3ce32da2cab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:11.274037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d5a7-b5e0-41b0-90e6-3ce32da2cab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:11.274509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d5a7-b5e0-41b0-90e6-3ce32da2cab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:11.275658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0d5a7-b5e0-41b0-90e6-3ce32da2cab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:11.279444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0d5a7-b5e0-41b0-90e6-3ce32da2cab1 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:11.283539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09cf31-b0ee-4626-bcd2-4463ad2cc1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:11.284310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09cf31-b0ee-4626-bcd2-4463ad2cc1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:11.289083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09cf31-b0ee-4626-bcd2-4463ad2cc1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:11.291454 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09cf31-b0ee-4626-bcd2-4463ad2cc1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:11.310204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1029/2060] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:11.310204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d5a7-b5e0-41b0-90e6-3ce32da2cab1 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:11.312010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09cf31-b0ee-4626-bcd2-4463ad2cc1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:11.320274 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09cf31-b0ee-4626-bcd2-4463ad2cc1e5 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:11.335530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d5a7-b5e0-41b0-90e6-3ce32da2cab1 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:11.337859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1032/2061] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:11.339322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09cf31-b0ee-4626-bcd2-4463ad2cc1e5 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:11.342070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166efdee-47f1-4b28-a6f6-74fd971d6677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:11.342700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166efdee-47f1-4b28-a6f6-74fd971d6677 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:11.343002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166efdee-47f1-4b28-a6f6-74fd971d6677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:11.343277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166efdee-47f1-4b28-a6f6-74fd971d6677 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:11.343925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166efdee-47f1-4b28-a6f6-74fd971d6677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:11.346080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166efdee-47f1-4b28-a6f6-74fd971d6677 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:11.359811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09cf31-b0ee-4626-bcd2-4463ad2cc1e5 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:11.368555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf18aa9-c24d-485a-ba8a-5a7a2276421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:11.369710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf18aa9-c24d-485a-ba8a-5a7a2276421a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:11.370488 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf18aa9-c24d-485a-ba8a-5a7a2276421a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:11.370896 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf18aa9-c24d-485a-ba8a-5a7a2276421a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:11.372086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf18aa9-c24d-485a-ba8a-5a7a2276421a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:11.376611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf18aa9-c24d-485a-ba8a-5a7a2276421a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:11.396721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1033/2062] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:11.403549 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf18aa9-c24d-485a-ba8a-5a7a2276421a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:11.422948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf18aa9-c24d-485a-ba8a-5a7a2276421a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:11.432127 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcf232-dc56-4898-a7dc-f62acb775032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:11.433550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcf232-dc56-4898-a7dc-f62acb775032 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:11.434257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcf232-dc56-4898-a7dc-f62acb775032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:11.436079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fcf232-dc56-4898-a7dc-f62acb775032 admin admin] PATH_INFO: `/v3/projects/9c41cdff3e574b00aa3145678bbc6453/users/b6b96ebee8ca4a239624f308cd20030b/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:11.545563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcf232-dc56-4898-a7dc-f62acb775032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c41cdff3e574b00aa3145678bbc6453, user_id=b6b96ebee8ca4a239624f308cd20030b, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:11.545563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fcf232-dc56-4898-a7dc-f62acb775032 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:11.780800 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1034/2063] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:11 2022] PUT /identity/v3/projects/9c41cdff3e574b00aa3145678bbc6453/users/b6b96ebee8ca4a239624f308cd20030b/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:52:11.785774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcf232-dc56-4898-a7dc-f62acb775032 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:11.787855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a7fcf232-dc56-4898-a7dc-f62acb775032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:11.791505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1030/2064] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:11 2022] POST /identity/v3/users => generated 283 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:11.792580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166efdee-47f1-4b28-a6f6-74fd971d6677 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:11.809276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166efdee-47f1-4b28-a6f6-74fd971d6677 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:11.867848 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:11.875478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fcf232-dc56-4898-a7dc-f62acb775032 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:11.884375 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:11.885843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:11.886187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:11.887379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] PATH_INFO: `/v3/projects/cb1b3f7642914e14bb6205f439e59178` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:11.888624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1b3f7642914e14bb6205f439e59178)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:11.890665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:11.900467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:11.931973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46998a06-1579-4352-9464-adc9f60c2375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:11.932648 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998a06-1579-4352-9464-adc9f60c2375 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:11.932933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998a06-1579-4352-9464-adc9f60c2375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:11.933213 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998a06-1579-4352-9464-adc9f60c2375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:11.934567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46998a06-1579-4352-9464-adc9f60c2375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:11.939623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46998a06-1579-4352-9464-adc9f60c2375 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:11.960926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1031/2065] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:11.962800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946b05-44b2-4ec7-8f03-cd103ab2e8cc None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:11.963274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946b05-44b2-4ec7-8f03-cd103ab2e8cc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:11.963679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90946b05-44b2-4ec7-8f03-cd103ab2e8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:12.015841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-90946b05-44b2-4ec7-8f03-cd103ab2e8cc None None] MFA Rules not processed for user `b6b96ebee8ca4a239624f308cd20030b`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:12.016667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-90946b05-44b2-4ec7-8f03-cd103ab2e8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:12.045668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1b3f7642914e14bb6205f439e59178', 'request_id': 'req-b0c1b232-3477-4d52-b49a-441d0011dd82'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:12.054812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1b3f7642914e14bb6205f439e59178', 'request_id': 'req-b0c1b232-3477-4d52-b49a-441d0011dd82'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:12.135981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1032/2066] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:12.135981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90946b05-44b2-4ec7-8f03-cd103ab2e8cc None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:12.148363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90946b05-44b2-4ec7-8f03-cd103ab2e8cc None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:12.215094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1b3f7642914e14bb6205f439e59178', 'request_id': 'req-b0c1b232-3477-4d52-b49a-441d0011dd82'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:12.266514 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] The token cache is being invalidate because project cb1b3f7642914e14bb6205f439e59178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:12.279021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:12.279021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:12.279021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1035/2067] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:11 2022] DELETE /identity/v3/projects/cb1b3f7642914e14bb6205f439e59178 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:12.279449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d9777-4e37-428a-b841-68e2b624285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:12.279559 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:12.279642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d9777-4e37-428a-b841-68e2b624285a admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:12.279642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d9777-4e37-428a-b841-68e2b624285a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:12.279642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d9777-4e37-428a-b841-68e2b624285a admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:12.279965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:12.280051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d9777-4e37-428a-b841-68e2b624285a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:12.280051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d9777-4e37-428a-b841-68e2b624285a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:12.295264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1033/2068] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:12.296158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d9777-4e37-428a-b841-68e2b624285a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:12.302387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-387d9777-4e37-428a-b841-68e2b624285a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:12.307362 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1b232-3477-4d52-b49a-441d0011dd82 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:12.316803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205ce65-e698-468b-9e9e-9f338c822b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:12.325076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205ce65-e698-468b-9e9e-9f338c822b3d admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:12.325076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205ce65-e698-468b-9e9e-9f338c822b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:12.325076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205ce65-e698-468b-9e9e-9f338c822b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:12.326041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d9777-4e37-428a-b841-68e2b624285a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:12.326224 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205ce65-e698-468b-9e9e-9f338c822b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:12.326385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:12.326976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205ce65-e698-468b-9e9e-9f338c822b3d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:12.327357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:12.327795 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:12.328223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] PATH_INFO: `/v3/projects/ccabda91714c4b60ad20f50026f201ef` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:12.329842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccabda91714c4b60ad20f50026f201ef)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:12.333267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:12.617857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1036/2069] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:12 2022] POST /identity/v3/projects => generated 393 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:12.617857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2af2-ef3b-4155-9197-aa3bc3db6ad9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:12.617857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2af2-ef3b-4155-9197-aa3bc3db6ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:12.617857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b2af2-ef3b-4155-9197-aa3bc3db6ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:12.636365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccabda91714c4b60ad20f50026f201ef', 'request_id': 'req-202962b8-be41-43a5-aef2-db5130a57d27'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:12.639055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c90b2af2-ef3b-4155-9197-aa3bc3db6ad9 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:12.640290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c90b2af2-ef3b-4155-9197-aa3bc3db6ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:12.644615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccabda91714c4b60ad20f50026f201ef', 'request_id': 'req-202962b8-be41-43a5-aef2-db5130a57d27'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:12.709850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1037/2070] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:12.709850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b2af2-ef3b-4155-9197-aa3bc3db6ad9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:12.711246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c90b2af2-ef3b-4155-9197-aa3bc3db6ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:12.721854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccabda91714c4b60ad20f50026f201ef', 'request_id': 'req-202962b8-be41-43a5-aef2-db5130a57d27'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:12.724045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b2af2-ef3b-4155-9197-aa3bc3db6ad9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:12.729643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd454cf-7f2f-47d6-903f-6e6c3a9ac3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:12.734180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd454cf-7f2f-47d6-903f-6e6c3a9ac3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:12.734180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd454cf-7f2f-47d6-903f-6e6c3a9ac3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:12.734180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd454cf-7f2f-47d6-903f-6e6c3a9ac3ca admin admin] PATH_INFO: `/v3/projects/67841822358e4f2295da3df27d6a3da1/users/fd3bf54b37324d7c82ceaddd15ed3e87/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:12.736757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] The token cache is being invalidate because project ccabda91714c4b60ad20f50026f201ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:12.737047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:12.737706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:12.739246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1034/2071] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:12 2022] DELETE /identity/v3/projects/ccabda91714c4b60ad20f50026f201ef => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:12.740016 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:12.741537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:12.749083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd454cf-7f2f-47d6-903f-6e6c3a9ac3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=67841822358e4f2295da3df27d6a3da1, user_id=fd3bf54b37324d7c82ceaddd15ed3e87, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:12.751843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd454cf-7f2f-47d6-903f-6e6c3a9ac3ca admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:12.813463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202962b8-be41-43a5-aef2-db5130a57d27 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:12.815295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31f837-fbb3-4184-b57e-8a8911a9500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:12.815943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31f837-fbb3-4184-b57e-8a8911a9500a admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:12.816240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31f837-fbb3-4184-b57e-8a8911a9500a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:12.816511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31f837-fbb3-4184-b57e-8a8911a9500a admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:12.817173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31f837-fbb3-4184-b57e-8a8911a9500a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:12.819113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31f837-fbb3-4184-b57e-8a8911a9500a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:12.837264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1038/2072] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:12 2022] PUT /identity/v3/projects/67841822358e4f2295da3df27d6a3da1/users/fd3bf54b37324d7c82ceaddd15ed3e87/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:12.842171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd95424-3aea-47d0-aa75-c90c42aab284 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:12.842171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd95424-3aea-47d0-aa75-c90c42aab284 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:12.842171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd95424-3aea-47d0-aa75-c90c42aab284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:12.871396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7dd95424-3aea-47d0-aa75-c90c42aab284 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:12.871396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7dd95424-3aea-47d0-aa75-c90c42aab284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:12.930180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1039/2073] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:12.931073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd95424-3aea-47d0-aa75-c90c42aab284 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:12.935111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7dd95424-3aea-47d0-aa75-c90c42aab284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:12.943600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1035/2074] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:12 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:12.952044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24754bbb-61a7-4b57-89a9-74c7aab42f03 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:12.952044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24754bbb-61a7-4b57-89a9-74c7aab42f03 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:12.952044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24754bbb-61a7-4b57-89a9-74c7aab42f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:12.964108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd95424-3aea-47d0-aa75-c90c42aab284 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:12.975001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:12.975802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:12.976591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:12.976711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:12.977085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] PATH_INFO: `/v3/users/ee5b0a19f2364872bc5d5e12e4a1a4a3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:12.978877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5b0a19f2364872bc5d5e12e4a1a4a3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:12.986338 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:12.995636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-24754bbb-61a7-4b57-89a9-74c7aab42f03 None None] MFA Rules not processed for user `fd3bf54b37324d7c82ceaddd15ed3e87`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:12.997575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-24754bbb-61a7-4b57-89a9-74c7aab42f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:13.077177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1036/2075] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:13.078224 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24754bbb-61a7-4b57-89a9-74c7aab42f03 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:13.090943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24754bbb-61a7-4b57-89a9-74c7aab42f03 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:13.101302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff0f67-6a92-42f9-9d5c-81a9bffe4b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:13.101302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff0f67-6a92-42f9-9d5c-81a9bffe4b59 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:13.101302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff0f67-6a92-42f9-9d5c-81a9bffe4b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:13.101302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff0f67-6a92-42f9-9d5c-81a9bffe4b59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:13.103543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff0f67-6a92-42f9-9d5c-81a9bffe4b59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:13.103543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff0f67-6a92-42f9-9d5c-81a9bffe4b59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:13.103543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff0f67-6a92-42f9-9d5c-81a9bffe4b59 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:13.116749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1037/2076] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:13.118521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff0f67-6a92-42f9-9d5c-81a9bffe4b59 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:13.131115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff0f67-6a92-42f9-9d5c-81a9bffe4b59 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:13.137195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90a3fa-a9ff-4367-b10c-1273543c47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:13.138054 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90a3fa-a9ff-4367-b10c-1273543c47f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:13.138493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90a3fa-a9ff-4367-b10c-1273543c47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:13.138891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90a3fa-a9ff-4367-b10c-1273543c47f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:13.139874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90a3fa-a9ff-4367-b10c-1273543c47f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:13.142661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90a3fa-a9ff-4367-b10c-1273543c47f0 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:13.157821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1038/2077] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:13.158889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90a3fa-a9ff-4367-b10c-1273543c47f0 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:13.160824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fd90a3fa-a9ff-4367-b10c-1273543c47f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:13.221979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90a3fa-a9ff-4367-b10c-1273543c47f0 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:13.226004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c61b71-991a-459c-9076-3fa59e1c39f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:13.226683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61b71-991a-459c-9076-3fa59e1c39f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:13.226963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61b71-991a-459c-9076-3fa59e1c39f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:13.227238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c61b71-991a-459c-9076-3fa59e1c39f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:13.236607 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c61b71-991a-459c-9076-3fa59e1c39f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:13.238083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c61b71-991a-459c-9076-3fa59e1c39f6 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:13.248172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1039/2078] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:13.249032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c61b71-991a-459c-9076-3fa59e1c39f6 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:13.259798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c61b71-991a-459c-9076-3fa59e1c39f6 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:13.265412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae431-17dc-449d-9060-bfd45f42cbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:13.266028 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae431-17dc-449d-9060-bfd45f42cbbd admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:13.266316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae431-17dc-449d-9060-bfd45f42cbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:13.266589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae431-17dc-449d-9060-bfd45f42cbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:13.267268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeae431-17dc-449d-9060-bfd45f42cbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:13.269226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeae431-17dc-449d-9060-bfd45f42cbbd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:13.339720 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5b0a19f2364872bc5d5e12e4a1a4a3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:13.355966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5b0a19f2364872bc5d5e12e4a1a4a3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:13.356853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5b0a19f2364872bc5d5e12e4a1a4a3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:13.449753 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1040/2079] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:13 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:13.449753 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae431-17dc-449d-9060-bfd45f42cbbd admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:13.513383 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5b0a19f2364872bc5d5e12e4a1a4a3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:13.514452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5b0a19f2364872bc5d5e12e4a1a4a3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:13.537961 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1040/2080] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:12 2022] DELETE /identity/v3/users/ee5b0a19f2364872bc5d5e12e4a1a4a3 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:13.545854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae431-17dc-449d-9060-bfd45f42cbbd admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:13.549153 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:13.550836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:13.612220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42440-8f14-46e4-a3a0-a058298f6c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:13.612816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42440-8f14-46e4-a3a0-a058298f6c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:13.613100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42440-8f14-46e4-a3a0-a058298f6c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:13.613381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f42440-8f14-46e4-a3a0-a058298f6c7a admin admin] PATH_INFO: `/v3/projects/63cd6b1341aa486ab1c7b8cf6a490fa5/users/1214ce442615495397d932413e0a712f/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:13.630762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f42440-8f14-46e4-a3a0-a058298f6c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cd6b1341aa486ab1c7b8cf6a490fa5, user_id=1214ce442615495397d932413e0a712f, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:13.633782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f42440-8f14-46e4-a3a0-a058298f6c7a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:13.640876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5c7ac-88f3-409c-8680-46940666be8b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:13.647754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c8ba2-d86c-45cf-b18f-35db0a9bc83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:13.648812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c8ba2-d86c-45cf-b18f-35db0a9bc83b admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:13.649298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c8ba2-d86c-45cf-b18f-35db0a9bc83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:13.649764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178c8ba2-d86c-45cf-b18f-35db0a9bc83b admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:13.650492 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c8ba2-d86c-45cf-b18f-35db0a9bc83b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:13.653138 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178c8ba2-d86c-45cf-b18f-35db0a9bc83b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:13.801430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1041/2081] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:13 2022] PUT /identity/v3/projects/63cd6b1341aa486ab1c7b8cf6a490fa5/users/1214ce442615495397d932413e0a712f/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:13.805314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42440-8f14-46e4-a3a0-a058298f6c7a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:13.810461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c5f42440-8f14-46e4-a3a0-a058298f6c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:13.811142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1041/2082] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:13 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:13.812626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c8ba2-d86c-45cf-b18f-35db0a9bc83b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:13.833094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178c8ba2-d86c-45cf-b18f-35db0a9bc83b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:13.932406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580c71-c44b-4f42-9b5a-67fa6ac1c863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:13.934089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580c71-c44b-4f42-9b5a-67fa6ac1c863 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:13.934196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580c71-c44b-4f42-9b5a-67fa6ac1c863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:13.934561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9580c71-c44b-4f42-9b5a-67fa6ac1c863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:13.935499 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9580c71-c44b-4f42-9b5a-67fa6ac1c863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:13.937503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9580c71-c44b-4f42-9b5a-67fa6ac1c863 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:13.954106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1042/2083] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:13.955991 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580c71-c44b-4f42-9b5a-67fa6ac1c863 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:13.968798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f42440-8f14-46e4-a3a0-a058298f6c7a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:13.975292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9580c71-c44b-4f42-9b5a-67fa6ac1c863 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:13.977669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2561-817f-4a9b-b8ac-f6611c4b43c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:13.978412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2561-817f-4a9b-b8ac-f6611c4b43c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:13.978772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2561-817f-4a9b-b8ac-f6611c4b43c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:13.979027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a2561-817f-4a9b-b8ac-f6611c4b43c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:13.979885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2561-817f-4a9b-b8ac-f6611c4b43c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:13.982650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a2561-817f-4a9b-b8ac-f6611c4b43c5 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:13.995610 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a824c-2bb5-48b4-8f76-4ec016b34024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:13.997450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a824c-2bb5-48b4-8f76-4ec016b34024 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:13.999623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a824c-2bb5-48b4-8f76-4ec016b34024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:13.999623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a824c-2bb5-48b4-8f76-4ec016b34024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:14.001344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a824c-2bb5-48b4-8f76-4ec016b34024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:14.019776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a824c-2bb5-48b4-8f76-4ec016b34024 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:14.022609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1042/2084] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:52:14.027543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2561-817f-4a9b-b8ac-f6611c4b43c5 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:14.047484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1043/2085] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:14.052079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a2561-817f-4a9b-b8ac-f6611c4b43c5 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:14.054166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a824c-2bb5-48b4-8f76-4ec016b34024 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:14.060866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bb767-202c-490b-af91-7dc74a420598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:14.061950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bb767-202c-490b-af91-7dc74a420598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:14.062401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bb767-202c-490b-af91-7dc74a420598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:14.063052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bb767-202c-490b-af91-7dc74a420598 admin admin] PATH_INFO: `/v3/projects/63cd6b1341aa486ab1c7b8cf6a490fa5/users/1214ce442615495397d932413e0a712f/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:14.066385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bb767-202c-490b-af91-7dc74a420598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cd6b1341aa486ab1c7b8cf6a490fa5, user_id=1214ce442615495397d932413e0a712f, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:14.071479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bb767-202c-490b-af91-7dc74a420598 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:14.071803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a824c-2bb5-48b4-8f76-4ec016b34024 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:14.079714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf69fcc-fbd8-4200-9798-ba3047b581b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:14.080672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69fcc-fbd8-4200-9798-ba3047b581b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:14.081157 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69fcc-fbd8-4200-9798-ba3047b581b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:14.081609 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf69fcc-fbd8-4200-9798-ba3047b581b9 admin admin] PATH_INFO: `/v3/projects/2b08d1c1dcf64187b53e4e3a76b6e346/users/297a016ff2944b33a06d5ce81735fb8d/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:14.091169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1043/2086] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:14 2022] PUT /identity/v3/projects/63cd6b1341aa486ab1c7b8cf6a490fa5/users/1214ce442615495397d932413e0a712f/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:14.102160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de33e6b-c22e-41ec-9c06-d3a9d88667b5 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:14.102448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de33e6b-c22e-41ec-9c06-d3a9d88667b5 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:14.102709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de33e6b-c22e-41ec-9c06-d3a9d88667b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:14.107276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf69fcc-fbd8-4200-9798-ba3047b581b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b08d1c1dcf64187b53e4e3a76b6e346, user_id=297a016ff2944b33a06d5ce81735fb8d, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:14.119130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf69fcc-fbd8-4200-9798-ba3047b581b9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:14.152045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:14.190348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0de33e6b-c22e-41ec-9c06-d3a9d88667b5 None None] MFA Rules not processed for user `1214ce442615495397d932413e0a712f`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:14.191841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0de33e6b-c22e-41ec-9c06-d3a9d88667b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:14.260339 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1044/2087] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:14 2022] PUT /identity/v3/projects/2b08d1c1dcf64187b53e4e3a76b6e346/users/297a016ff2944b33a06d5ce81735fb8d/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:14.261488 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf69fcc-fbd8-4200-9798-ba3047b581b9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:14.263718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7cf69fcc-fbd8-4200-9798-ba3047b581b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:14.290515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1044/2088] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:52:14.295500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede1921-45e3-468b-a5cd-ea852b40555c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:14.295500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede1921-45e3-468b-a5cd-ea852b40555c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:14.295500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede1921-45e3-468b-a5cd-ea852b40555c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:14.316225 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-4ede1921-45e3-468b-a5cd-ea852b40555c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:14.317550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4ede1921-45e3-468b-a5cd-ea852b40555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:14.334425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:14.367878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf69fcc-fbd8-4200-9798-ba3047b581b9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:14.378106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:14.378787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:14.379272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:14.379560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] PATH_INFO: `/v3/projects/41c830ad025d47ee9cf48fcaf3ebe320` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:14.381197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c830ad025d47ee9cf48fcaf3ebe320)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:14.383990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:14.401564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1045/2089] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:14.415414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede1921-45e3-468b-a5cd-ea852b40555c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:14.421002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4ede1921-45e3-468b-a5cd-ea852b40555c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:14.484458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede1921-45e3-468b-a5cd-ea852b40555c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:14.489177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac988f-acfd-49c0-8487-b848a159c960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:14.489904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac988f-acfd-49c0-8487-b848a159c960 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:14.490332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac988f-acfd-49c0-8487-b848a159c960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:14.490632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac988f-acfd-49c0-8487-b848a159c960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:14.501574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac988f-acfd-49c0-8487-b848a159c960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:14.503125 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac988f-acfd-49c0-8487-b848a159c960 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:14.517446 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1046/2090] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:14.518506 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac988f-acfd-49c0-8487-b848a159c960 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:14.523255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-02ac988f-acfd-49c0-8487-b848a159c960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:14.641727 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac988f-acfd-49c0-8487-b848a159c960 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:14.654197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c830ad025d47ee9cf48fcaf3ebe320', 'request_id': 'req-24fb680b-4b8b-42f0-9d7d-57c3d876efda'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:14.681934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c830ad025d47ee9cf48fcaf3ebe320', 'request_id': 'req-24fb680b-4b8b-42f0-9d7d-57c3d876efda'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:14.707988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c459ac2-94df-4421-815d-2b2fe768dfd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:14.708638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459ac2-94df-4421-815d-2b2fe768dfd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:14.708916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459ac2-94df-4421-815d-2b2fe768dfd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:14.709180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c459ac2-94df-4421-815d-2b2fe768dfd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:14.780391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c459ac2-94df-4421-815d-2b2fe768dfd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:14.782267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c459ac2-94df-4421-815d-2b2fe768dfd1 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:14.795225 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1047/2091] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:14 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:14.811451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c830ad025d47ee9cf48fcaf3ebe320', 'request_id': 'req-24fb680b-4b8b-42f0-9d7d-57c3d876efda'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:14.846521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] The token cache is being invalidate because project 41c830ad025d47ee9cf48fcaf3ebe320 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:14.847036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:14.850043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:14.850043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1045/2092] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:14 2022] DELETE /identity/v3/projects/41c830ad025d47ee9cf48fcaf3ebe320 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:14.856470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831656b2-d9e3-4932-a9df-1155585d0fed None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:14.857025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831656b2-d9e3-4932-a9df-1155585d0fed None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:14.857531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831656b2-d9e3-4932-a9df-1155585d0fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:14.895346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-831656b2-d9e3-4932-a9df-1155585d0fed None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:14.897499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-831656b2-d9e3-4932-a9df-1155585d0fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:14.958210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:14.959644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:14.971933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb680b-4b8b-42f0-9d7d-57c3d876efda admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:14.976308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7daaf-8c92-4aea-b388-2ee1fa40c578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:14.977046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7daaf-8c92-4aea-b388-2ee1fa40c578 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:14.977327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7daaf-8c92-4aea-b388-2ee1fa40c578 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:14.977661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7daaf-8c92-4aea-b388-2ee1fa40c578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:14.980021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bce7daaf-8c92-4aea-b388-2ee1fa40c578 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:14.990165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1048/2093] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:15.000046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859be88-da27-42a4-9dfb-f775549158b2 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:15.000448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859be88-da27-42a4-9dfb-f775549158b2 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:15.000754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859be88-da27-42a4-9dfb-f775549158b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:15.022223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-8859be88-da27-42a4-9dfb-f775549158b2 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:15.023496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8859be88-da27-42a4-9dfb-f775549158b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:15.031833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1049/2094] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:15.036403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859be88-da27-42a4-9dfb-f775549158b2 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:15.054953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8859be88-da27-42a4-9dfb-f775549158b2 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:15.061501 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fcca2-5a7c-4cad-bdd3-b8668fc9f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:15.062142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fcca2-5a7c-4cad-bdd3-b8668fc9f395 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:15.062424 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fcca2-5a7c-4cad-bdd3-b8668fc9f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:15.063037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768fcca2-5a7c-4cad-bdd3-b8668fc9f395 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:15.063726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fcca2-5a7c-4cad-bdd3-b8668fc9f395 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:15.064464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fcca2-5a7c-4cad-bdd3-b8668fc9f395 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:15.066594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768fcca2-5a7c-4cad-bdd3-b8668fc9f395 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:15.088274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1050/2095] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:15.096423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fcca2-5a7c-4cad-bdd3-b8668fc9f395 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:15.108121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7daaf-8c92-4aea-b388-2ee1fa40c578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:15.114409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7daaf-8c92-4aea-b388-2ee1fa40c578 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:15.117654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768fcca2-5a7c-4cad-bdd3-b8668fc9f395 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:15.131396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7f86-2031-4f91-8c34-34fb0900de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:15.131396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7f86-2031-4f91-8c34-34fb0900de82 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:15.131396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7f86-2031-4f91-8c34-34fb0900de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:15.131952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b7f86-2031-4f91-8c34-34fb0900de82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:15.133372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b7f86-2031-4f91-8c34-34fb0900de82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:15.138298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b7f86-2031-4f91-8c34-34fb0900de82 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:15.160187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1046/2096] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:14 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:15.373443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1051/2097] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:15 2022] POST /identity/v3/projects => generated 371 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:15.377892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7daaf-8c92-4aea-b388-2ee1fa40c578 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:15.389514 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7daaf-8c92-4aea-b388-2ee1fa40c578 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:15.480001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518de3e-5641-4109-9f07-db16b69584a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:15.482467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518de3e-5641-4109-9f07-db16b69584a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:15.482788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518de3e-5641-4109-9f07-db16b69584a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:15.484185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d518de3e-5641-4109-9f07-db16b69584a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:15.484911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518de3e-5641-4109-9f07-db16b69584a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:15.489053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d518de3e-5641-4109-9f07-db16b69584a5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:15.640114 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7f86-2031-4f91-8c34-34fb0900de82 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:15.651709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1047/2098] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:15 2022] POST /identity/v3/users => generated 286 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:15.660514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b7f86-2031-4f91-8c34-34fb0900de82 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:15.672164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b33a8d-2fbe-4538-9721-6b32c3f1b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:15.673765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b33a8d-2fbe-4538-9721-6b32c3f1b634 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:15.674303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b33a8d-2fbe-4538-9721-6b32c3f1b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:15.674654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b33a8d-2fbe-4538-9721-6b32c3f1b634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:15.676744 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b33a8d-2fbe-4538-9721-6b32c3f1b634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:15.679059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b33a8d-2fbe-4538-9721-6b32c3f1b634 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:15.693928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1052/2099] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:15.699686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518de3e-5641-4109-9f07-db16b69584a5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:15.717285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d518de3e-5641-4109-9f07-db16b69584a5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:15.723184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec6339-f9fb-4bee-9edb-3173942c783b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:15.723937 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6339-f9fb-4bee-9edb-3173942c783b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:15.724271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6339-f9fb-4bee-9edb-3173942c783b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:15.724657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec6339-f9fb-4bee-9edb-3173942c783b admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:15.725378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec6339-f9fb-4bee-9edb-3173942c783b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:15.728193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec6339-f9fb-4bee-9edb-3173942c783b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:15.740317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1048/2100] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:15.745532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b33a8d-2fbe-4538-9721-6b32c3f1b634 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:15.757639 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b33a8d-2fbe-4538-9721-6b32c3f1b634 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:15.765267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864d3e0-31a3-461c-a47d-df7e63e276d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:15.766410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d3e0-31a3-461c-a47d-df7e63e276d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:15.766914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d3e0-31a3-461c-a47d-df7e63e276d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:15.767412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864d3e0-31a3-461c-a47d-df7e63e276d6 admin admin] PATH_INFO: `/v3/projects/085fd08ef69243d49636326d66455e02/users/b39a6056757b441da532a16a45251544/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:15.798521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864d3e0-31a3-461c-a47d-df7e63e276d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085fd08ef69243d49636326d66455e02, user_id=b39a6056757b441da532a16a45251544, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:15.805696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864d3e0-31a3-461c-a47d-df7e63e276d6 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:15.907234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1053/2101] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:15 2022] PUT /identity/v3/projects/085fd08ef69243d49636326d66455e02/users/b39a6056757b441da532a16a45251544/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:15.925010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28fde1-c559-45fd-aec5-560dd6b3443c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:15.925990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28fde1-c559-45fd-aec5-560dd6b3443c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:15.926443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28fde1-c559-45fd-aec5-560dd6b3443c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:15.969537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-8f28fde1-c559-45fd-aec5-560dd6b3443c None None] MFA Rules not processed for user `b39a6056757b441da532a16a45251544`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:15.971851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8f28fde1-c559-45fd-aec5-560dd6b3443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:16.171752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1049/2102] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:16.204111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864d3e0-31a3-461c-a47d-df7e63e276d6 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:16.225434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e864d3e0-31a3-461c-a47d-df7e63e276d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:16.390080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864d3e0-31a3-461c-a47d-df7e63e276d6 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:16.395251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed53876-0d2a-431f-98a7-2c9df21fe2ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:16.400160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed53876-0d2a-431f-98a7-2c9df21fe2ef service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:16.400160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed53876-0d2a-431f-98a7-2c9df21fe2ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:16.400160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed53876-0d2a-431f-98a7-2c9df21fe2ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:16.406271 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed53876-0d2a-431f-98a7-2c9df21fe2ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:16.407705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed53876-0d2a-431f-98a7-2c9df21fe2ef service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:16.417293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1054/2103] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:16.440671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28fde1-c559-45fd-aec5-560dd6b3443c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:16.537920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28fde1-c559-45fd-aec5-560dd6b3443c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:16.548240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:16.549323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:16.549817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:16.550282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] PATH_INFO: `/v3/users/b39a6056757b441da532a16a45251544` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:16.551994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b39a6056757b441da532a16a45251544)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:16.554510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:16.987592 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b39a6056757b441da532a16a45251544'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:17.012749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b39a6056757b441da532a16a45251544'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:17.014275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b39a6056757b441da532a16a45251544'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:17.140909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b39a6056757b441da532a16a45251544'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:17.142554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b39a6056757b441da532a16a45251544'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:17.195167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1050/2104] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:16 2022] DELETE /identity/v3/users/b39a6056757b441da532a16a45251544 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:17.203107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6968089-cea7-4c97-bec8-a78709ab39a5 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:17.204003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6968089-cea7-4c97-bec8-a78709ab39a5 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:17.204931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6968089-cea7-4c97-bec8-a78709ab39a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:17.232950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b6968089-cea7-4c97-bec8-a78709ab39a5 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:17.235570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b6968089-cea7-4c97-bec8-a78709ab39a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:17.368117 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1055/2105] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:17.382647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:17.385783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:17.503733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e003d45-fb42-4a91-b998-9d1680e5436f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:17.511830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24baa30-4d2f-433a-978f-c4e3d0d055ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:17.512558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24baa30-4d2f-433a-978f-c4e3d0d055ea service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:17.512900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24baa30-4d2f-433a-978f-c4e3d0d055ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:17.514153 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24baa30-4d2f-433a-978f-c4e3d0d055ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:17.564344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24baa30-4d2f-433a-978f-c4e3d0d055ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:17.567049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24baa30-4d2f-433a-978f-c4e3d0d055ea service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:17.591047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1051/2106] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:18.618300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6968089-cea7-4c97-bec8-a78709ab39a5 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:18.624752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b6968089-cea7-4c97-bec8-a78709ab39a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:18.667467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6968089-cea7-4c97-bec8-a78709ab39a5 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:18.675487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:18.676233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:18.676605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:18.676891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] PATH_INFO: `/v3/projects/085fd08ef69243d49636326d66455e02` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:18.678931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=085fd08ef69243d49636326d66455e02)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:18.681992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:18.936521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085fd08ef69243d49636326d66455e02', 'request_id': 'req-8b373319-6446-43da-8339-0965688c2c69'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:18.945034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085fd08ef69243d49636326d66455e02', 'request_id': 'req-8b373319-6446-43da-8339-0965688c2c69'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:19.069416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085fd08ef69243d49636326d66455e02', 'request_id': 'req-8b373319-6446-43da-8339-0965688c2c69'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:19.115401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] The token cache is being invalidate because project 085fd08ef69243d49636326d66455e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:19.115401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:19.115401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8b373319-6446-43da-8339-0965688c2c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:19.117791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1056/2107] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:18 2022] DELETE /identity/v3/projects/085fd08ef69243d49636326d66455e02 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:19.130318 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32272-3d74-40b7-b832-92d278a93275 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:19.131778 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32272-3d74-40b7-b832-92d278a93275 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:19.132705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32272-3d74-40b7-b832-92d278a93275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:19.192191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-89d32272-3d74-40b7-b832-92d278a93275 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:19.194402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-89d32272-3d74-40b7-b832-92d278a93275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:19.364549 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1052/2108] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:19.375067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db30250-75e7-4388-9ca8-6d6e4fcb550f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:19.379449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db30250-75e7-4388-9ca8-6d6e4fcb550f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:19.379449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db30250-75e7-4388-9ca8-6d6e4fcb550f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:19.427772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7db30250-75e7-4388-9ca8-6d6e4fcb550f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:19.430682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7db30250-75e7-4388-9ca8-6d6e4fcb550f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:19.456271 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1057/2109] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:19.458979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32272-3d74-40b7-b832-92d278a93275 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:19.474821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32272-3d74-40b7-b832-92d278a93275 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:19.490750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bae58-3106-4c2b-bb6f-0ad5e9a9dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:19.492099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bae58-3106-4c2b-bb6f-0ad5e9a9dec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:19.492376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bae58-3106-4c2b-bb6f-0ad5e9a9dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:19.493848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bae58-3106-4c2b-bb6f-0ad5e9a9dec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:19.494600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bae58-3106-4c2b-bb6f-0ad5e9a9dec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:19.496671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bae58-3106-4c2b-bb6f-0ad5e9a9dec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:19.501512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bae58-3106-4c2b-bb6f-0ad5e9a9dec9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:19.538818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1053/2110] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:19.540314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db30250-75e7-4388-9ca8-6d6e4fcb550f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:19.553896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db30250-75e7-4388-9ca8-6d6e4fcb550f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:19.557609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:19.570900 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121dec4-59dd-445f-a6cf-81101b1eb041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:19.571549 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121dec4-59dd-445f-a6cf-81101b1eb041 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:19.571829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121dec4-59dd-445f-a6cf-81101b1eb041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:19.572096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121dec4-59dd-445f-a6cf-81101b1eb041 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:19.572784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121dec4-59dd-445f-a6cf-81101b1eb041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:19.574853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121dec4-59dd-445f-a6cf-81101b1eb041 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:19.625488 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:19.801125 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1058/2111] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:19 2022] POST /identity/v3/projects => generated 375 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:19.811272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bae58-3106-4c2b-bb6f-0ad5e9a9dec9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:19.824670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bae58-3106-4c2b-bb6f-0ad5e9a9dec9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:19.947000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d693b0-ace5-47d4-afdf-3ef9a87bc7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:19.948247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d693b0-ace5-47d4-afdf-3ef9a87bc7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:19.948823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d693b0-ace5-47d4-afdf-3ef9a87bc7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:19.949246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d693b0-ace5-47d4-afdf-3ef9a87bc7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:19.950076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d693b0-ace5-47d4-afdf-3ef9a87bc7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:19.953435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d693b0-ace5-47d4-afdf-3ef9a87bc7a0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:20.140820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1054/2112] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:19 2022] POST /identity/v3/users => generated 288 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:20.145156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121dec4-59dd-445f-a6cf-81101b1eb041 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:20.185509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121dec4-59dd-445f-a6cf-81101b1eb041 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:20.237370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa0848-6c2b-4147-a17f-656f077b268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:20.238209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa0848-6c2b-4147-a17f-656f077b268c admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:20.238588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa0848-6c2b-4147-a17f-656f077b268c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:20.242083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa0848-6c2b-4147-a17f-656f077b268c admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:20.242833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa0848-6c2b-4147-a17f-656f077b268c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:20.248452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa0848-6c2b-4147-a17f-656f077b268c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:20.302784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1059/2113] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:20.307257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d693b0-ace5-47d4-afdf-3ef9a87bc7a0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:20.345252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d693b0-ace5-47d4-afdf-3ef9a87bc7a0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:20.384444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1cfd3-3f4d-4b2c-9240-24fc4a5113d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:20.385122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1cfd3-3f4d-4b2c-9240-24fc4a5113d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:20.385409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1cfd3-3f4d-4b2c-9240-24fc4a5113d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:20.385687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1cfd3-3f4d-4b2c-9240-24fc4a5113d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:20.386889 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1cfd3-3f4d-4b2c-9240-24fc4a5113d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:20.388632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1cfd3-3f4d-4b2c-9240-24fc4a5113d7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:20.416536 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1055/2114] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:52:20.419276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa0848-6c2b-4147-a17f-656f077b268c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:20.436653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa0848-6c2b-4147-a17f-656f077b268c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:20.442244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2cf52-0f4d-4408-a442-aaf1bd16a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:20.443342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2cf52-0f4d-4408-a442-aaf1bd16a380 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:20.443918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2cf52-0f4d-4408-a442-aaf1bd16a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:20.444421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2cf52-0f4d-4408-a442-aaf1bd16a380 admin admin] PATH_INFO: `/v3/projects/5e257ffba1e743b2a699a2c45ac9ad41/users/82e1040b0d9d4eae852219dfbccde184/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:20.467753 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2cf52-0f4d-4408-a442-aaf1bd16a380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e257ffba1e743b2a699a2c45ac9ad41, user_id=82e1040b0d9d4eae852219dfbccde184, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:20.471752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2cf52-0f4d-4408-a442-aaf1bd16a380 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:20.646177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1060/2115] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:20 2022] PUT /identity/v3/projects/5e257ffba1e743b2a699a2c45ac9ad41/users/82e1040b0d9d4eae852219dfbccde184/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:52:20.652973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee2c47-0f55-4bbe-bd77-e7c9c5bd19d4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:20.653641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee2c47-0f55-4bbe-bd77-e7c9c5bd19d4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:20.654044 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee2c47-0f55-4bbe-bd77-e7c9c5bd19d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:20.701899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-92ee2c47-0f55-4bbe-bd77-e7c9c5bd19d4 None None] MFA Rules not processed for user `82e1040b0d9d4eae852219dfbccde184`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:20.703309 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-92ee2c47-0f55-4bbe-bd77-e7c9c5bd19d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:20.795764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1056/2116] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:52:20.798975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2cf52-0f4d-4408-a442-aaf1bd16a380 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:20.895916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2cf52-0f4d-4408-a442-aaf1bd16a380 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:20.907334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c6310-abe1-4524-a5f9-52401ecec8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:20.908812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c6310-abe1-4524-a5f9-52401ecec8fd admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:20.909204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c6310-abe1-4524-a5f9-52401ecec8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:20.909579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c6310-abe1-4524-a5f9-52401ecec8fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:20.911074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c6310-abe1-4524-a5f9-52401ecec8fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:20.913672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c6310-abe1-4524-a5f9-52401ecec8fd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:21.149559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1061/2117] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:20 2022] POST /identity/v3/projects => generated 375 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:21.152137 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee2c47-0f55-4bbe-bd77-e7c9c5bd19d4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:21.176979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee2c47-0f55-4bbe-bd77-e7c9c5bd19d4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:21.267968 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e84c8-0333-4acb-b4f6-fd85798d043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:21.268802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e84c8-0333-4acb-b4f6-fd85798d043c admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:21.269267 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e84c8-0333-4acb-b4f6-fd85798d043c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:21.269425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e84c8-0333-4acb-b4f6-fd85798d043c admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:21.270529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e84c8-0333-4acb-b4f6-fd85798d043c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:21.272831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e84c8-0333-4acb-b4f6-fd85798d043c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:21.415262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1057/2118] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:21 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:21.423172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c6310-abe1-4524-a5f9-52401ecec8fd admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:21.445343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c6310-abe1-4524-a5f9-52401ecec8fd admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:21.452876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7264-7008-4f40-b0cc-e56e4a8e4c3d None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:21.454188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7264-7008-4f40-b0cc-e56e4a8e4c3d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:21.455132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b7264-7008-4f40-b0cc-e56e4a8e4c3d None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:21.457775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1058/2119] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:52:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:52:21.461818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2fd80-830b-4f07-a97c-0d5e0adf2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:21.462957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2fd80-830b-4f07-a97c-0d5e0adf2691 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:21.463410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2fd80-830b-4f07-a97c-0d5e0adf2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:21.463856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2fd80-830b-4f07-a97c-0d5e0adf2691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:21.465267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2fd80-830b-4f07-a97c-0d5e0adf2691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:21.468087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2fd80-830b-4f07-a97c-0d5e0adf2691 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:21.472310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755631fb-de45-43e5-be77-baf79aa48637 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:21.473014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755631fb-de45-43e5-be77-baf79aa48637 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:21.474764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755631fb-de45-43e5-be77-baf79aa48637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:21.505350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1062/2120] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:21.512636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2fd80-830b-4f07-a97c-0d5e0adf2691 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:21.536415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2fd80-830b-4f07-a97c-0d5e0adf2691 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:21.546077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3757ebb-9eef-4577-8fd7-19c3805a93c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:21.547182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3757ebb-9eef-4577-8fd7-19c3805a93c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:21.547739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3757ebb-9eef-4577-8fd7-19c3805a93c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:21.548305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3757ebb-9eef-4577-8fd7-19c3805a93c9 admin admin] PATH_INFO: `/v3/projects/1684c09f68c64e60a31bbbcdd8dc41c3/users/b2fc77349f7c424b9688c1defbe2e728/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:21.570406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3757ebb-9eef-4577-8fd7-19c3805a93c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1684c09f68c64e60a31bbbcdd8dc41c3, user_id=b2fc77349f7c424b9688c1defbe2e728, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:21.573676 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-755631fb-de45-43e5-be77-baf79aa48637 None None] MFA Rules not processed for user `dca09f6fe11f4b878dd11c4cb69ca7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:21.576010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3757ebb-9eef-4577-8fd7-19c3805a93c9 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:21.579513 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-755631fb-de45-43e5-be77-baf79aa48637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:21.663202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1063/2121] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:21 2022] PUT /identity/v3/projects/1684c09f68c64e60a31bbbcdd8dc41c3/users/b2fc77349f7c424b9688c1defbe2e728/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:21.673824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3757ebb-9eef-4577-8fd7-19c3805a93c9 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:21.755754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1059/2122] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:52:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:21.785895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3757ebb-9eef-4577-8fd7-19c3805a93c9 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:21.786478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755631fb-de45-43e5-be77-baf79aa48637 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:21.789990 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-755631fb-de45-43e5-be77-baf79aa48637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:21.802741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4473-c599-4b15-b67a-c6fc884f4727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:21.803406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4473-c599-4b15-b67a-c6fc884f4727 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:21.803710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4473-c599-4b15-b67a-c6fc884f4727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:21.804005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4473-c599-4b15-b67a-c6fc884f4727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:21.808067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee4473-c599-4b15-b67a-c6fc884f4727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:21.812367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee4473-c599-4b15-b67a-c6fc884f4727 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:21.817438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755631fb-de45-43e5-be77-baf79aa48637 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:21.838107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1064/2123] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:21.845816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4473-c599-4b15-b67a-c6fc884f4727 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:21.871042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4473-c599-4b15-b67a-c6fc884f4727 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:21.882281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe0492-bee7-4d30-b9a6-211fe5d3150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:21.883071 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe0492-bee7-4d30-b9a6-211fe5d3150d admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:21.883373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe0492-bee7-4d30-b9a6-211fe5d3150d admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:21.883673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe0492-bee7-4d30-b9a6-211fe5d3150d admin admin] PATH_INFO: `/v3/projects/1684c09f68c64e60a31bbbcdd8dc41c3/users/b2fc77349f7c424b9688c1defbe2e728/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:21.891448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe0492-bee7-4d30-b9a6-211fe5d3150d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1684c09f68c64e60a31bbbcdd8dc41c3, user_id=b2fc77349f7c424b9688c1defbe2e728, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:21.891448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe0492-bee7-4d30-b9a6-211fe5d3150d admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:21.907617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1065/2124] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:21 2022] PUT /identity/v3/projects/1684c09f68c64e60a31bbbcdd8dc41c3/users/b2fc77349f7c424b9688c1defbe2e728/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:21.920300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6377-5779-406a-9ab1-febc832b740d None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:21.920653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6377-5779-406a-9ab1-febc832b740d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:21.920900 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa6377-5779-406a-9ab1-febc832b740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:21.971680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c017e-dd1a-49ee-b190-0dd3163c4d14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca09f6fe11f4b878dd11c4cb69ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:21.972462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c017e-dd1a-49ee-b190-0dd3163c4d14 service placement] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:21.972815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c017e-dd1a-49ee-b190-0dd3163c4d14 service placement] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:21.973538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c017e-dd1a-49ee-b190-0dd3163c4d14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:21.977942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9eaa6377-5779-406a-9ab1-febc832b740d None None] MFA Rules not processed for user `b2fc77349f7c424b9688c1defbe2e728`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:21.979180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9eaa6377-5779-406a-9ab1-febc832b740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:21.994816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c017e-dd1a-49ee-b190-0dd3163c4d14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:22.000060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c017e-dd1a-49ee-b190-0dd3163c4d14 service placement] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:22.029387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1060/2125] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:22.108621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1066/2126] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:52:22.121628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c017e-dd1a-49ee-b190-0dd3163c4d14 service placement] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:22.123402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a69c017e-dd1a-49ee-b190-0dd3163c4d14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:22.209938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c017e-dd1a-49ee-b190-0dd3163c4d14 service placement] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:22.265598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4eec7a-ed83-4c50-b763-939d1be3afcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:22.271136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eec7a-ed83-4c50-b763-939d1be3afcb service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:22.271136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eec7a-ed83-4c50-b763-939d1be3afcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:22.271136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eec7a-ed83-4c50-b763-939d1be3afcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:22.340963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4eec7a-ed83-4c50-b763-939d1be3afcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:22.342673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4eec7a-ed83-4c50-b763-939d1be3afcb service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:22.353232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1061/2127] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:23.298278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6377-5779-406a-9ab1-febc832b740d None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:23.301574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9eaa6377-5779-406a-9ab1-febc832b740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:23.509926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa6377-5779-406a-9ab1-febc832b740d None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:23.521646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:23.522316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:23.522601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:23.522877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] PATH_INFO: `/v3/users/ad1787af22c94bc8a3599abf7e8fbe39` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:23.526038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1787af22c94bc8a3599abf7e8fbe39)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:23.536815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:23.803681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1787af22c94bc8a3599abf7e8fbe39'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:23.814337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1787af22c94bc8a3599abf7e8fbe39'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:23.815351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1787af22c94bc8a3599abf7e8fbe39'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:23.841404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4eec7a-ed83-4c50-b763-939d1be3afcb service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:23.845482 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3f4eec7a-ed83-4c50-b763-939d1be3afcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:23.882642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4eec7a-ed83-4c50-b763-939d1be3afcb service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:23.900022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:23.900787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:23.901178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:23.902227 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] PATH_INFO: `/v3/users/b6b96ebee8ca4a239624f308cd20030b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:23.921346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b96ebee8ca4a239624f308cd20030b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:23.921346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:23.939821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1787af22c94bc8a3599abf7e8fbe39'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:23.965761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-69e7edb9-beab-4c0d-ac94-c824639dc6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1787af22c94bc8a3599abf7e8fbe39'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:23.988476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1067/2128] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:23 2022] DELETE /identity/v3/users/ad1787af22c94bc8a3599abf7e8fbe39 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:24.224834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b96ebee8ca4a239624f308cd20030b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:24.235863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b96ebee8ca4a239624f308cd20030b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:24.237098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b96ebee8ca4a239624f308cd20030b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:24.287802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:24.331927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:24.335714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b96ebee8ca4a239624f308cd20030b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:24.335714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b96ebee8ca4a239624f308cd20030b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:24.404452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1062/2129] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:23 2022] DELETE /identity/v3/users/b6b96ebee8ca4a239624f308cd20030b => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:24.422677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be40ae-1c51-42d6-8b3b-2c548ce9f720 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:24.423304 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be40ae-1c51-42d6-8b3b-2c548ce9f720 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:24.423883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be40ae-1c51-42d6-8b3b-2c548ce9f720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:24.473249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-08be40ae-1c51-42d6-8b3b-2c548ce9f720 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:24.473249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-08be40ae-1c51-42d6-8b3b-2c548ce9f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:24.565013 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1068/2130] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:24.578683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:24.580812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:24.643600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a070cc-acc1-4ded-8ff4-a919011a020e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:24.643896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a070cc-acc1-4ded-8ff4-a919011a020e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:24.644176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a070cc-acc1-4ded-8ff4-a919011a020e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:24.706357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-60a070cc-acc1-4ded-8ff4-a919011a020e None None] MFA Rules not processed for user `297a016ff2944b33a06d5ce81735fb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:24.707629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-60a070cc-acc1-4ded-8ff4-a919011a020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:24.789642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a0ca3-8e0c-4532-ab9d-84edb3fb60be admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:24.798936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d97d28-0860-40e5-a0bb-7bc4c344e0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:24.799737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97d28-0860-40e5-a0bb-7bc4c344e0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:24.800276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97d28-0860-40e5-a0bb-7bc4c344e0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:24.800609 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d97d28-0860-40e5-a0bb-7bc4c344e0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:24.814156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d97d28-0860-40e5-a0bb-7bc4c344e0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:24.818325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d97d28-0860-40e5-a0bb-7bc4c344e0a5 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:24.829332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1063/2131] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:24.831201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d97d28-0860-40e5-a0bb-7bc4c344e0a5 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:24.835941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b5d97d28-0860-40e5-a0bb-7bc4c344e0a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:24.869912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1069/2132] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:24.871162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a070cc-acc1-4ded-8ff4-a919011a020e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:24.874008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-60a070cc-acc1-4ded-8ff4-a919011a020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:24.877380 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d97d28-0860-40e5-a0bb-7bc4c344e0a5 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:24.888146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:24.889793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:24.890361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:24.890807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] PATH_INFO: `/v3/projects/91575ac1354247dca14aff7bbfe5d111` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:24.893239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91575ac1354247dca14aff7bbfe5d111)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:24.895401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:24.905097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a070cc-acc1-4ded-8ff4-a919011a020e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:24.920966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fdbe9-fa1a-4fbe-a54b-d6d971f85751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:24.921644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fdbe9-fa1a-4fbe-a54b-d6d971f85751 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:24.921934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fdbe9-fa1a-4fbe-a54b-d6d971f85751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:24.922211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fdbe9-fa1a-4fbe-a54b-d6d971f85751 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:24.922952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fdbe9-fa1a-4fbe-a54b-d6d971f85751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:24.926187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122fdbe9-fa1a-4fbe-a54b-d6d971f85751 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:25.072465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91575ac1354247dca14aff7bbfe5d111', 'request_id': 'req-03395c9b-7d0e-42fb-b454-990d39606021'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:25.084117 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1070/2133] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:24 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:52:25.098023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fdbe9-fa1a-4fbe-a54b-d6d971f85751 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:25.102873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91575ac1354247dca14aff7bbfe5d111', 'request_id': 'req-03395c9b-7d0e-42fb-b454-990d39606021'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:25.217721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91575ac1354247dca14aff7bbfe5d111', 'request_id': 'req-03395c9b-7d0e-42fb-b454-990d39606021'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:25.238113 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] The token cache is being invalidate because project 91575ac1354247dca14aff7bbfe5d111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:25.238675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:25.239803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:25.246732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1064/2134] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:24 2022] DELETE /identity/v3/projects/91575ac1354247dca14aff7bbfe5d111 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:25.247964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:25.250722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:25.362542 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fdbe9-fa1a-4fbe-a54b-d6d971f85751 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:25.370324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d2204-ca0b-4a97-8bfe-b57c74eb6f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:25.371504 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2204-ca0b-4a97-8bfe-b57c74eb6f5c admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:25.371787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2204-ca0b-4a97-8bfe-b57c74eb6f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:25.372111 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2204-ca0b-4a97-8bfe-b57c74eb6f5c admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:25.372848 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d2204-ca0b-4a97-8bfe-b57c74eb6f5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:25.377244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d2204-ca0b-4a97-8bfe-b57c74eb6f5c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:25.380929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03395c9b-7d0e-42fb-b454-990d39606021 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:25.387041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:25.391585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:25.391585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:25.391585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] PATH_INFO: `/v3/users/154ab53b40b1409a9b1f359933c8e018` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:25.391585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154ab53b40b1409a9b1f359933c8e018)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:25.392852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:25.524892 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1071/2135] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:25 2022] POST /identity/v3/users => generated 293 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:52:25.529666 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d2204-ca0b-4a97-8bfe-b57c74eb6f5c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:25.534974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-050d2204-ca0b-4a97-8bfe-b57c74eb6f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:25.566629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d2204-ca0b-4a97-8bfe-b57c74eb6f5c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:25.583403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c004b2-5ba6-4ee6-a0c1-009fe733da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:25.585032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c004b2-5ba6-4ee6-a0c1-009fe733da3d admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:25.585309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c004b2-5ba6-4ee6-a0c1-009fe733da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:25.587871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c004b2-5ba6-4ee6-a0c1-009fe733da3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:25.588734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c004b2-5ba6-4ee6-a0c1-009fe733da3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:25.591058 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c004b2-5ba6-4ee6-a0c1-009fe733da3d admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:25.622987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1072/2136] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:25.630085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c004b2-5ba6-4ee6-a0c1-009fe733da3d admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:25.652725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c004b2-5ba6-4ee6-a0c1-009fe733da3d admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:25.661493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab7470-ccc5-429a-be20-9c61196c2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:25.662588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab7470-ccc5-429a-be20-9c61196c2962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:25.663117 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab7470-ccc5-429a-be20-9c61196c2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:25.664050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab7470-ccc5-429a-be20-9c61196c2962 admin admin] PATH_INFO: `/v3/projects/1e2a4c47764e425f8d054a49468caaa4/users/102d4c23a15b4f08aa33d12d5d7639ba/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:25.685479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab7470-ccc5-429a-be20-9c61196c2962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2a4c47764e425f8d054a49468caaa4, user_id=102d4c23a15b4f08aa33d12d5d7639ba, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:25.690349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab7470-ccc5-429a-be20-9c61196c2962 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:25.724709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154ab53b40b1409a9b1f359933c8e018'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:25.757911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154ab53b40b1409a9b1f359933c8e018'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:25.759025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154ab53b40b1409a9b1f359933c8e018'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:25.814317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1073/2137] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:25 2022] PUT /identity/v3/projects/1e2a4c47764e425f8d054a49468caaa4/users/102d4c23a15b4f08aa33d12d5d7639ba/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:25.822952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab7470-ccc5-429a-be20-9c61196c2962 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:25.879783 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154ab53b40b1409a9b1f359933c8e018'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:25.883354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154ab53b40b1409a9b1f359933c8e018'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:25.928915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1065/2138] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:25 2022] DELETE /identity/v3/users/154ab53b40b1409a9b1f359933c8e018 => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:25.960578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab7470-ccc5-429a-be20-9c61196c2962 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:26.050719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a868f-ff2b-41a9-b59f-c7a0503313b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:26.061375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a868f-ff2b-41a9-b59f-c7a0503313b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:26.061693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a868f-ff2b-41a9-b59f-c7a0503313b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:26.062487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a868f-ff2b-41a9-b59f-c7a0503313b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:26.064230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a868f-ff2b-41a9-b59f-c7a0503313b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:26.069818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a868f-ff2b-41a9-b59f-c7a0503313b2 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:26.101910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1074/2139] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:26.102799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:26.105627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:26.148372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad73559-c34c-49df-9018-3de4f4639432 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:26.154919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b12ca5-890a-4a6e-a598-2a313ff1c76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:26.171557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b12ca5-890a-4a6e-a598-2a313ff1c76d admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:26.171557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b12ca5-890a-4a6e-a598-2a313ff1c76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:26.171557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b12ca5-890a-4a6e-a598-2a313ff1c76d admin admin] PATH_INFO: `/v3/projects/1e2a4c47764e425f8d054a49468caaa4/users/102d4c23a15b4f08aa33d12d5d7639ba/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:26.171557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b12ca5-890a-4a6e-a598-2a313ff1c76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2a4c47764e425f8d054a49468caaa4, user_id=102d4c23a15b4f08aa33d12d5d7639ba, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:26.171557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b12ca5-890a-4a6e-a598-2a313ff1c76d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:26.174166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1066/2140] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:26 2022] PUT /identity/v3/projects/1e2a4c47764e425f8d054a49468caaa4/users/102d4c23a15b4f08aa33d12d5d7639ba/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:26.451523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a868f-ff2b-41a9-b59f-c7a0503313b2 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:26.451523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-773a868f-ff2b-41a9-b59f-c7a0503313b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:26.473925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a868f-ff2b-41a9-b59f-c7a0503313b2 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:26.555307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b12ca5-890a-4a6e-a598-2a313ff1c76d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:26.557476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e0b12ca5-890a-4a6e-a598-2a313ff1c76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:26.644809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:26.644809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:26.644809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:26.644809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] PATH_INFO: `/v3/projects/9c41cdff3e574b00aa3145678bbc6453` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:26.645626 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c41cdff3e574b00aa3145678bbc6453)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:26.645626 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:26.710876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b12ca5-890a-4a6e-a598-2a313ff1c76d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:26.719660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:26.719660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:26.719660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:26.719660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] PATH_INFO: `/v3/projects/ffdecce8660041cc93143da0a051cf06` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:26.721353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffdecce8660041cc93143da0a051cf06)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:26.724707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:26.846808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c41cdff3e574b00aa3145678bbc6453', 'request_id': 'req-337e2d9a-9385-4f53-b3e0-c626719c3b8d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:26.859484 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c41cdff3e574b00aa3145678bbc6453', 'request_id': 'req-337e2d9a-9385-4f53-b3e0-c626719c3b8d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:26.950020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c41cdff3e574b00aa3145678bbc6453', 'request_id': 'req-337e2d9a-9385-4f53-b3e0-c626719c3b8d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:26.951213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdecce8660041cc93143da0a051cf06', 'request_id': 'req-cc54a82e-1080-4dc2-bb16-ab18fd12838c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:26.958489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdecce8660041cc93143da0a051cf06', 'request_id': 'req-cc54a82e-1080-4dc2-bb16-ab18fd12838c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:26.962650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] The token cache is being invalidate because project 9c41cdff3e574b00aa3145678bbc6453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:26.963006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:26.963703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:26.965302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1075/2141] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:26 2022] DELETE /identity/v3/projects/9c41cdff3e574b00aa3145678bbc6453 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:26.966331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:26.967667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:27.044741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e2d9a-9385-4f53-b3e0-c626719c3b8d admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:27.106320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdecce8660041cc93143da0a051cf06', 'request_id': 'req-cc54a82e-1080-4dc2-bb16-ab18fd12838c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.106514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:27.107400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:27.109129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:27.109659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:27.110186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] PATH_INFO: `/v3/users/82e1040b0d9d4eae852219dfbccde184` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:27.113168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e1040b0d9d4eae852219dfbccde184)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:27.121283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:27.126160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] The token cache is being invalidate because project ffdecce8660041cc93143da0a051cf06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:27.126457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.127365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.128954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1067/2142] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:26 2022] DELETE /identity/v3/projects/ffdecce8660041cc93143da0a051cf06 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:27.130286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:27.131982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:27.146122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54a82e-1080-4dc2-bb16-ab18fd12838c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:27.175200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:27.176656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:27.178898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:27.179389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] PATH_INFO: `/v3/users/1214ce442615495397d932413e0a712f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:27.186175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1214ce442615495397d932413e0a712f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:27.189289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:27.295395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:27.430091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e1040b0d9d4eae852219dfbccde184'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.440814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e1040b0d9d4eae852219dfbccde184'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.441645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e1040b0d9d4eae852219dfbccde184'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.474397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1214ce442615495397d932413e0a712f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.486399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1214ce442615495397d932413e0a712f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.487617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1214ce442615495397d932413e0a712f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.549122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e1040b0d9d4eae852219dfbccde184'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.585813 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e2d7721e-4371-407b-9bf7-ebbb5b6c7edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e1040b0d9d4eae852219dfbccde184'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.598180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1076/2143] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:26 2022] DELETE /identity/v3/users/82e1040b0d9d4eae852219dfbccde184 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:27.603942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d16ae-ebcf-4d3b-9b0d-2e275f037649 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:27.604547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d16ae-ebcf-4d3b-9b0d-2e275f037649 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:27.605030 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d16ae-ebcf-4d3b-9b0d-2e275f037649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:27.647498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c15d16ae-ebcf-4d3b-9b0d-2e275f037649 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:27.648943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c15d16ae-ebcf-4d3b-9b0d-2e275f037649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:27.660830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1214ce442615495397d932413e0a712f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.674732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17c25f68-0633-4c86-9ba6-4aea3f2ccacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1214ce442615495397d932413e0a712f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:27.711761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1068/2144] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:27 2022] DELETE /identity/v3/users/1214ce442615495397d932413e0a712f => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:27.714740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b00c52-f4d2-4628-a8e7-00757233a6c9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:27.715325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b00c52-f4d2-4628-a8e7-00757233a6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:27.715878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b00c52-f4d2-4628-a8e7-00757233a6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:27.755190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-48b00c52-f4d2-4628-a8e7-00757233a6c9 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:27.757126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-48b00c52-f4d2-4628-a8e7-00757233a6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:27.816189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1077/2145] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:27.817987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef4aa-d843-446c-840c-d719d502208e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:27.824277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef4aa-d843-446c-840c-d719d502208e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:27.824277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef4aa-d843-446c-840c-d719d502208e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:27.864990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7c6ef4aa-d843-446c-840c-d719d502208e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:27.866284 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7c6ef4aa-d843-446c-840c-d719d502208e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:27.913163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1069/2146] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:27.934844 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b00c52-f4d2-4628-a8e7-00757233a6c9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:27.937108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-48b00c52-f4d2-4628-a8e7-00757233a6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:27.995518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1078/2147] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:52:28.011619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef4aa-d843-446c-840c-d719d502208e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:28.035996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef4aa-d843-446c-840c-d719d502208e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:28.039080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2272ae-1b63-4799-97df-6250425125f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:28.040051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2272ae-1b63-4799-97df-6250425125f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:28.040445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2272ae-1b63-4799-97df-6250425125f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:28.040827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2272ae-1b63-4799-97df-6250425125f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:28.041746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2272ae-1b63-4799-97df-6250425125f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:28.042851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2272ae-1b63-4799-97df-6250425125f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:28.045159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2272ae-1b63-4799-97df-6250425125f3 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:28.056097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b00c52-f4d2-4628-a8e7-00757233a6c9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:28.081247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e79f-1ac2-4aac-a02c-bd2abe00119a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:28.082385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e79f-1ac2-4aac-a02c-bd2abe00119a service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:28.082669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e79f-1ac2-4aac-a02c-bd2abe00119a service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:28.082934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e79f-1ac2-4aac-a02c-bd2abe00119a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:28.097896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1079/2148] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:28.098129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2272ae-1b63-4799-97df-6250425125f3 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:28.135753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e79f-1ac2-4aac-a02c-bd2abe00119a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:28.139144 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e79f-1ac2-4aac-a02c-bd2abe00119a service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:28.157920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2272ae-1b63-4799-97df-6250425125f3 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:28.180342 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1070/2149] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:52:28.199165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f96c-ba01-4cea-b2d4-9c474ecb1dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:28.199165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f96c-ba01-4cea-b2d4-9c474ecb1dbc admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:28.199165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f96c-ba01-4cea-b2d4-9c474ecb1dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:28.199165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f96c-ba01-4cea-b2d4-9c474ecb1dbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:28.199802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4f96c-ba01-4cea-b2d4-9c474ecb1dbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:28.199802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4f96c-ba01-4cea-b2d4-9c474ecb1dbc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:28.373201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e79f-1ac2-4aac-a02c-bd2abe00119a service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:28.377464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1080/2150] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:28 2022] POST /identity/v3/projects => generated 381 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:28.397246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e79f-1ac2-4aac-a02c-bd2abe00119a service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:28.583184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb187bf-9e71-48d5-a679-f7fe415e9eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:28.584826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb187bf-9e71-48d5-a679-f7fe415e9eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:28.585638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb187bf-9e71-48d5-a679-f7fe415e9eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:28.586094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb187bf-9e71-48d5-a679-f7fe415e9eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:28.587925 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb187bf-9e71-48d5-a679-f7fe415e9eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:28.591136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb187bf-9e71-48d5-a679-f7fe415e9eb1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:28.763445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f96c-ba01-4cea-b2d4-9c474ecb1dbc admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:28.765462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-dce4f96c-ba01-4cea-b2d4-9c474ecb1dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:28.774968 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1071/2151] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:28 2022] POST /identity/v3/users => generated 291 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:52:28.780011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb187bf-9e71-48d5-a679-f7fe415e9eb1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:28.801391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb187bf-9e71-48d5-a679-f7fe415e9eb1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:28.807195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fac1d1-51d7-4f0d-a5b0-0c7f34130229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:28.807913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fac1d1-51d7-4f0d-a5b0-0c7f34130229 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:28.808198 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fac1d1-51d7-4f0d-a5b0-0c7f34130229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:28.808490 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fac1d1-51d7-4f0d-a5b0-0c7f34130229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:28.809169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fac1d1-51d7-4f0d-a5b0-0c7f34130229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:28.810907 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fac1d1-51d7-4f0d-a5b0-0c7f34130229 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:28.824147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f96c-ba01-4cea-b2d4-9c474ecb1dbc admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:28.831699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:28.832747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1072/2152] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:52:28.847103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:28.847392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:28.847719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] PATH_INFO: `/v3/projects/63cd6b1341aa486ab1c7b8cf6a490fa5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:28.852200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cd6b1341aa486ab1c7b8cf6a490fa5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:28.853143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fac1d1-51d7-4f0d-a5b0-0c7f34130229 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:28.854475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:28.879272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fac1d1-51d7-4f0d-a5b0-0c7f34130229 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:28.894213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20d8a9-1ca4-4fef-9e42-402996595c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:28.894854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d8a9-1ca4-4fef-9e42-402996595c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:28.895241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d8a9-1ca4-4fef-9e42-402996595c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:28.895408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20d8a9-1ca4-4fef-9e42-402996595c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:28.896064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20d8a9-1ca4-4fef-9e42-402996595c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:28.900151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20d8a9-1ca4-4fef-9e42-402996595c4d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:28.921372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1073/2153] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:28.925807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20d8a9-1ca4-4fef-9e42-402996595c4d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:28.944957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20d8a9-1ca4-4fef-9e42-402996595c4d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:28.964941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584973e-2c23-4e2a-ad05-303ff6d71f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:28.966057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584973e-2c23-4e2a-ad05-303ff6d71f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:28.966570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584973e-2c23-4e2a-ad05-303ff6d71f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:28.967056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584973e-2c23-4e2a-ad05-303ff6d71f9e admin admin] PATH_INFO: `/v3/projects/8942320def6548e89d1027d55877b1d3/users/f3d001c0d4b8452891452e191590d3f3/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:29.015903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584973e-2c23-4e2a-ad05-303ff6d71f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8942320def6548e89d1027d55877b1d3, user_id=f3d001c0d4b8452891452e191590d3f3, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:29.024125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584973e-2c23-4e2a-ad05-303ff6d71f9e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:29.054756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cd6b1341aa486ab1c7b8cf6a490fa5', 'request_id': 'req-2c9f11e4-4f41-46b8-800a-c879aa18d253'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:29.067104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cd6b1341aa486ab1c7b8cf6a490fa5', 'request_id': 'req-2c9f11e4-4f41-46b8-800a-c879aa18d253'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:29.216025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cd6b1341aa486ab1c7b8cf6a490fa5', 'request_id': 'req-2c9f11e4-4f41-46b8-800a-c879aa18d253'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:29.235786 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1074/2154] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:28 2022] PUT /identity/v3/projects/8942320def6548e89d1027d55877b1d3/users/f3d001c0d4b8452891452e191590d3f3/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:29.247301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9fd4f-958f-4433-9a15-f99dc34d86dd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:29.247690 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9fd4f-958f-4433-9a15-f99dc34d86dd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:29.247852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9fd4f-958f-4433-9a15-f99dc34d86dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:29.257719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] The token cache is being invalidate because project 63cd6b1341aa486ab1c7b8cf6a490fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:29.258684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:29.262280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:29.267553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1081/2155] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:28 2022] DELETE /identity/v3/projects/63cd6b1341aa486ab1c7b8cf6a490fa5 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:29.270616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:29.277624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:29.328135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a2b9fd4f-958f-4433-9a15-f99dc34d86dd None None] MFA Rules not processed for user `f3d001c0d4b8452891452e191590d3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:29.329732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a2b9fd4f-958f-4433-9a15-f99dc34d86dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:29.426396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f11e4-4f41-46b8-800a-c879aa18d253 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:29.535094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1075/2156] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:29.537789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bc51-5bcf-4b41-b65d-339f45f85817 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:29.538083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bc51-5bcf-4b41-b65d-339f45f85817 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:29.538364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11bc51-5bcf-4b41-b65d-339f45f85817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:29.569457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9f11bc51-5bcf-4b41-b65d-339f45f85817 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:29.573187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9f11bc51-5bcf-4b41-b65d-339f45f85817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:29.634974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:29.637098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:29.637775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:29.638384 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] PATH_INFO: `/v3/projects/5e257ffba1e743b2a699a2c45ac9ad41` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:29.641566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e257ffba1e743b2a699a2c45ac9ad41)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:29.646100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:29.725149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1076/2157] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:29.733558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11bc51-5bcf-4b41-b65d-339f45f85817 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:29.735061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9f11bc51-5bcf-4b41-b65d-339f45f85817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:29.892033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11bc51-5bcf-4b41-b65d-339f45f85817 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:29.904690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e257ffba1e743b2a699a2c45ac9ad41', 'request_id': 'req-31c6ce2d-b474-4712-b320-09fb27809213'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:29.916677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e257ffba1e743b2a699a2c45ac9ad41', 'request_id': 'req-31c6ce2d-b474-4712-b320-09fb27809213'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:30.022939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28dcc46-f9d6-4812-874b-e2410a638c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:30.022939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dcc46-f9d6-4812-874b-e2410a638c5e service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:30.022939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dcc46-f9d6-4812-874b-e2410a638c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:30.022939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dcc46-f9d6-4812-874b-e2410a638c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:30.086195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e257ffba1e743b2a699a2c45ac9ad41', 'request_id': 'req-31c6ce2d-b474-4712-b320-09fb27809213'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:30.099997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28dcc46-f9d6-4812-874b-e2410a638c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:30.103140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28dcc46-f9d6-4812-874b-e2410a638c5e service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:30.133429 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1077/2158] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:30.134866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] The token cache is being invalidate because project 5e257ffba1e743b2a699a2c45ac9ad41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:30.135208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:30.135911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a06e-8100-448f-ab85-11113807f8d1 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:30.137451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a06e-8100-448f-ab85-11113807f8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:30.137836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5a06e-8100-448f-ab85-11113807f8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:30.138415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:30.148872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1082/2159] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:29 2022] DELETE /identity/v3/projects/5e257ffba1e743b2a699a2c45ac9ad41 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:30.158344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:30.160518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:30.214549 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2bf5a06e-8100-448f-ab85-11113807f8d1 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:30.215815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2bf5a06e-8100-448f-ab85-11113807f8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:30.280559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6ce2d-b474-4712-b320-09fb27809213 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:30.286962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:30.287829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:30.287941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:30.288173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] PATH_INFO: `/v3/users/b2fc77349f7c424b9688c1defbe2e728` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:30.289473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2fc77349f7c424b9688c1defbe2e728)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:30.291578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:30.399460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1078/2160] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:30.404588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a06e-8100-448f-ab85-11113807f8d1 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:30.421411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5a06e-8100-448f-ab85-11113807f8d1 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:30.427947 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fcb07-ff98-4036-99bf-aa26a0cf494c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:30.428474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fcb07-ff98-4036-99bf-aa26a0cf494c admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:30.428787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fcb07-ff98-4036-99bf-aa26a0cf494c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:30.429104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346fcb07-ff98-4036-99bf-aa26a0cf494c admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:30.431800 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fcb07-ff98-4036-99bf-aa26a0cf494c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:30.431800 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fcb07-ff98-4036-99bf-aa26a0cf494c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:30.441077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346fcb07-ff98-4036-99bf-aa26a0cf494c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:30.472644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1079/2161] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:52:30.477347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fcb07-ff98-4036-99bf-aa26a0cf494c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:30.505792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346fcb07-ff98-4036-99bf-aa26a0cf494c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:30.516305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51596a-488d-4d62-a682-0780139ac7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:30.517166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51596a-488d-4d62-a682-0780139ac7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:30.517410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51596a-488d-4d62-a682-0780139ac7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:30.517693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51596a-488d-4d62-a682-0780139ac7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:30.519231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51596a-488d-4d62-a682-0780139ac7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:30.520464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51596a-488d-4d62-a682-0780139ac7d5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:30.566821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2fc77349f7c424b9688c1defbe2e728'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:30.576723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2fc77349f7c424b9688c1defbe2e728'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:30.578444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2fc77349f7c424b9688c1defbe2e728'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:30.638854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1080/2162] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:30 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:52:30.646459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51596a-488d-4d62-a682-0780139ac7d5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:30.693717 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2fc77349f7c424b9688c1defbe2e728'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:30.714912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2fc77349f7c424b9688c1defbe2e728'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:30.720531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51596a-488d-4d62-a682-0780139ac7d5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:30.726629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3bd1-bff2-443d-b18b-6a24affaa1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:30.728040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1083/2163] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:30 2022] DELETE /identity/v3/users/b2fc77349f7c424b9688c1defbe2e728 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:30.728162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3bd1-bff2-443d-b18b-6a24affaa1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:30.728381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3bd1-bff2-443d-b18b-6a24affaa1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:30.728695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3bd1-bff2-443d-b18b-6a24affaa1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:30.729366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3bd1-bff2-443d-b18b-6a24affaa1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:30.731346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3bd1-bff2-443d-b18b-6a24affaa1f1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:30.889925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:30.896180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1081/2164] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:30 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:30.904150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:30.906983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:30.990171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964a4d8-b0c8-45e9-8db9-fd9d77d5e94a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:30.996116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfc413-0d19-4cc3-b837-5fc2d0da50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:30.997730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfc413-0d19-4cc3-b837-5fc2d0da50c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:30.998242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfc413-0d19-4cc3-b837-5fc2d0da50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:30.998694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfc413-0d19-4cc3-b837-5fc2d0da50c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:30.999530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfc413-0d19-4cc3-b837-5fc2d0da50c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:31.001394 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfc413-0d19-4cc3-b837-5fc2d0da50c5 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:31.022233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1084/2165] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:52:31.022451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3bd1-bff2-443d-b18b-6a24affaa1f1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:31.035819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3bd1-bff2-443d-b18b-6a24affaa1f1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:31.059383 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860a377-d620-4262-a09f-54b116aabc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:31.060289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a377-d620-4262-a09f-54b116aabc10 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:31.060603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a377-d620-4262-a09f-54b116aabc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:31.063602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860a377-d620-4262-a09f-54b116aabc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:31.064195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860a377-d620-4262-a09f-54b116aabc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:31.068236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860a377-d620-4262-a09f-54b116aabc10 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:31.086169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1082/2166] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:52:31.090713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfc413-0d19-4cc3-b837-5fc2d0da50c5 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:31.105797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfc413-0d19-4cc3-b837-5fc2d0da50c5 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:31.112427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af3e8-dad0-4e8f-b1f1-eb9218ce8817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:31.113764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af3e8-dad0-4e8f-b1f1-eb9218ce8817 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:31.114281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af3e8-dad0-4e8f-b1f1-eb9218ce8817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:31.114797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af3e8-dad0-4e8f-b1f1-eb9218ce8817 admin admin] PATH_INFO: `/v3/projects/89c8db5081af465b9802a208f51e1a8a/users/3b7d05fccfa848f6b793ff4532b3bf52/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:31.141962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1af3e8-dad0-4e8f-b1f1-eb9218ce8817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c8db5081af465b9802a208f51e1a8a, user_id=3b7d05fccfa848f6b793ff4532b3bf52, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:31.145372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1af3e8-dad0-4e8f-b1f1-eb9218ce8817 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:31.234847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:31.249650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1085/2167] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:31 2022] PUT /identity/v3/projects/89c8db5081af465b9802a208f51e1a8a/users/3b7d05fccfa848f6b793ff4532b3bf52/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:31.259728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e6b9-e2dc-4d31-b9b6-de692e0aba34 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:31.260082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e6b9-e2dc-4d31-b9b6-de692e0aba34 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:31.260366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd0e6b9-e2dc-4d31-b9b6-de692e0aba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:31.301024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3cd0e6b9-e2dc-4d31-b9b6-de692e0aba34 None None] MFA Rules not processed for user `3b7d05fccfa848f6b793ff4532b3bf52`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:31.302611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3cd0e6b9-e2dc-4d31-b9b6-de692e0aba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:31.398561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1083/2168] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:31.413345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af3e8-dad0-4e8f-b1f1-eb9218ce8817 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:31.415407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8d1af3e8-dad0-4e8f-b1f1-eb9218ce8817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:31.493070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af3e8-dad0-4e8f-b1f1-eb9218ce8817 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:31.497950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c29b34-1b2e-42b1-a1b5-d6d33ca9907c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:31.498790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29b34-1b2e-42b1-a1b5-d6d33ca9907c service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:31.499376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29b34-1b2e-42b1-a1b5-d6d33ca9907c service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:31.499802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c29b34-1b2e-42b1-a1b5-d6d33ca9907c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:31.519403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c29b34-1b2e-42b1-a1b5-d6d33ca9907c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:31.519403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c29b34-1b2e-42b1-a1b5-d6d33ca9907c service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:31.531633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1086/2169] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:31.677333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e6b9-e2dc-4d31-b9b6-de692e0aba34 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:31.679701 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3cd0e6b9-e2dc-4d31-b9b6-de692e0aba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:31.770455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd0e6b9-e2dc-4d31-b9b6-de692e0aba34 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:31.782123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:31.782796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:31.783237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:31.783574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] PATH_INFO: `/v3/projects/1684c09f68c64e60a31bbbcdd8dc41c3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:31.786575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1684c09f68c64e60a31bbbcdd8dc41c3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:31.790456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:31.969312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1684c09f68c64e60a31bbbcdd8dc41c3', 'request_id': 'req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:31.979707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1684c09f68c64e60a31bbbcdd8dc41c3', 'request_id': 'req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:32.078420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1684c09f68c64e60a31bbbcdd8dc41c3', 'request_id': 'req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:32.103878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] The token cache is being invalidate because project 1684c09f68c64e60a31bbbcdd8dc41c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:32.104736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:32.106208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4ec06b8f-0d44-43ba-a556-fa2bc92971d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:32.109156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1084/2170] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:31 2022] DELETE /identity/v3/projects/1684c09f68c64e60a31bbbcdd8dc41c3 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:32.120849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483452d-dd7c-449b-8448-93789d68de62 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:32.121421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483452d-dd7c-449b-8448-93789d68de62 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:32.121421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483452d-dd7c-449b-8448-93789d68de62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:32.156633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-a483452d-dd7c-449b-8448-93789d68de62 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:32.156633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a483452d-dd7c-449b-8448-93789d68de62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:32.248522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1087/2171] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:32.258104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e1be6-d10d-4904-9d4d-cf862818254f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:32.258475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e1be6-d10d-4904-9d4d-cf862818254f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:32.258867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e1be6-d10d-4904-9d4d-cf862818254f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:32.303802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-238e1be6-d10d-4904-9d4d-cf862818254f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:32.303802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-238e1be6-d10d-4904-9d4d-cf862818254f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:32.338397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1085/2172] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:32.343254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483452d-dd7c-449b-8448-93789d68de62 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:32.362184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483452d-dd7c-449b-8448-93789d68de62 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:32.371285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb015c-0a36-442d-a170-0fa2672c7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:32.371999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb015c-0a36-442d-a170-0fa2672c7936 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:32.372543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb015c-0a36-442d-a170-0fa2672c7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:32.373068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb015c-0a36-442d-a170-0fa2672c7936 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:32.374143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb015c-0a36-442d-a170-0fa2672c7936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:32.374464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb015c-0a36-442d-a170-0fa2672c7936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:32.377748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb015c-0a36-442d-a170-0fa2672c7936 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:32.416516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1088/2173] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:32.423280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e1be6-d10d-4904-9d4d-cf862818254f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:32.440446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e1be6-d10d-4904-9d4d-cf862818254f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:32.449723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ea44-14f9-43f8-a130-2482736d49b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:32.450718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ea44-14f9-43f8-a130-2482736d49b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:32.452105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ea44-14f9-43f8-a130-2482736d49b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:32.452660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080ea44-14f9-43f8-a130-2482736d49b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:32.453976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080ea44-14f9-43f8-a130-2482736d49b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:32.457530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080ea44-14f9-43f8-a130-2482736d49b2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:32.653677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1086/2174] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:32 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:32.653850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb015c-0a36-442d-a170-0fa2672c7936 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:32.688858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb015c-0a36-442d-a170-0fa2672c7936 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:32.795761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f356523-6c99-4180-b9ff-f18ed6ed7d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:32.797500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f356523-6c99-4180-b9ff-f18ed6ed7d57 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:32.797855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f356523-6c99-4180-b9ff-f18ed6ed7d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:32.798837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f356523-6c99-4180-b9ff-f18ed6ed7d57 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:32.800531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f356523-6c99-4180-b9ff-f18ed6ed7d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:32.805675 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f356523-6c99-4180-b9ff-f18ed6ed7d57 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:32.982246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1089/2175] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:32 2022] POST /identity/v3/users => generated 292 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:52:32.984302 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ea44-14f9-43f8-a130-2482736d49b2 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:33.004079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080ea44-14f9-43f8-a130-2482736d49b2 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:33.013964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfef543-f25b-45a2-b0bb-570e3cc760a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:33.014916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfef543-f25b-45a2-b0bb-570e3cc760a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:33.015334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfef543-f25b-45a2-b0bb-570e3cc760a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:33.015712 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfef543-f25b-45a2-b0bb-570e3cc760a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:33.016998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfef543-f25b-45a2-b0bb-570e3cc760a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:33.020207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfef543-f25b-45a2-b0bb-570e3cc760a3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:33.048557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1087/2176] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:52:33.051206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f356523-6c99-4180-b9ff-f18ed6ed7d57 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:33.074599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f356523-6c99-4180-b9ff-f18ed6ed7d57 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:33.093044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7918f82-5573-4093-bae8-9f3d9b9e66df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:33.094540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7918f82-5573-4093-bae8-9f3d9b9e66df admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:33.095527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7918f82-5573-4093-bae8-9f3d9b9e66df admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:33.096053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7918f82-5573-4093-bae8-9f3d9b9e66df admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:33.097162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7918f82-5573-4093-bae8-9f3d9b9e66df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:33.100570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7918f82-5573-4093-bae8-9f3d9b9e66df admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:33.125033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1090/2177] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:52:33.130811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfef543-f25b-45a2-b0bb-570e3cc760a3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:33.150361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfef543-f25b-45a2-b0bb-570e3cc760a3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:33.159084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b173a48-ab2d-4ee0-aebe-4f9f3a0366c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:33.160210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b173a48-ab2d-4ee0-aebe-4f9f3a0366c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:33.160764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b173a48-ab2d-4ee0-aebe-4f9f3a0366c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:33.161269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b173a48-ab2d-4ee0-aebe-4f9f3a0366c6 admin admin] PATH_INFO: `/v3/projects/7ce75587b6214719a405d523970b3639/users/8f158fe275af48cb8c2e7fb5c593896d/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:33.192982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b173a48-ab2d-4ee0-aebe-4f9f3a0366c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce75587b6214719a405d523970b3639, user_id=8f158fe275af48cb8c2e7fb5c593896d, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:33.200345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b173a48-ab2d-4ee0-aebe-4f9f3a0366c6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:33.303700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1088/2178] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:33 2022] PUT /identity/v3/projects/7ce75587b6214719a405d523970b3639/users/8f158fe275af48cb8c2e7fb5c593896d/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:33.314644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ffa68-1388-414b-a619-798dacc0ccd6 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:33.314949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ffa68-1388-414b-a619-798dacc0ccd6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:33.315232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ffa68-1388-414b-a619-798dacc0ccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:33.388943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0b8ffa68-1388-414b-a619-798dacc0ccd6 None None] MFA Rules not processed for user `8f158fe275af48cb8c2e7fb5c593896d`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:33.392354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0b8ffa68-1388-414b-a619-798dacc0ccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:33.546966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1091/2179] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:33.552251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b173a48-ab2d-4ee0-aebe-4f9f3a0366c6 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:33.691673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b173a48-ab2d-4ee0-aebe-4f9f3a0366c6 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:33.699483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043a137-2fcb-4312-8ada-36618bda201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:33.700421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043a137-2fcb-4312-8ada-36618bda201a admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:33.702740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043a137-2fcb-4312-8ada-36618bda201a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:33.703241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043a137-2fcb-4312-8ada-36618bda201a admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:33.704121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043a137-2fcb-4312-8ada-36618bda201a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:33.706340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043a137-2fcb-4312-8ada-36618bda201a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:33.857399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1089/2180] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:33 2022] POST /identity/v3/projects => generated 385 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:33.862247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ffa68-1388-414b-a619-798dacc0ccd6 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:33.874211 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ffa68-1388-414b-a619-798dacc0ccd6 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:34.024609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8a9ab-23ad-420e-b5a5-f70c97fc6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:34.026981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8a9ab-23ad-420e-b5a5-f70c97fc6534 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:34.026981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8a9ab-23ad-420e-b5a5-f70c97fc6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:34.027623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8a9ab-23ad-420e-b5a5-f70c97fc6534 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:34.029238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8a9ab-23ad-420e-b5a5-f70c97fc6534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:34.034859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8a9ab-23ad-420e-b5a5-f70c97fc6534 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:34.164115 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1092/2181] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:33 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:52:34.172046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043a137-2fcb-4312-8ada-36618bda201a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:34.198164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043a137-2fcb-4312-8ada-36618bda201a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:34.202912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a186e5-87b4-426a-a480-ff9c113530a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:34.205842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a186e5-87b4-426a-a480-ff9c113530a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:34.207214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a186e5-87b4-426a-a480-ff9c113530a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:34.207332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a186e5-87b4-426a-a480-ff9c113530a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:34.208793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a186e5-87b4-426a-a480-ff9c113530a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:34.212474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a186e5-87b4-426a-a480-ff9c113530a0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:34.240694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1090/2182] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:34.247172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8a9ab-23ad-420e-b5a5-f70c97fc6534 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:34.274853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8a9ab-23ad-420e-b5a5-f70c97fc6534 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:34.280847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5ee9a-1e75-447f-9bfe-327739434b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:34.281657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5ee9a-1e75-447f-9bfe-327739434b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:34.282029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5ee9a-1e75-447f-9bfe-327739434b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:34.282392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5ee9a-1e75-447f-9bfe-327739434b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:34.283210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5ee9a-1e75-447f-9bfe-327739434b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:34.285281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5ee9a-1e75-447f-9bfe-327739434b6b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:34.301448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1093/2183] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:34.304957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a186e5-87b4-426a-a480-ff9c113530a0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:34.349545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a186e5-87b4-426a-a480-ff9c113530a0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:34.349545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3636-5199-477a-8ab5-c681adb3ec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:34.349545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3636-5199-477a-8ab5-c681adb3ec3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:34.349545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3636-5199-477a-8ab5-c681adb3ec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:34.349954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e3636-5199-477a-8ab5-c681adb3ec3a admin admin] PATH_INFO: `/v3/projects/e38d42218a20420eb7831393d5637e1e/users/a9584b6aceab4e43b1bc9ec80a6d4212/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:34.353143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e3636-5199-477a-8ab5-c681adb3ec3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38d42218a20420eb7831393d5637e1e, user_id=a9584b6aceab4e43b1bc9ec80a6d4212, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:34.356541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e3636-5199-477a-8ab5-c681adb3ec3a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:34.513178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1091/2184] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:34 2022] PUT /identity/v3/projects/e38d42218a20420eb7831393d5637e1e/users/a9584b6aceab4e43b1bc9ec80a6d4212/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:34.527509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f655e8c-ba60-45f5-8363-fb8c8e9595ee None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:34.530968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f655e8c-ba60-45f5-8363-fb8c8e9595ee None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:34.530968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f655e8c-ba60-45f5-8363-fb8c8e9595ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:34.554353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:34.600900 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-6f655e8c-ba60-45f5-8363-fb8c8e9595ee None None] MFA Rules not processed for user `a9584b6aceab4e43b1bc9ec80a6d4212`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:34.602503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6f655e8c-ba60-45f5-8363-fb8c8e9595ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:34.680414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:34.705483 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1094/2185] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:34.706742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3636-5199-477a-8ab5-c681adb3ec3a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:34.842552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e3636-5199-477a-8ab5-c681adb3ec3a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:34.864116 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f838800-e699-4be0-9a04-bb05f62a0a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:34.865094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f838800-e699-4be0-9a04-bb05f62a0a5a admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:34.865639 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f838800-e699-4be0-9a04-bb05f62a0a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:34.866156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f838800-e699-4be0-9a04-bb05f62a0a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:34.866883 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f838800-e699-4be0-9a04-bb05f62a0a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:34.868964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f838800-e699-4be0-9a04-bb05f62a0a5a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:35.083334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1092/2186] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:34 2022] POST /identity/v3/projects => generated 383 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:35.089700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f655e8c-ba60-45f5-8363-fb8c8e9595ee None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:35.110069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f655e8c-ba60-45f5-8363-fb8c8e9595ee None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:35.184361 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae616a-1124-4ad9-873d-97461e8221ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:35.185278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae616a-1124-4ad9-873d-97461e8221ec admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:35.209928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae616a-1124-4ad9-873d-97461e8221ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:35.209928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae616a-1124-4ad9-873d-97461e8221ec admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:35.209928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae616a-1124-4ad9-873d-97461e8221ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:35.209928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae616a-1124-4ad9-873d-97461e8221ec admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:35.348835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1095/2187] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:35 2022] POST /identity/v3/users => generated 298 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:35.350522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f838800-e699-4be0-9a04-bb05f62a0a5a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:35.370459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f838800-e699-4be0-9a04-bb05f62a0a5a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:35.392928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb07952-95f4-4dfe-8b49-b1f5971d5924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:35.392928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb07952-95f4-4dfe-8b49-b1f5971d5924 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:35.392928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb07952-95f4-4dfe-8b49-b1f5971d5924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:35.392928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb07952-95f4-4dfe-8b49-b1f5971d5924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:35.395881 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb07952-95f4-4dfe-8b49-b1f5971d5924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:35.406823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb07952-95f4-4dfe-8b49-b1f5971d5924 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:35.437134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1093/2188] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:35.438220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae616a-1124-4ad9-873d-97461e8221ec admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:35.452257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae616a-1124-4ad9-873d-97461e8221ec admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:35.466051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5941d-732e-4b57-a42b-badd0f78bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:35.466847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5941d-732e-4b57-a42b-badd0f78bec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:35.467347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5941d-732e-4b57-a42b-badd0f78bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:35.467764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5941d-732e-4b57-a42b-badd0f78bec5 admin admin] PATH_INFO: `/v3/projects/92ac33ac9bf34829b4e5fc1dfe6ad7eb/users/b2810e728b4a48e5afec1d8d9b518073/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:35.505559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5941d-732e-4b57-a42b-badd0f78bec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ac33ac9bf34829b4e5fc1dfe6ad7eb, user_id=b2810e728b4a48e5afec1d8d9b518073, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:35.515565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5941d-732e-4b57-a42b-badd0f78bec5 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:35.660659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1096/2189] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:35 2022] PUT /identity/v3/projects/92ac33ac9bf34829b4e5fc1dfe6ad7eb/users/b2810e728b4a48e5afec1d8d9b518073/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:35.666004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb07952-95f4-4dfe-8b49-b1f5971d5924 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:35.684264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb07952-95f4-4dfe-8b49-b1f5971d5924 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:35.889943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb0821-6723-462e-8cc6-8aa9694510df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:35.890945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb0821-6723-462e-8cc6-8aa9694510df admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:35.899218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb0821-6723-462e-8cc6-8aa9694510df admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:35.899218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb0821-6723-462e-8cc6-8aa9694510df admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:35.899218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb0821-6723-462e-8cc6-8aa9694510df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:35.899218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb0821-6723-462e-8cc6-8aa9694510df admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:35.937662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1094/2190] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:35.938044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5941d-732e-4b57-a42b-badd0f78bec5 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:35.957258 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5941d-732e-4b57-a42b-badd0f78bec5 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:35.976403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd56ea5-7465-40ba-b5d3-cc8a59138e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:35.977170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd56ea5-7465-40ba-b5d3-cc8a59138e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:35.977457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd56ea5-7465-40ba-b5d3-cc8a59138e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:35.978152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd56ea5-7465-40ba-b5d3-cc8a59138e64 admin admin] PATH_INFO: `/v3/projects/92ac33ac9bf34829b4e5fc1dfe6ad7eb/users/b2810e728b4a48e5afec1d8d9b518073/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:35.988608 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd56ea5-7465-40ba-b5d3-cc8a59138e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ac33ac9bf34829b4e5fc1dfe6ad7eb, user_id=b2810e728b4a48e5afec1d8d9b518073, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:35.994264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd56ea5-7465-40ba-b5d3-cc8a59138e64 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:36.041569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e7d80-78ae-4ecb-a6f4-60cb9e2d7130 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:36.041922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e7d80-78ae-4ecb-a6f4-60cb9e2d7130 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:36.042165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e7d80-78ae-4ecb-a6f4-60cb9e2d7130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:36.045308 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1097/2191] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:35 2022] PUT /identity/v3/projects/92ac33ac9bf34829b4e5fc1dfe6ad7eb/users/b2810e728b4a48e5afec1d8d9b518073/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:36.109661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ec1e7d80-78ae-4ecb-a6f4-60cb9e2d7130 None None] MFA Rules not processed for user `b2810e728b4a48e5afec1d8d9b518073`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:36.111175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ec1e7d80-78ae-4ecb-a6f4-60cb9e2d7130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:36.233858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1095/2192] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:36.381641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7420322-6c90-431c-91a2-19b4e60a0698 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:36.382191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7420322-6c90-431c-91a2-19b4e60a0698 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:36.382191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7420322-6c90-431c-91a2-19b4e60a0698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:36.444514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c7420322-6c90-431c-91a2-19b4e60a0698 None None] MFA Rules not processed for user `102d4c23a15b4f08aa33d12d5d7639ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:36.446077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c7420322-6c90-431c-91a2-19b4e60a0698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:36.552424 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1098/2193] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:36.575480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e7d80-78ae-4ecb-a6f4-60cb9e2d7130 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:36.577528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ec1e7d80-78ae-4ecb-a6f4-60cb9e2d7130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:36.690199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7420322-6c90-431c-91a2-19b4e60a0698 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:36.693495 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c7420322-6c90-431c-91a2-19b4e60a0698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:36.745726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:36.755537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e7d80-78ae-4ecb-a6f4-60cb9e2d7130 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:36.776171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87dea4-d1bc-4ac4-8ca6-ed67da35cfd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:36.776999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87dea4-d1bc-4ac4-8ca6-ed67da35cfd6 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:36.777304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87dea4-d1bc-4ac4-8ca6-ed67da35cfd6 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:36.777583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87dea4-d1bc-4ac4-8ca6-ed67da35cfd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:36.786186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fa87dea4-d1bc-4ac4-8ca6-ed67da35cfd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:36.867376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7420322-6c90-431c-91a2-19b4e60a0698 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:36.878508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58ef3-f212-42cd-8ec8-8c5497c7edc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:36.880125 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58ef3-f212-42cd-8ec8-8c5497c7edc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:36.880711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58ef3-f212-42cd-8ec8-8c5497c7edc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:36.881531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d58ef3-f212-42cd-8ec8-8c5497c7edc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:36.963752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87dea4-d1bc-4ac4-8ca6-ed67da35cfd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:36.967551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87dea4-d1bc-4ac4-8ca6-ed67da35cfd6 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:36.994668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1096/2194] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:52:37.074403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58ef3-f212-42cd-8ec8-8c5497c7edc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:37.082772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d58ef3-f212-42cd-8ec8-8c5497c7edc7 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:37.126859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1099/2195] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:37.772392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:38.133086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ed712-3c3a-4aab-85b9-0b5c29f41650 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:38.133814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ed712-3c3a-4aab-85b9-0b5c29f41650 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:38.133814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ed712-3c3a-4aab-85b9-0b5c29f41650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:38.159018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-529ed712-3c3a-4aab-85b9-0b5c29f41650 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:38.161091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-529ed712-3c3a-4aab-85b9-0b5c29f41650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:38.377369 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1097/2196] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:52:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:52:38.451688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58ef3-f212-42cd-8ec8-8c5497c7edc7 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:38.453646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-11d58ef3-f212-42cd-8ec8-8c5497c7edc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:38.631818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d58ef3-f212-42cd-8ec8-8c5497c7edc7 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:38.647682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de598315-a23d-4913-a9e2-b6b6e6568309 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:38.649096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598315-a23d-4913-a9e2-b6b6e6568309 service swift] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:38.649505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598315-a23d-4913-a9e2-b6b6e6568309 service swift] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:38.649887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de598315-a23d-4913-a9e2-b6b6e6568309 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:38.680172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de598315-a23d-4913-a9e2-b6b6e6568309 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:38.682023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de598315-a23d-4913-a9e2-b6b6e6568309 service swift] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:38.720981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1100/2197] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:52:40.228824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ed712-3c3a-4aab-85b9-0b5c29f41650 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:40.228824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-529ed712-3c3a-4aab-85b9-0b5c29f41650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:40.310970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ed712-3c3a-4aab-85b9-0b5c29f41650 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:40.341249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:40.342718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:40.343175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:40.344418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] PATH_INFO: `/v3/users/3b7d05fccfa848f6b793ff4532b3bf52` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:40.346852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7d05fccfa848f6b793ff4532b3bf52)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:40.351563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:40.395470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de598315-a23d-4913-a9e2-b6b6e6568309 service swift] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:40.411300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de598315-a23d-4913-a9e2-b6b6e6568309 service swift] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:40.424940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e385ac2f-b888-4a95-80fb-797b7ae63671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:40.425962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ac2f-b888-4a95-80fb-797b7ae63671 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:40.426415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ac2f-b888-4a95-80fb-797b7ae63671 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:40.427202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e385ac2f-b888-4a95-80fb-797b7ae63671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:40.513907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385ac2f-b888-4a95-80fb-797b7ae63671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:40.515704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e385ac2f-b888-4a95-80fb-797b7ae63671 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:40.531883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1101/2198] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:41.149892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7d05fccfa848f6b793ff4532b3bf52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:41.186171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7d05fccfa848f6b793ff4532b3bf52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:41.188278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7d05fccfa848f6b793ff4532b3bf52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:41.348553 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7d05fccfa848f6b793ff4532b3bf52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:41.351014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7d05fccfa848f6b793ff4532b3bf52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:41.395301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1098/2199] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:40 2022] DELETE /identity/v3/users/3b7d05fccfa848f6b793ff4532b3bf52 => generated 0 bytes in 1193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:41.406089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfdba8-ce1e-4526-9b05-73b698454238 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:41.406089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfdba8-ce1e-4526-9b05-73b698454238 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:41.406089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfdba8-ce1e-4526-9b05-73b698454238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:41.468784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-45dfdba8-ce1e-4526-9b05-73b698454238 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:41.468784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-45dfdba8-ce1e-4526-9b05-73b698454238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:41.487692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:41.593619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1102/2200] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:52:41.603751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:41.605378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:41.759387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256325cc-57f8-44c3-af77-4a03174072a3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:41.768386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8e64f-b00d-4921-9e6e-43565dfebfac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:41.771331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8e64f-b00d-4921-9e6e-43565dfebfac service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:41.772136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8e64f-b00d-4921-9e6e-43565dfebfac service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:41.773322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8e64f-b00d-4921-9e6e-43565dfebfac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:41.831280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8e64f-b00d-4921-9e6e-43565dfebfac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:41.834217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8e64f-b00d-4921-9e6e-43565dfebfac service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:41.873608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1099/2201] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:42.394810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfdba8-ce1e-4526-9b05-73b698454238 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:42.397279 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-45dfdba8-ce1e-4526-9b05-73b698454238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:42.451648 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfdba8-ce1e-4526-9b05-73b698454238 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:42.463624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:42.471587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:42.471587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:42.471587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] PATH_INFO: `/v3/users/f3d001c0d4b8452891452e191590d3f3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:42.471587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d001c0d4b8452891452e191590d3f3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:42.473288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:42.826556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8e64f-b00d-4921-9e6e-43565dfebfac service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:42.828097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-39a8e64f-b00d-4921-9e6e-43565dfebfac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:42.882264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8e64f-b00d-4921-9e6e-43565dfebfac service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:42.893296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:42.893965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:42.894252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:42.894532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] PATH_INFO: `/v3/projects/89c8db5081af465b9802a208f51e1a8a` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:42.896288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c8db5081af465b9802a208f51e1a8a)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:42.900845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:42.987409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d001c0d4b8452891452e191590d3f3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:43.015364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d001c0d4b8452891452e191590d3f3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:43.019896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d001c0d4b8452891452e191590d3f3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:43.077811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:43.145068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d001c0d4b8452891452e191590d3f3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:43.168989 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a3771191-d4ca-47e8-b0d6-9f3c8d7f5e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d001c0d4b8452891452e191590d3f3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:43.177951 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1103/2202] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:42 2022] DELETE /identity/v3/users/f3d001c0d4b8452891452e191590d3f3 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:43.185207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553da4-ab61-4c7e-abf5-0d54fb75fd02 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:43.185374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553da4-ab61-4c7e-abf5-0d54fb75fd02 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:43.185828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b553da4-ab61-4c7e-abf5-0d54fb75fd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:43.238547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-4b553da4-ab61-4c7e-abf5-0d54fb75fd02 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:43.240584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4b553da4-ab61-4c7e-abf5-0d54fb75fd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:43.284528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c8db5081af465b9802a208f51e1a8a', 'request_id': 'req-dedfb1f3-db70-4610-ae78-bbf59b168cce'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:43.332850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c8db5081af465b9802a208f51e1a8a', 'request_id': 'req-dedfb1f3-db70-4610-ae78-bbf59b168cce'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:43.402244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1104/2203] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:43.409970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a3bb-5a99-4e7a-9cb5-56afce86cf85 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:43.409970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a3bb-5a99-4e7a-9cb5-56afce86cf85 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:43.409970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225a3bb-5a99-4e7a-9cb5-56afce86cf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:43.431324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5225a3bb-5a99-4e7a-9cb5-56afce86cf85 None None] MFA Rules not processed for user `297a016ff2944b33a06d5ce81735fb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:43.432600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5225a3bb-5a99-4e7a-9cb5-56afce86cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:43.444627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c8db5081af465b9802a208f51e1a8a', 'request_id': 'req-dedfb1f3-db70-4610-ae78-bbf59b168cce'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:43.482128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] The token cache is being invalidate because project 89c8db5081af465b9802a208f51e1a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:43.482128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:43.482128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:43.486683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1100/2204] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:42 2022] DELETE /identity/v3/projects/89c8db5081af465b9802a208f51e1a8a => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:43.486683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:43.489476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:43.565765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1105/2205] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:43.574470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225a3bb-5a99-4e7a-9cb5-56afce86cf85 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:43.577243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5225a3bb-5a99-4e7a-9cb5-56afce86cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:43.614237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfb1f3-db70-4610-ae78-bbf59b168cce admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:43.619717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4732de-8854-43cc-80ac-c859ead38fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:43.621779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4732de-8854-43cc-80ac-c859ead38fcf service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:43.622303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4732de-8854-43cc-80ac-c859ead38fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:43.622829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4732de-8854-43cc-80ac-c859ead38fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:43.627911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bb4732de-8854-43cc-80ac-c859ead38fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:43.661370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4732de-8854-43cc-80ac-c859ead38fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:43.662811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4732de-8854-43cc-80ac-c859ead38fcf service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:43.685825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1101/2206] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:43.690695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941e33d-270f-4e02-8af0-b1e9de69e695 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:43.690971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941e33d-270f-4e02-8af0-b1e9de69e695 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:43.691253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941e33d-270f-4e02-8af0-b1e9de69e695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:43.718148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225a3bb-5a99-4e7a-9cb5-56afce86cf85 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:43.724129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fc9b0-dbe3-47b8-92a6-50b148f7ac35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:43.725489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fc9b0-dbe3-47b8-92a6-50b148f7ac35 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:43.726041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fc9b0-dbe3-47b8-92a6-50b148f7ac35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:43.726415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fc9b0-dbe3-47b8-92a6-50b148f7ac35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:43.728568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-721fc9b0-dbe3-47b8-92a6-50b148f7ac35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:43.733967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a941e33d-270f-4e02-8af0-b1e9de69e695 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:43.736264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a941e33d-270f-4e02-8af0-b1e9de69e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:43.762220 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1102/2207] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:43.773022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684d81-f5ee-4445-b966-a01a1c6b269f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:43.773624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684d81-f5ee-4445-b966-a01a1c6b269f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:43.774447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684d81-f5ee-4445-b966-a01a1c6b269f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:43.800177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d9684d81-f5ee-4445-b966-a01a1c6b269f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:43.802151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d9684d81-f5ee-4445-b966-a01a1c6b269f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:43.819381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1103/2208] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:43.822075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9684d81-f5ee-4445-b966-a01a1c6b269f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:43.836603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9684d81-f5ee-4445-b966-a01a1c6b269f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:43.846656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9c440-9bb8-45b8-999f-67400e783e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:43.849475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9c440-9bb8-45b8-999f-67400e783e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:43.849746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9c440-9bb8-45b8-999f-67400e783e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:43.851955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9c440-9bb8-45b8-999f-67400e783e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:43.852997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9c440-9bb8-45b8-999f-67400e783e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:43.853902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9c440-9bb8-45b8-999f-67400e783e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:43.855815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9c440-9bb8-45b8-999f-67400e783e6f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:43.895532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1104/2209] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:43.900476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9c440-9bb8-45b8-999f-67400e783e6f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:43.927021 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fc9b0-dbe3-47b8-92a6-50b148f7ac35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:43.927021 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fc9b0-dbe3-47b8-92a6-50b148f7ac35 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:43.927627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9c440-9bb8-45b8-999f-67400e783e6f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:43.931730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1a23c-65f1-413e-a2f6-a8cfaa12398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:43.933213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1a23c-65f1-413e-a2f6-a8cfaa12398a admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:43.933591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1a23c-65f1-413e-a2f6-a8cfaa12398a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:43.934008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1a23c-65f1-413e-a2f6-a8cfaa12398a admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:43.935048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1a23c-65f1-413e-a2f6-a8cfaa12398a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:43.938486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1a23c-65f1-413e-a2f6-a8cfaa12398a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:43.957849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1106/2210] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:44.210356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fc9b0-dbe3-47b8-92a6-50b148f7ac35 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:44.211544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1105/2211] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:43 2022] POST /identity/v3/projects => generated 383 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:52:44.227164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fc9b0-dbe3-47b8-92a6-50b148f7ac35 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:44.436885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fde68-83f0-4237-b09f-9831f4a6c53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:44.437774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fde68-83f0-4237-b09f-9831f4a6c53b admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:44.438302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fde68-83f0-4237-b09f-9831f4a6c53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:44.438913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8fde68-83f0-4237-b09f-9831f4a6c53b admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:44.450293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fde68-83f0-4237-b09f-9831f4a6c53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:44.452992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8fde68-83f0-4237-b09f-9831f4a6c53b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:44.570469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1a23c-65f1-413e-a2f6-a8cfaa12398a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:44.572796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5ba1a23c-65f1-413e-a2f6-a8cfaa12398a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:44.611821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1a23c-65f1-413e-a2f6-a8cfaa12398a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:44.624292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:44.632105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:44.632870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:44.633525 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] PATH_INFO: `/v3/projects/8942320def6548e89d1027d55877b1d3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:44.636155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8942320def6548e89d1027d55877b1d3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:44.639375 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:44.704603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1107/2212] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:44 2022] POST /identity/v3/users => generated 292 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:52:44.711745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fde68-83f0-4237-b09f-9831f4a6c53b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:44.727573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8fde68-83f0-4237-b09f-9831f4a6c53b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:44.732558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441a996-a9f5-4b44-825c-39930847b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:44.733615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a996-a9f5-4b44-825c-39930847b351 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:44.734092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a996-a9f5-4b44-825c-39930847b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:44.734385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441a996-a9f5-4b44-825c-39930847b351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:44.735065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441a996-a9f5-4b44-825c-39930847b351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:44.736803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441a996-a9f5-4b44-825c-39930847b351 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:44.757915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1108/2213] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:52:44.761278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441a996-a9f5-4b44-825c-39930847b351 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:44.772393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441a996-a9f5-4b44-825c-39930847b351 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:44.777992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6a66c-3827-4540-ac9f-a0cdba27790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:44.778642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6a66c-3827-4540-ac9f-a0cdba27790f admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:44.778922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6a66c-3827-4540-ac9f-a0cdba27790f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:44.779201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6a66c-3827-4540-ac9f-a0cdba27790f admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:44.779858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6a66c-3827-4540-ac9f-a0cdba27790f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:44.781530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6a66c-3827-4540-ac9f-a0cdba27790f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:44.795473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1109/2214] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:52:44.800499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6a66c-3827-4540-ac9f-a0cdba27790f admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:44.811620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6a66c-3827-4540-ac9f-a0cdba27790f admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:44.816765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde5cd5-8468-40e1-ab39-a82f1135ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:44.817551 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde5cd5-8468-40e1-ab39-a82f1135ff8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:44.817864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde5cd5-8468-40e1-ab39-a82f1135ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:44.818193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde5cd5-8468-40e1-ab39-a82f1135ff8f admin admin] PATH_INFO: `/v3/projects/933f36ed9eb940aea3cefd545059cf38/users/b6148d30dd374817922af119ee180dbf/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:44.835421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde5cd5-8468-40e1-ab39-a82f1135ff8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=933f36ed9eb940aea3cefd545059cf38, user_id=b6148d30dd374817922af119ee180dbf, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:44.838207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde5cd5-8468-40e1-ab39-a82f1135ff8f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:45.106744 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1110/2215] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:44 2022] PUT /identity/v3/projects/933f36ed9eb940aea3cefd545059cf38/users/b6148d30dd374817922af119ee180dbf/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:52:45.117450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c61f-0121-40c5-bbca-c901b2831503 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.117732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c61f-0121-40c5-bbca-c901b2831503 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.118011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3c61f-0121-40c5-bbca-c901b2831503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.118663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8942320def6548e89d1027d55877b1d3', 'request_id': 'req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:45.126214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8942320def6548e89d1027d55877b1d3', 'request_id': 'req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:45.153947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7ab3c61f-0121-40c5-bbca-c901b2831503 None None] MFA Rules not processed for user `b6148d30dd374817922af119ee180dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:45.155193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7ab3c61f-0121-40c5-bbca-c901b2831503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:45.199376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8942320def6548e89d1027d55877b1d3', 'request_id': 'req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:45.219134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] The token cache is being invalidate because project 8942320def6548e89d1027d55877b1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:45.219517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:45.220700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ead9fa8d-e06b-4d7b-81e7-8ab072f00b1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:45.224288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1106/2216] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:44 2022] DELETE /identity/v3/projects/8942320def6548e89d1027d55877b1d3 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:45.230184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daea6b-0de2-4272-b0c9-e240932f0fc4 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.230686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daea6b-0de2-4272-b0c9-e240932f0fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.231105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daea6b-0de2-4272-b0c9-e240932f0fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.260732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d3daea6b-0de2-4272-b0c9-e240932f0fc4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:45.262472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d3daea6b-0de2-4272-b0c9-e240932f0fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:45.287142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1111/2217] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:52:45.294323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c61f-0121-40c5-bbca-c901b2831503 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:45.296567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7ab3c61f-0121-40c5-bbca-c901b2831503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:45.361365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1107/2218] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:45.372196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef2ee-889d-4c95-ab9a-867694197662 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.372658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef2ee-889d-4c95-ab9a-867694197662 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.373229 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cef2ee-889d-4c95-ab9a-867694197662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.404019 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3c61f-0121-40c5-bbca-c901b2831503 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:45.407363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-11cef2ee-889d-4c95-ab9a-867694197662 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:45.409441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-11cef2ee-889d-4c95-ab9a-867694197662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:45.409872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83126ce-2329-422a-a513-fd165134e9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:45.410512 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83126ce-2329-422a-a513-fd165134e9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.410789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83126ce-2329-422a-a513-fd165134e9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.411060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83126ce-2329-422a-a513-fd165134e9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.411877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83126ce-2329-422a-a513-fd165134e9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:45.413994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83126ce-2329-422a-a513-fd165134e9e4 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:45.430723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1108/2219] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:52:45.431955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cef2ee-889d-4c95-ab9a-867694197662 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:45.454852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cef2ee-889d-4c95-ab9a-867694197662 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:45.462246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dad8f-2dcd-4561-88c8-9dbc8b79fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:45.463398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dad8f-2dcd-4561-88c8-9dbc8b79fe11 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.464637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dad8f-2dcd-4561-88c8-9dbc8b79fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.465141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dad8f-2dcd-4561-88c8-9dbc8b79fe11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.466152 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dad8f-2dcd-4561-88c8-9dbc8b79fe11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:45.466694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dad8f-2dcd-4561-88c8-9dbc8b79fe11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:45.469112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dad8f-2dcd-4561-88c8-9dbc8b79fe11 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:45.492182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1109/2220] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:45.497653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dad8f-2dcd-4561-88c8-9dbc8b79fe11 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:45.517250 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dad8f-2dcd-4561-88c8-9dbc8b79fe11 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:45.520600 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35c9b-122c-413c-83b2-7cfc3faaafaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:45.522860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35c9b-122c-413c-83b2-7cfc3faaafaa admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.522860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35c9b-122c-413c-83b2-7cfc3faaafaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.522860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35c9b-122c-413c-83b2-7cfc3faaafaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.523994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de35c9b-122c-413c-83b2-7cfc3faaafaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:45.531351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de35c9b-122c-413c-83b2-7cfc3faaafaa admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:45.542121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1112/2221] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:45 2022] POST /identity/v3/projects => generated 383 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:45.555085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83126ce-2329-422a-a513-fd165134e9e4 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:45.661127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83126ce-2329-422a-a513-fd165134e9e4 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:45.668694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb171148-6ce1-4cc5-8c23-9ff7e615532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:45.669349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb171148-6ce1-4cc5-8c23-9ff7e615532d admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.669819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb171148-6ce1-4cc5-8c23-9ff7e615532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.670348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb171148-6ce1-4cc5-8c23-9ff7e615532d admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.671236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb171148-6ce1-4cc5-8c23-9ff7e615532d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:45.673229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb171148-6ce1-4cc5-8c23-9ff7e615532d admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:45.727573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:45.740445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1110/2222] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:45 2022] POST /identity/v3/projects => generated 377 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:45.741415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35c9b-122c-413c-83b2-7cfc3faaafaa admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:45.836071 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1113/2223] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:45 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:45.837292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb171148-6ce1-4cc5-8c23-9ff7e615532d admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:45.854366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb171148-6ce1-4cc5-8c23-9ff7e615532d admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:45.856206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35c9b-122c-413c-83b2-7cfc3faaafaa admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:45.865597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad7710-e0bc-449a-b33a-1e86936bb7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:45.866241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad7710-e0bc-449a-b33a-1e86936bb7ed admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.866518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad7710-e0bc-449a-b33a-1e86936bb7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.866788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad7710-e0bc-449a-b33a-1e86936bb7ed admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.867747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d22b8a-706f-4d13-8adc-3dcfc695eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:45.868571 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad7710-e0bc-449a-b33a-1e86936bb7ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:45.869277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d22b8a-706f-4d13-8adc-3dcfc695eb5b admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.869769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d22b8a-706f-4d13-8adc-3dcfc695eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.870350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d22b8a-706f-4d13-8adc-3dcfc695eb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.870837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad7710-e0bc-449a-b33a-1e86936bb7ed admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:45.875511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d22b8a-706f-4d13-8adc-3dcfc695eb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:45.877650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d22b8a-706f-4d13-8adc-3dcfc695eb5b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:45.906548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1114/2224] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:45.911244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d22b8a-706f-4d13-8adc-3dcfc695eb5b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:45.924514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d22b8a-706f-4d13-8adc-3dcfc695eb5b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:45.929630 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b44b99-f776-43a8-858a-cd242e271ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:45.930547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b44b99-f776-43a8-858a-cd242e271ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.930831 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b44b99-f776-43a8-858a-cd242e271ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.931118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b44b99-f776-43a8-858a-cd242e271ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.932391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b44b99-f776-43a8-858a-cd242e271ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:45.933603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b44b99-f776-43a8-858a-cd242e271ff0 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:45.955283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1115/2225] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:45.956309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b44b99-f776-43a8-858a-cd242e271ff0 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:45.968761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b44b99-f776-43a8-858a-cd242e271ff0 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:45.976545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcd0577-9da9-4cd8-b897-bbe1c008e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:45.976545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd0577-9da9-4cd8-b897-bbe1c008e03e admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:45.976545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd0577-9da9-4cd8-b897-bbe1c008e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:45.976545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcd0577-9da9-4cd8-b897-bbe1c008e03e admin admin] PATH_INFO: `/v3/projects/fe2adcc994174085bc0e8bc53e585a72/users/98e98e2e7bde46b4a4a95c39458f0f0d/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:45.993888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd0577-9da9-4cd8-b897-bbe1c008e03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2adcc994174085bc0e8bc53e585a72, user_id=98e98e2e7bde46b4a4a95c39458f0f0d, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:45.997894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1111/2226] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:45 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:45.998129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcd0577-9da9-4cd8-b897-bbe1c008e03e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:46.005975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad7710-e0bc-449a-b33a-1e86936bb7ed admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:46.037367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad7710-e0bc-449a-b33a-1e86936bb7ed admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:46.043761 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf023f-26ba-40a5-9c64-c5ee5fa25400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:46.044453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf023f-26ba-40a5-9c64-c5ee5fa25400 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:46.048162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf023f-26ba-40a5-9c64-c5ee5fa25400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:46.048162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cf023f-26ba-40a5-9c64-c5ee5fa25400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:46.048162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf023f-26ba-40a5-9c64-c5ee5fa25400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:46.048162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cf023f-26ba-40a5-9c64-c5ee5fa25400 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:46.060296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1112/2227] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:46.064681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf023f-26ba-40a5-9c64-c5ee5fa25400 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:46.077262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cf023f-26ba-40a5-9c64-c5ee5fa25400 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:46.083261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09850f50-b5f0-46af-835c-2ce27281c6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:46.083930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09850f50-b5f0-46af-835c-2ce27281c6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:46.084210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09850f50-b5f0-46af-835c-2ce27281c6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:46.084490 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09850f50-b5f0-46af-835c-2ce27281c6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:46.085167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09850f50-b5f0-46af-835c-2ce27281c6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:46.086841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09850f50-b5f0-46af-835c-2ce27281c6f1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:46.102310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1113/2228] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:52:46.107367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09850f50-b5f0-46af-835c-2ce27281c6f1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:46.119655 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1116/2229] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:45 2022] PUT /identity/v3/projects/fe2adcc994174085bc0e8bc53e585a72/users/98e98e2e7bde46b4a4a95c39458f0f0d/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:46.128871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09850f50-b5f0-46af-835c-2ce27281c6f1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:46.140263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839818-2b38-4806-8d35-a9999392eadf None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:46.140654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839818-2b38-4806-8d35-a9999392eadf None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:46.140943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839818-2b38-4806-8d35-a9999392eadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:46.227334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-25839818-2b38-4806-8d35-a9999392eadf None None] MFA Rules not processed for user `98e98e2e7bde46b4a4a95c39458f0f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:46.228940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-25839818-2b38-4806-8d35-a9999392eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:46.235551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7fda7-c4f8-4720-a079-361b4e313b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:46.236233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7fda7-c4f8-4720-a079-361b4e313b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:46.236792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7fda7-c4f8-4720-a079-361b4e313b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:46.237247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7fda7-c4f8-4720-a079-361b4e313b98 admin admin] PATH_INFO: `/v3/projects/046c2227ad1742ba99686988515b8ad4/users/0c5e1d7e8f7144a6a8f7d912021a58a2/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:46.306823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7fda7-c4f8-4720-a079-361b4e313b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=046c2227ad1742ba99686988515b8ad4, user_id=0c5e1d7e8f7144a6a8f7d912021a58a2, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:46.310708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7fda7-c4f8-4720-a079-361b4e313b98 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:46.418798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1114/2230] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:46 2022] PUT /identity/v3/projects/046c2227ad1742ba99686988515b8ad4/users/0c5e1d7e8f7144a6a8f7d912021a58a2/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:52:46.420920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d81c0-ff85-4bc0-b234-3b2e5092e4bd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:46.425549 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d81c0-ff85-4bc0-b234-3b2e5092e4bd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:46.425944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d81c0-ff85-4bc0-b234-3b2e5092e4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:46.454804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1117/2231] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:46.455828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839818-2b38-4806-8d35-a9999392eadf None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:46.468094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839818-2b38-4806-8d35-a9999392eadf None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:46.489936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1f4d81c0-ff85-4bc0-b234-3b2e5092e4bd None None] MFA Rules not processed for user `0c5e1d7e8f7144a6a8f7d912021a58a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:46.491444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1f4d81c0-ff85-4bc0-b234-3b2e5092e4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:46.514075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:46.594810 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1115/2232] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:46.606132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d81c0-ff85-4bc0-b234-3b2e5092e4bd None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:46.610956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a966982-f8c6-44f3-a9f4-0794dd6a3ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:46.611254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a966982-f8c6-44f3-a9f4-0794dd6a3ede admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:46.611694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a966982-f8c6-44f3-a9f4-0794dd6a3ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:46.612150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1f4d81c0-ff85-4bc0-b234-3b2e5092e4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:46.612372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a966982-f8c6-44f3-a9f4-0794dd6a3ede admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:46.612913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a966982-f8c6-44f3-a9f4-0794dd6a3ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:46.615518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a966982-f8c6-44f3-a9f4-0794dd6a3ede admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:46.700397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d81c0-ff85-4bc0-b234-3b2e5092e4bd None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:46.705281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7f166-fd36-4e33-ad7e-b0c8fa7719e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:46.711476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7f166-fd36-4e33-ad7e-b0c8fa7719e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:46.711476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7f166-fd36-4e33-ad7e-b0c8fa7719e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:46.711476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7f166-fd36-4e33-ad7e-b0c8fa7719e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:46.719930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7f166-fd36-4e33-ad7e-b0c8fa7719e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:46.721418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7f166-fd36-4e33-ad7e-b0c8fa7719e6 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:46.731702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1116/2233] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:46.753861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7f166-fd36-4e33-ad7e-b0c8fa7719e6 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:46.754215 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1118/2234] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:46 2022] POST /identity/v3/projects => generated 383 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:46.772713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7f166-fd36-4e33-ad7e-b0c8fa7719e6 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:46.914779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab70a0-0598-44e0-8596-5b4b273d9321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:46.914779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab70a0-0598-44e0-8596-5b4b273d9321 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:46.919801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab70a0-0598-44e0-8596-5b4b273d9321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:46.919801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab70a0-0598-44e0-8596-5b4b273d9321 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:46.919801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab70a0-0598-44e0-8596-5b4b273d9321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:46.923878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab70a0-0598-44e0-8596-5b4b273d9321 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:47.102396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1117/2235] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:46 2022] POST /identity/v3/users => generated 298 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:52:47.107503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a966982-f8c6-44f3-a9f4-0794dd6a3ede admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:47.129509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a966982-f8c6-44f3-a9f4-0794dd6a3ede admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:47.141711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e265f3-6bfe-4cba-954c-a8cd4f27ad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:47.142518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e265f3-6bfe-4cba-954c-a8cd4f27ad0b admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:47.143170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e265f3-6bfe-4cba-954c-a8cd4f27ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:47.143803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e265f3-6bfe-4cba-954c-a8cd4f27ad0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:47.144888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e265f3-6bfe-4cba-954c-a8cd4f27ad0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:47.147474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e265f3-6bfe-4cba-954c-a8cd4f27ad0b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:47.166310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1119/2236] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:47.169013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab70a0-0598-44e0-8596-5b4b273d9321 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:47.187083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab70a0-0598-44e0-8596-5b4b273d9321 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:47.192496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aeb5a-edba-43bd-b50d-4648c6f9a24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:47.193210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aeb5a-edba-43bd-b50d-4648c6f9a24e admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:47.203282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aeb5a-edba-43bd-b50d-4648c6f9a24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:47.203282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aeb5a-edba-43bd-b50d-4648c6f9a24e admin admin] PATH_INFO: `/v3/projects/8bfe81ecdd534ad5aad3aad65365deda/users/e5e4b13a0b264e36a98722074e322ff8/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:47.231491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aeb5a-edba-43bd-b50d-4648c6f9a24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfe81ecdd534ad5aad3aad65365deda, user_id=e5e4b13a0b264e36a98722074e322ff8, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:47.249135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aeb5a-edba-43bd-b50d-4648c6f9a24e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:47.381721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1118/2237] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:47 2022] PUT /identity/v3/projects/8bfe81ecdd534ad5aad3aad65365deda/users/e5e4b13a0b264e36a98722074e322ff8/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:47.387328 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:47.388312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e265f3-6bfe-4cba-954c-a8cd4f27ad0b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:47.418062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e265f3-6bfe-4cba-954c-a8cd4f27ad0b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:47.511988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53299af2-4afc-4770-8649-b37abb422817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:47.512914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53299af2-4afc-4770-8649-b37abb422817 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:47.513267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53299af2-4afc-4770-8649-b37abb422817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:47.513687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53299af2-4afc-4770-8649-b37abb422817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:47.514424 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53299af2-4afc-4770-8649-b37abb422817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:47.516121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53299af2-4afc-4770-8649-b37abb422817 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:47.545277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aeb5a-edba-43bd-b50d-4648c6f9a24e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:47.552818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1120/2238] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:52:47.561187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aeb5a-edba-43bd-b50d-4648c6f9a24e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:47.566757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecbfc0-c5dd-4e39-8420-006a7047357b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:47.566757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecbfc0-c5dd-4e39-8420-006a7047357b admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:47.566757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecbfc0-c5dd-4e39-8420-006a7047357b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:47.566757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecbfc0-c5dd-4e39-8420-006a7047357b admin admin] PATH_INFO: `/v3/projects/8bfe81ecdd534ad5aad3aad65365deda/users/e5e4b13a0b264e36a98722074e322ff8/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:47.567803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecbfc0-c5dd-4e39-8420-006a7047357b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bfe81ecdd534ad5aad3aad65365deda, user_id=e5e4b13a0b264e36a98722074e322ff8, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:47.570755 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecbfc0-c5dd-4e39-8420-006a7047357b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:47.582931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1119/2239] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:52:47 2022] PUT /identity/v3/projects/8bfe81ecdd534ad5aad3aad65365deda/users/e5e4b13a0b264e36a98722074e322ff8/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:47.594192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9c34b-c52e-4004-bc09-2b6d8d9d0c4c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:47.594519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9c34b-c52e-4004-bc09-2b6d8d9d0c4c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:47.594806 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9c34b-c52e-4004-bc09-2b6d8d9d0c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:47.632236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9ef9c34b-c52e-4004-bc09-2b6d8d9d0c4c None None] MFA Rules not processed for user `e5e4b13a0b264e36a98722074e322ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:47.632236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9ef9c34b-c52e-4004-bc09-2b6d8d9d0c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:47.742412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1121/2240] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:52:47.849106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecbfc0-c5dd-4e39-8420-006a7047357b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:47.955643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecbfc0-c5dd-4e39-8420-006a7047357b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:47.960244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8580b-f0bb-4936-a872-efc4c19229e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:47.961428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8580b-f0bb-4936-a872-efc4c19229e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:47.961428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8580b-f0bb-4936-a872-efc4c19229e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:47.961989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8580b-f0bb-4936-a872-efc4c19229e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:48.065952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8580b-f0bb-4936-a872-efc4c19229e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:48.068335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8580b-f0bb-4936-a872-efc4c19229e1 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:48.086910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1120/2241] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:49.862816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:49.904965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:50.926434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:51.673079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9c34b-c52e-4004-bc09-2b6d8d9d0c4c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:51.686027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9c34b-c52e-4004-bc09-2b6d8d9d0c4c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:51.690534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9d3b0-ca8a-4b7d-80c6-f6606903feab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:51.691255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d3b0-ca8a-4b7d-80c6-f6606903feab service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:51.691659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d3b0-ca8a-4b7d-80c6-f6606903feab service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:51.695141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d3b0-ca8a-4b7d-80c6-f6606903feab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:51.815908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9d3b0-ca8a-4b7d-80c6-f6606903feab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:51.817904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9d3b0-ca8a-4b7d-80c6-f6606903feab service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:51.852718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1122/2242] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:52.980719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:53.308774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:54.075440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8580b-f0bb-4936-a872-efc4c19229e1 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:54.076988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bed8580b-f0bb-4936-a872-efc4c19229e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:54.165802 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8580b-f0bb-4936-a872-efc4c19229e1 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:54.171151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:54.171793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:54.172068 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:54.172336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] PATH_INFO: `/v3/users/8f158fe275af48cb8c2e7fb5c593896d` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:54.173521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f158fe275af48cb8c2e7fb5c593896d)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:54.175580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:54.815440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f158fe275af48cb8c2e7fb5c593896d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:54.824926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f158fe275af48cb8c2e7fb5c593896d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:54.825993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f158fe275af48cb8c2e7fb5c593896d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:54.965134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f158fe275af48cb8c2e7fb5c593896d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:54.966841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f158fe275af48cb8c2e7fb5c593896d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:54.987799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1121/2243] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:54 2022] DELETE /identity/v3/users/8f158fe275af48cb8c2e7fb5c593896d => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:54.993182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282520a6-88aa-4759-b046-7e752253b53f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:54.993750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282520a6-88aa-4759-b046-7e752253b53f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:54.993750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282520a6-88aa-4759-b046-7e752253b53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:55.023607 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-282520a6-88aa-4759-b046-7e752253b53f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:55.025386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-282520a6-88aa-4759-b046-7e752253b53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:55.129103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1123/2244] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:55.139730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:55.141201 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:55.203426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a8633-5c0f-4f9e-9778-dbf2633743d3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:55.212545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d3ff4-bd2a-4dbf-b66e-f1126d584ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:55.212545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d3ff4-bd2a-4dbf-b66e-f1126d584ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:55.212545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d3ff4-bd2a-4dbf-b66e-f1126d584ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:55.212545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d3ff4-bd2a-4dbf-b66e-f1126d584ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:55.219652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d3ff4-bd2a-4dbf-b66e-f1126d584ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:55.221160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d3ff4-bd2a-4dbf-b66e-f1126d584ce7 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:55.233605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1122/2245] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:55.597601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282520a6-88aa-4759-b046-7e752253b53f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:55.599209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-282520a6-88aa-4759-b046-7e752253b53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:55.632779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:55.669765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282520a6-88aa-4759-b046-7e752253b53f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:55.674106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae319b-9bec-4717-b8e0-8a4d4dd10396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:55.674743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae319b-9bec-4717-b8e0-8a4d4dd10396 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:55.675021 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae319b-9bec-4717-b8e0-8a4d4dd10396 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:55.675288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae319b-9bec-4717-b8e0-8a4d4dd10396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:55.677138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4eae319b-9bec-4717-b8e0-8a4d4dd10396 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:55.770369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae319b-9bec-4717-b8e0-8a4d4dd10396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:55.771850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae319b-9bec-4717-b8e0-8a4d4dd10396 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:55.782978 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1124/2246] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:52:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:52:55.905474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d3ff4-bd2a-4dbf-b66e-f1126d584ce7 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:55.908246 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-504d3ff4-bd2a-4dbf-b66e-f1126d584ce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:55.925410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d3ff4-bd2a-4dbf-b66e-f1126d584ce7 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:55.941271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:55.941271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:55.941271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:55.941271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] PATH_INFO: `/v3/projects/7ce75587b6214719a405d523970b3639` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:55.941902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce75587b6214719a405d523970b3639)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:55.941902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:56.196255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce75587b6214719a405d523970b3639', 'request_id': 'req-39a9bd3a-ecc5-475a-9709-7f9084e3a549'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:56.204680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce75587b6214719a405d523970b3639', 'request_id': 'req-39a9bd3a-ecc5-475a-9709-7f9084e3a549'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:56.318625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce75587b6214719a405d523970b3639', 'request_id': 'req-39a9bd3a-ecc5-475a-9709-7f9084e3a549'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:56.332930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] The token cache is being invalidate because project 7ce75587b6214719a405d523970b3639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:56.333582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:56.334494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:56.339630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1123/2247] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:55 2022] DELETE /identity/v3/projects/7ce75587b6214719a405d523970b3639 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:56.341656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae319b-9bec-4717-b8e0-8a4d4dd10396 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:56.354700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae319b-9bec-4717-b8e0-8a4d4dd10396 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:56.446987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:56.448241 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:56.448580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:56.448861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] PATH_INFO: `/v3/users/a9584b6aceab4e43b1bc9ec80a6d4212` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:56.450049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9584b6aceab4e43b1bc9ec80a6d4212)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:56.452277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:56.717804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9584b6aceab4e43b1bc9ec80a6d4212'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:56.727910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9584b6aceab4e43b1bc9ec80a6d4212'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:56.728955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9584b6aceab4e43b1bc9ec80a6d4212'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:56.857006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9584b6aceab4e43b1bc9ec80a6d4212'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:56.877230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9584b6aceab4e43b1bc9ec80a6d4212'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:56.888802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1125/2248] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:56 2022] DELETE /identity/v3/users/a9584b6aceab4e43b1bc9ec80a6d4212 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:56.898849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:57.493509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:57.493509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:57.503574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9bd3a-ecc5-475a-9709-7f9084e3a549 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:57.574750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:57.575489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:57.575913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:57.576184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] PATH_INFO: `/v3/projects/e38d42218a20420eb7831393d5637e1e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:57.577592 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38d42218a20420eb7831393d5637e1e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:57.579734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:57.727702 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38d42218a20420eb7831393d5637e1e', 'request_id': 'req-4cd8fa24-fa36-4873-8024-c418000d1e40'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:57.733267 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38d42218a20420eb7831393d5637e1e', 'request_id': 'req-4cd8fa24-fa36-4873-8024-c418000d1e40'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:57.816049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38d42218a20420eb7831393d5637e1e', 'request_id': 'req-4cd8fa24-fa36-4873-8024-c418000d1e40'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:57.829087 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] The token cache is being invalidate because project e38d42218a20420eb7831393d5637e1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:57.829377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:57.830038 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:57.831886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1124/2249] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:57 2022] DELETE /identity/v3/projects/e38d42218a20420eb7831393d5637e1e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:57.836095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:57.837633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:57.851994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ed787-fcc4-4b6b-8c84-f588db79c5bd admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:57.917490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:57.918579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:57.919082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:57.919585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] PATH_INFO: `/v3/users/b2810e728b4a48e5afec1d8d9b518073` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:57.922048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2810e728b4a48e5afec1d8d9b518073)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:57.925360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:58.200200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2810e728b4a48e5afec1d8d9b518073'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:58.208419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2810e728b4a48e5afec1d8d9b518073'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:58.209662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2810e728b4a48e5afec1d8d9b518073'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:58.341001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2810e728b4a48e5afec1d8d9b518073'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:58.356353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-bac800b3-cfe1-4c1e-9e02-a6f1efe3abdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2810e728b4a48e5afec1d8d9b518073'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:58.365873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1126/2250] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:52:57 2022] DELETE /identity/v3/users/b2810e728b4a48e5afec1d8d9b518073 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:58.899880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:58.901471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:58.917253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8fa24-fa36-4873-8024-c418000d1e40 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:59.011981 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:59.013102 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:59.013590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:59.014086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] PATH_INFO: `/v3/projects/92ac33ac9bf34829b4e5fc1dfe6ad7eb` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:59.016186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ac33ac9bf34829b4e5fc1dfe6ad7eb)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:59.020008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:59.039859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:52:59.262078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ac33ac9bf34829b4e5fc1dfe6ad7eb', 'request_id': 'req-d52c616b-b782-411a-ad37-164b9041c88f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:59.287472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ac33ac9bf34829b4e5fc1dfe6ad7eb', 'request_id': 'req-d52c616b-b782-411a-ad37-164b9041c88f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:59.423882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ac33ac9bf34829b4e5fc1dfe6ad7eb', 'request_id': 'req-d52c616b-b782-411a-ad37-164b9041c88f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:59.436927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] The token cache is being invalidate because project 92ac33ac9bf34829b4e5fc1dfe6ad7eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:52:59.437219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:59.437895 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d52c616b-b782-411a-ad37-164b9041c88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:52:59.439535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1125/2251] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:52:58 2022] DELETE /identity/v3/projects/92ac33ac9bf34829b4e5fc1dfe6ad7eb => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:52:59.444644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584475-e097-4685-943a-bf9c52d65290 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:59.445294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584475-e097-4685-943a-bf9c52d65290 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:59.445518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52584475-e097-4685-943a-bf9c52d65290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:59.467474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-52584475-e097-4685-943a-bf9c52d65290 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:59.468883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-52584475-e097-4685-943a-bf9c52d65290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:59.545904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1127/2252] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:52:59.558948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af302276-6730-4b42-9118-b713a4074c20 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:59.559232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af302276-6730-4b42-9118-b713a4074c20 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:59.559508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af302276-6730-4b42-9118-b713a4074c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:59.583449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-af302276-6730-4b42-9118-b713a4074c20 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:52:59.584808 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-af302276-6730-4b42-9118-b713a4074c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:52:59.594142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1126/2253] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:52:59.599049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52584475-e097-4685-943a-bf9c52d65290 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:59.610218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52584475-e097-4685-943a-bf9c52d65290 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:59.615110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedacea3-7091-4a99-8104-d89c4fab618c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:59.615788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedacea3-7091-4a99-8104-d89c4fab618c admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:59.616147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedacea3-7091-4a99-8104-d89c4fab618c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:59.616416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedacea3-7091-4a99-8104-d89c4fab618c admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:59.617123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedacea3-7091-4a99-8104-d89c4fab618c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:52:59.617421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedacea3-7091-4a99-8104-d89c4fab618c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:59.619069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedacea3-7091-4a99-8104-d89c4fab618c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:59.634406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1128/2254] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:52:59.638138 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af302276-6730-4b42-9118-b713a4074c20 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:59.647926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af302276-6730-4b42-9118-b713a4074c20 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:59.653421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387038fc-96af-4bf8-97c6-beed06679306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:59.654071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387038fc-96af-4bf8-97c6-beed06679306 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:59.654415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387038fc-96af-4bf8-97c6-beed06679306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:59.654697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387038fc-96af-4bf8-97c6-beed06679306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:59.655295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387038fc-96af-4bf8-97c6-beed06679306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:59.657417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387038fc-96af-4bf8-97c6-beed06679306 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:52:59.816335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1127/2255] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:52:59 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:52:59.820671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedacea3-7091-4a99-8104-d89c4fab618c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:52:59.832390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedacea3-7091-4a99-8104-d89c4fab618c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:52:59.907227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4f2b4-7d38-40c8-9453-5bd654d938b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:52:59.907227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4f2b4-7d38-40c8-9453-5bd654d938b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:52:59.907227 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4f2b4-7d38-40c8-9453-5bd654d938b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:52:59.907718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4f2b4-7d38-40c8-9453-5bd654d938b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:52:59.908192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4f2b4-7d38-40c8-9453-5bd654d938b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:52:59.910467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4f2b4-7d38-40c8-9453-5bd654d938b7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:00.031327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1129/2256] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:52:59 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:53:00.035868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387038fc-96af-4bf8-97c6-beed06679306 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:00.056057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387038fc-96af-4bf8-97c6-beed06679306 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:00.061586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58cd67-26be-4a51-ba8d-6aebb878591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:00.064060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58cd67-26be-4a51-ba8d-6aebb878591e admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:00.064060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58cd67-26be-4a51-ba8d-6aebb878591e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:00.064060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58cd67-26be-4a51-ba8d-6aebb878591e admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:00.064060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58cd67-26be-4a51-ba8d-6aebb878591e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:00.065923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58cd67-26be-4a51-ba8d-6aebb878591e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:00.102277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1128/2257] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:53:00.106252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4f2b4-7d38-40c8-9453-5bd654d938b7 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:00.132032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4f2b4-7d38-40c8-9453-5bd654d938b7 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:00.142429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7f31a-c6b8-4c98-98c4-37a80b8b31cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:00.143696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f31a-c6b8-4c98-98c4-37a80b8b31cd admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:00.144130 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f31a-c6b8-4c98-98c4-37a80b8b31cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:00.146041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7f31a-c6b8-4c98-98c4-37a80b8b31cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:00.147310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7f31a-c6b8-4c98-98c4-37a80b8b31cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:00.149746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7f31a-c6b8-4c98-98c4-37a80b8b31cd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:00.167841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1130/2258] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:53:00.170697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58cd67-26be-4a51-ba8d-6aebb878591e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:00.184978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58cd67-26be-4a51-ba8d-6aebb878591e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:00.190623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aa6e7-6273-4892-b563-3cdd32b87f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:00.191483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aa6e7-6273-4892-b563-3cdd32b87f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:00.192239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aa6e7-6273-4892-b563-3cdd32b87f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:00.192797 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42aa6e7-6273-4892-b563-3cdd32b87f14 admin admin] PATH_INFO: `/v3/projects/1515d87b44484ec4904ec2303c9f1f33/users/9f617d6e3f3444cda7307794d7b8d837/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:00.248149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:00.254167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42aa6e7-6273-4892-b563-3cdd32b87f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1515d87b44484ec4904ec2303c9f1f33, user_id=9f617d6e3f3444cda7307794d7b8d837, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:00.258222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42aa6e7-6273-4892-b563-3cdd32b87f14 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:00.438187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1129/2259] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:53:00 2022] PUT /identity/v3/projects/1515d87b44484ec4904ec2303c9f1f33/users/9f617d6e3f3444cda7307794d7b8d837/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:53:00.443859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c22e5f-ba26-426c-99cb-dcf9f23076df None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:00.444332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c22e5f-ba26-426c-99cb-dcf9f23076df None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:00.444794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c22e5f-ba26-426c-99cb-dcf9f23076df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:00.471559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-68c22e5f-ba26-426c-99cb-dcf9f23076df None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:00.473289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-68c22e5f-ba26-426c-99cb-dcf9f23076df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:00.608307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1131/2260] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:00.947519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aa6e7-6273-4892-b563-3cdd32b87f14 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:00.957026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b42aa6e7-6273-4892-b563-3cdd32b87f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:01.124088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:01.133561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42aa6e7-6273-4892-b563-3cdd32b87f14 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:01.141821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6ac98-1363-4914-b253-c9aada57e651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:01.143992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6ac98-1363-4914-b253-c9aada57e651 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:01.145029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6ac98-1363-4914-b253-c9aada57e651 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:01.145870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6ac98-1363-4914-b253-c9aada57e651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:01.173406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6ac98-1363-4914-b253-c9aada57e651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:01.178362 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6ac98-1363-4914-b253-c9aada57e651 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:01.201903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1130/2261] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:02.641348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c22e5f-ba26-426c-99cb-dcf9f23076df None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:02.644188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-68c22e5f-ba26-426c-99cb-dcf9f23076df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:02.660238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c22e5f-ba26-426c-99cb-dcf9f23076df None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:02.669541 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:02.670927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:02.671564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:02.671931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] PATH_INFO: `/v3/users/b6148d30dd374817922af119ee180dbf` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:02.674034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6148d30dd374817922af119ee180dbf)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:02.677789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:02.959055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6148d30dd374817922af119ee180dbf'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:02.966413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6148d30dd374817922af119ee180dbf'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:02.967154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6148d30dd374817922af119ee180dbf'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:03.058835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6148d30dd374817922af119ee180dbf'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:03.074518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6148d30dd374817922af119ee180dbf'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:03.080815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1132/2262] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:53:02 2022] DELETE /identity/v3/users/b6148d30dd374817922af119ee180dbf => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:03.085645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8197e-5e0c-42ae-a849-c0166bd7728d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:03.086143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8197e-5e0c-42ae-a849-c0166bd7728d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:03.086239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8197e-5e0c-42ae-a849-c0166bd7728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:03.106803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f2a8197e-5e0c-42ae-a849-c0166bd7728d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:03.108132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f2a8197e-5e0c-42ae-a849-c0166bd7728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:03.198768 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1131/2263] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:03.211291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:03.213600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:03.292186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e660f-4b23-4b3d-be8f-d9bdff852e89 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:03.302726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe815d-dd89-463c-9cb3-37d19e665a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:03.306017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe815d-dd89-463c-9cb3-37d19e665a46 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:03.306770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe815d-dd89-463c-9cb3-37d19e665a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:03.307831 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe815d-dd89-463c-9cb3-37d19e665a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:03.325443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe815d-dd89-463c-9cb3-37d19e665a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:03.330017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe815d-dd89-463c-9cb3-37d19e665a46 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:03.353223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1133/2264] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:03.363904 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d873f-9e42-4dd3-965d-cdb35f938adc None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:03.364198 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d873f-9e42-4dd3-965d-cdb35f938adc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:03.364449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d873f-9e42-4dd3-965d-cdb35f938adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:03.406076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-704d873f-9e42-4dd3-965d-cdb35f938adc None None] MFA Rules not processed for user `9f617d6e3f3444cda7307794d7b8d837`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:03.407984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-704d873f-9e42-4dd3-965d-cdb35f938adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:03.533231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1132/2265] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:53:03.554331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe815d-dd89-463c-9cb3-37d19e665a46 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:03.556023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-cefe815d-dd89-463c-9cb3-37d19e665a46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:03.675816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe815d-dd89-463c-9cb3-37d19e665a46 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:03.682423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d96d2-69a4-4010-99ea-cf708b462d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:03.683441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d96d2-69a4-4010-99ea-cf708b462d6d service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:03.683963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d96d2-69a4-4010-99ea-cf708b462d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:03.684441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d96d2-69a4-4010-99ea-cf708b462d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:03.695740 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d96d2-69a4-4010-99ea-cf708b462d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:03.697472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d96d2-69a4-4010-99ea-cf708b462d6d service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:03.708393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1134/2266] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:03.722642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:04.270431 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756e4cc-eb9a-4116-a83a-f33aabcc67d4 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:04.272930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756e4cc-eb9a-4116-a83a-f33aabcc67d4 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:04.273639 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756e4cc-eb9a-4116-a83a-f33aabcc67d4 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:04.280514 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1133/2267] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:53:04 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:53:04.288791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e809c67-fa51-4127-86ac-074a483e1af6 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:04.288791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e809c67-fa51-4127-86ac-074a483e1af6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:04.289131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756e4cc-eb9a-4116-a83a-f33aabcc67d4 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:04.292333 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e809c67-fa51-4127-86ac-074a483e1af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:04.293038 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8756e4cc-eb9a-4116-a83a-f33aabcc67d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:04.333876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-1e809c67-fa51-4127-86ac-074a483e1af6 None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:04.335373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-1e809c67-fa51-4127-86ac-074a483e1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:04.351641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756e4cc-eb9a-4116-a83a-f33aabcc67d4 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:04.359260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:04.360074 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:04.360435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:04.360825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] PATH_INFO: `/v3/projects/933f36ed9eb940aea3cefd545059cf38` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:04.362508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=933f36ed9eb940aea3cefd545059cf38)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:04.364848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:04.438383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1135/2268] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:53:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:53:04.451673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e809c67-fa51-4127-86ac-074a483e1af6 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:04.453939 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-1e809c67-fa51-4127-86ac-074a483e1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:04.517773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '933f36ed9eb940aea3cefd545059cf38', 'request_id': 'req-8ba0d284-828d-42e2-b233-03e570364df4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:04.526756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '933f36ed9eb940aea3cefd545059cf38', 'request_id': 'req-8ba0d284-828d-42e2-b233-03e570364df4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:04.535709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e809c67-fa51-4127-86ac-074a483e1af6 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:04.601830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c8391-4e30-4469-81dd-f623f0a2b873 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07be3fbf45dc407ba3b6ad4d1e6ea042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:04.602510 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c8391-4e30-4469-81dd-f623f0a2b873 service glance] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:04.602948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c8391-4e30-4469-81dd-f623f0a2b873 service glance] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:04.603230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c8391-4e30-4469-81dd-f623f0a2b873 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:04.644850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '933f36ed9eb940aea3cefd545059cf38', 'request_id': 'req-8ba0d284-828d-42e2-b233-03e570364df4'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:04.667690 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] The token cache is being invalidate because project 933f36ed9eb940aea3cefd545059cf38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:53:04.667983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:04.668882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:04.671086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1134/2269] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:53:04 2022] DELETE /identity/v3/projects/933f36ed9eb940aea3cefd545059cf38 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:53:04.676381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:04.678029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:04.692134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c8391-4e30-4469-81dd-f623f0a2b873 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:04.696594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c8391-4e30-4469-81dd-f623f0a2b873 service glance] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:04.706755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1136/2270] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:04.755098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0d284-828d-42e2-b233-03e570364df4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:04.760745 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:04.761083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:04.761369 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:04.761649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] PATH_INFO: `/v3/users/98e98e2e7bde46b4a4a95c39458f0f0d` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:04.763005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e98e2e7bde46b4a4a95c39458f0f0d)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:04.765386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:04.865269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c8391-4e30-4469-81dd-f623f0a2b873 service glance] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:04.868914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4b3c8391-4e30-4469-81dd-f623f0a2b873 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:04.889983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c8391-4e30-4469-81dd-f623f0a2b873 service glance] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:04.902591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:04.906917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:04.906917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:04.906917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] PATH_INFO: `/v3/users/fd3bf54b37324d7c82ceaddd15ed3e87` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:04.906917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3bf54b37324d7c82ceaddd15ed3e87)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:04.908068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:05.063446 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:05.079322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e98e2e7bde46b4a4a95c39458f0f0d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:05.086870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e98e2e7bde46b4a4a95c39458f0f0d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:05.087621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e98e2e7bde46b4a4a95c39458f0f0d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:05.171414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3bf54b37324d7c82ceaddd15ed3e87'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:05.194137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3bf54b37324d7c82ceaddd15ed3e87'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:05.194137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3bf54b37324d7c82ceaddd15ed3e87'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:05.212655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e98e2e7bde46b4a4a95c39458f0f0d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:05.213472 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-6b0f4b7b-3c92-4dc9-89f9-c88224e50efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e98e2e7bde46b4a4a95c39458f0f0d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:05.244556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1135/2271] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:53:04 2022] DELETE /identity/v3/users/98e98e2e7bde46b4a4a95c39458f0f0d => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:05.247563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaedfe3-0cd5-4369-bfd2-9ae05a4ee635 None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:05.247979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaedfe3-0cd5-4369-bfd2-9ae05a4ee635 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:05.248344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaedfe3-0cd5-4369-bfd2-9ae05a4ee635 None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:05.254971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1136/2272] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:53:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:53:05.282066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6eb6-29a7-40a0-ac16-ff1ecb23f7dd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:05.283447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6eb6-29a7-40a0-ac16-ff1ecb23f7dd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:05.284557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6eb6-29a7-40a0-ac16-ff1ecb23f7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:05.321924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-330c6eb6-29a7-40a0-ac16-ff1ecb23f7dd None None] MFA Rules not processed for user `2adcc3ba3bdf4b92bd719f60e0b263ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:05.323317 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-330c6eb6-29a7-40a0-ac16-ff1ecb23f7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:05.393052 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3bf54b37324d7c82ceaddd15ed3e87'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:05.411015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b1d4b59a-32bc-4bdf-ae85-784fc557dbcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3bf54b37324d7c82ceaddd15ed3e87'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:05.422965 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1137/2273] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:53:04 2022] DELETE /identity/v3/users/fd3bf54b37324d7c82ceaddd15ed3e87 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:05.427733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405ad40-404a-46b1-b6c8-fa65eaa65e45 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:05.428470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405ad40-404a-46b1-b6c8-fa65eaa65e45 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:05.429689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405ad40-404a-46b1-b6c8-fa65eaa65e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:05.434079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1137/2274] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:53:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:05.447840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6eb6-29a7-40a0-ac16-ff1ecb23f7dd None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:05.449515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-330c6eb6-29a7-40a0-ac16-ff1ecb23f7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:05.460862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e405ad40-404a-46b1-b6c8-fa65eaa65e45 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:05.461126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6eb6-29a7-40a0-ac16-ff1ecb23f7dd None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:05.462541 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e405ad40-404a-46b1-b6c8-fa65eaa65e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:05.519304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b377da-9b2c-4926-9e3d-766c2ad04fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:05.520149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b377da-9b2c-4926-9e3d-766c2ad04fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:05.520417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b377da-9b2c-4926-9e3d-766c2ad04fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:05.520734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b377da-9b2c-4926-9e3d-766c2ad04fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:05.530270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b377da-9b2c-4926-9e3d-766c2ad04fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:05.531963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b377da-9b2c-4926-9e3d-766c2ad04fc6 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:05.543293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1138/2275] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:53:05.579412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1138/2276] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:05.598683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b377da-9b2c-4926-9e3d-766c2ad04fc6 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:05.610055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b377da-9b2c-4926-9e3d-766c2ad04fc6 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:05.614310 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e42fd-94e3-4c11-a335-a30e03585f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:05.615296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e42fd-94e3-4c11-a335-a30e03585f64 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:05.615642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e42fd-94e3-4c11-a335-a30e03585f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:05.616248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e42fd-94e3-4c11-a335-a30e03585f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:05.627319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e42fd-94e3-4c11-a335-a30e03585f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:05.629060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e42fd-94e3-4c11-a335-a30e03585f64 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:05.639869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1139/2277] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:53:05.674569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d750564-da67-4d60-9b60-f0e546fa5422 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:05.674983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d750564-da67-4d60-9b60-f0e546fa5422 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:05.675310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d750564-da67-4d60-9b60-f0e546fa5422 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:05.677222 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1139/2278] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:53:05.688551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c269-dc5e-4623-8a62-296cf7beb508 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:05.689425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c269-dc5e-4623-8a62-296cf7beb508 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:05.689720 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31c269-dc5e-4623-8a62-296cf7beb508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:05.724988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3c31c269-dc5e-4623-8a62-296cf7beb508 None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:05.726349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3c31c269-dc5e-4623-8a62-296cf7beb508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:05.839859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1140/2279] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:53:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:05.859468 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d750564-da67-4d60-9b60-f0e546fa5422 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:05.870689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5d750564-da67-4d60-9b60-f0e546fa5422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:05.889276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d750564-da67-4d60-9b60-f0e546fa5422 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:05.893924 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742a01-df91-4ef6-8bb5-4303b456a3d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:05.895125 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742a01-df91-4ef6-8bb5-4303b456a3d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:05.895526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742a01-df91-4ef6-8bb5-4303b456a3d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:05.895875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41742a01-df91-4ef6-8bb5-4303b456a3d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:05.908682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742a01-df91-4ef6-8bb5-4303b456a3d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:05.910202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41742a01-df91-4ef6-8bb5-4303b456a3d5 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:05.922099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1140/2280] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:06.030674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1182458-c014-445e-88e7-13c43bcada67 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:06.030985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1182458-c014-445e-88e7-13c43bcada67 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:06.031244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1182458-c014-445e-88e7-13c43bcada67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:06.060151 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f1182458-c014-445e-88e7-13c43bcada67 None None] MFA Rules not processed for user `9f617d6e3f3444cda7307794d7b8d837`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:06.061691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f1182458-c014-445e-88e7-13c43bcada67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:06.129658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1141/2281] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:06.191068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742a01-df91-4ef6-8bb5-4303b456a3d5 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:06.200842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-41742a01-df91-4ef6-8bb5-4303b456a3d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:06.236784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41742a01-df91-4ef6-8bb5-4303b456a3d5 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:06.243230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:06.244966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:06.245298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:06.245569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] PATH_INFO: `/v3/projects/fe2adcc994174085bc0e8bc53e585a72` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:06.248399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2adcc994174085bc0e8bc53e585a72)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:06.251398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:06.329975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1182458-c014-445e-88e7-13c43bcada67 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:06.332277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f1182458-c014-445e-88e7-13c43bcada67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:06.350657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1182458-c014-445e-88e7-13c43bcada67 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:06.366271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:06.367314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:06.368629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:06.369660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] PATH_INFO: `/v3/projects/67841822358e4f2295da3df27d6a3da1` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:06.371278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67841822358e4f2295da3df27d6a3da1)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:06.374132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:06.470173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2adcc994174085bc0e8bc53e585a72', 'request_id': 'req-357218e5-7a1c-4513-906e-7c0877911d7e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:06.478595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2adcc994174085bc0e8bc53e585a72', 'request_id': 'req-357218e5-7a1c-4513-906e-7c0877911d7e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:06.550379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2adcc994174085bc0e8bc53e585a72', 'request_id': 'req-357218e5-7a1c-4513-906e-7c0877911d7e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:06.571612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] The token cache is being invalidate because project fe2adcc994174085bc0e8bc53e585a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:53:06.577205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:06.577205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:06.577205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1141/2282] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:53:06 2022] DELETE /identity/v3/projects/fe2adcc994174085bc0e8bc53e585a72 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:06.585246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:06.590042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:06.609195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67841822358e4f2295da3df27d6a3da1', 'request_id': 'req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:06.612424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67841822358e4f2295da3df27d6a3da1', 'request_id': 'req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:06.730821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357218e5-7a1c-4513-906e-7c0877911d7e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:06.737131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67841822358e4f2295da3df27d6a3da1', 'request_id': 'req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:06.764131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] The token cache is being invalidate because project 67841822358e4f2295da3df27d6a3da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:53:06.768529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:06.780090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f3c37ae2-6f1d-4169-9aa5-bb26c589fe50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:06.780090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1142/2283] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:53:06 2022] DELETE /identity/v3/projects/67841822358e4f2295da3df27d6a3da1 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:06.786389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc4b7b-cb34-4fbf-8a28-ae4c4561f0ba None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:06.786934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc4b7b-cb34-4fbf-8a28-ae4c4561f0ba None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:06.787507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc4b7b-cb34-4fbf-8a28-ae4c4561f0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:06.830459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-45bc4b7b-cb34-4fbf-8a28-ae4c4561f0ba None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:06.831706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-45bc4b7b-cb34-4fbf-8a28-ae4c4561f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:06.839300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:06.840317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:06.840711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:06.841064 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] PATH_INFO: `/v3/users/e5e4b13a0b264e36a98722074e322ff8` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:06.842344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e4b13a0b264e36a98722074e322ff8)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:06.844656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:06.852582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1143/2284] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:53:06.866005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92332cac-5e41-4e06-8667-039f06648ff9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:06.866005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92332cac-5e41-4e06-8667-039f06648ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:06.866005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92332cac-5e41-4e06-8667-039f06648ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:06.897779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-92332cac-5e41-4e06-8667-039f06648ff9 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:06.899441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-92332cac-5e41-4e06-8667-039f06648ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:06.932290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1144/2285] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:53:06.939481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92332cac-5e41-4e06-8667-039f06648ff9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:06.959011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92332cac-5e41-4e06-8667-039f06648ff9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:06.973904 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea14d3-a695-4595-9e64-a82727e162d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:06.975706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea14d3-a695-4595-9e64-a82727e162d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:06.976947 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea14d3-a695-4595-9e64-a82727e162d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:06.979448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea14d3-a695-4595-9e64-a82727e162d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:06.980216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea14d3-a695-4595-9e64-a82727e162d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:53:06.980556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea14d3-a695-4595-9e64-a82727e162d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:06.982733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea14d3-a695-4595-9e64-a82727e162d4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:07.003845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1145/2286] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:53:07.005247 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea14d3-a695-4595-9e64-a82727e162d4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:07.017786 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea14d3-a695-4595-9e64-a82727e162d4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:07.025048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e65b0-7134-43d5-afb5-3992e9f6e016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:07.025873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e65b0-7134-43d5-afb5-3992e9f6e016 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:07.026158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e65b0-7134-43d5-afb5-3992e9f6e016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:07.026970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07e65b0-7134-43d5-afb5-3992e9f6e016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:07.027799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e65b0-7134-43d5-afb5-3992e9f6e016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:07.030633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07e65b0-7134-43d5-afb5-3992e9f6e016 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:07.198878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1146/2287] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:53:07 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:53:07.203759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e65b0-7134-43d5-afb5-3992e9f6e016 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:07.207138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e4b13a0b264e36a98722074e322ff8'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:07.217329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e4b13a0b264e36a98722074e322ff8'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:07.219238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e4b13a0b264e36a98722074e322ff8'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:07.271343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07e65b0-7134-43d5-afb5-3992e9f6e016 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:07.278055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40238f58-a28c-4140-aecf-22795e97cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:07.278055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40238f58-a28c-4140-aecf-22795e97cf77 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:07.278553 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40238f58-a28c-4140-aecf-22795e97cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:07.278977 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40238f58-a28c-4140-aecf-22795e97cf77 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:07.279648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40238f58-a28c-4140-aecf-22795e97cf77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:07.281965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40238f58-a28c-4140-aecf-22795e97cf77 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:07.348187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e4b13a0b264e36a98722074e322ff8'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:07.376263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e4b13a0b264e36a98722074e322ff8'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:07.387342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1142/2288] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:53:06 2022] DELETE /identity/v3/users/e5e4b13a0b264e36a98722074e322ff8 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:07.428608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1147/2289] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:53:07 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:53:07.429348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:07.430785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:07.531657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:07.536955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcbdbb-010c-448f-97ab-cab07c02def9 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:07.543612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe217fb-e93c-4aab-8be4-41489ebaeffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:07.544385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe217fb-e93c-4aab-8be4-41489ebaeffc admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:07.544932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe217fb-e93c-4aab-8be4-41489ebaeffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:07.545519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe217fb-e93c-4aab-8be4-41489ebaeffc admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:07.546240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe217fb-e93c-4aab-8be4-41489ebaeffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:07.548043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe217fb-e93c-4aab-8be4-41489ebaeffc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:07.562103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1143/2290] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:53:07.566423 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40238f58-a28c-4140-aecf-22795e97cf77 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:07.595150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40238f58-a28c-4140-aecf-22795e97cf77 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:07.600675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4fa0e-bdff-4800-9523-e005a598b284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:07.601588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4fa0e-bdff-4800-9523-e005a598b284 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:07.605678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4fa0e-bdff-4800-9523-e005a598b284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:07.605678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4fa0e-bdff-4800-9523-e005a598b284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:07.605678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4fa0e-bdff-4800-9523-e005a598b284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:07.605678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4fa0e-bdff-4800-9523-e005a598b284 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:07.621480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1148/2291] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:53:07.628230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe217fb-e93c-4aab-8be4-41489ebaeffc admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:07.645043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe217fb-e93c-4aab-8be4-41489ebaeffc admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:07.650018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b66862-e7c6-4fe4-9f0c-addf25afdbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:07.651661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b66862-e7c6-4fe4-9f0c-addf25afdbc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:07.651661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b66862-e7c6-4fe4-9f0c-addf25afdbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:07.652027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b66862-e7c6-4fe4-9f0c-addf25afdbc2 admin admin] PATH_INFO: `/v3/projects/35e48d292397480b9b3191e957308c89/users/3f87b42c88954740914f36c5ea16368f/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:07.667579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b66862-e7c6-4fe4-9f0c-addf25afdbc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e48d292397480b9b3191e957308c89, user_id=3f87b42c88954740914f36c5ea16368f, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:07.670552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b66862-e7c6-4fe4-9f0c-addf25afdbc2 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:07.767642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1144/2292] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:53:07 2022] PUT /identity/v3/projects/35e48d292397480b9b3191e957308c89/users/3f87b42c88954740914f36c5ea16368f/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:07.779272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bddd-a138-4e2c-8d58-b7b4045c9169 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:07.779559 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bddd-a138-4e2c-8d58-b7b4045c9169 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:07.779831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44bddd-a138-4e2c-8d58-b7b4045c9169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:07.834109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ec44bddd-a138-4e2c-8d58-b7b4045c9169 None None] MFA Rules not processed for user `3f87b42c88954740914f36c5ea16368f`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:07.835371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ec44bddd-a138-4e2c-8d58-b7b4045c9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:07.927480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1149/2293] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:07.946531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b66862-e7c6-4fe4-9f0c-addf25afdbc2 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:07.949216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-63b66862-e7c6-4fe4-9f0c-addf25afdbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:08.002273 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44bddd-a138-4e2c-8d58-b7b4045c9169 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:08.006557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ec44bddd-a138-4e2c-8d58-b7b4045c9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:08.022267 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b66862-e7c6-4fe4-9f0c-addf25afdbc2 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:08.027865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6ba82-4045-4c3f-a8d8-682c4798059f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:08.028579 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6ba82-4045-4c3f-a8d8-682c4798059f service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:08.033519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6ba82-4045-4c3f-a8d8-682c4798059f service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:08.033519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6ba82-4045-4c3f-a8d8-682c4798059f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:08.039643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6ba82-4045-4c3f-a8d8-682c4798059f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:08.041337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6ba82-4045-4c3f-a8d8-682c4798059f service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:08.073678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1145/2294] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:08.183098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44bddd-a138-4e2c-8d58-b7b4045c9169 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:08.191541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:08.191541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:08.191541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:08.191541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] PATH_INFO: `/v3/projects/8bfe81ecdd534ad5aad3aad65365deda` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:08.194032 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bfe81ecdd534ad5aad3aad65365deda)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:08.196457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:08.404584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bfe81ecdd534ad5aad3aad65365deda', 'request_id': 'req-17f50ee2-b88a-4dac-98fc-136a3947724d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:08.412043 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bfe81ecdd534ad5aad3aad65365deda', 'request_id': 'req-17f50ee2-b88a-4dac-98fc-136a3947724d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:08.524251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bfe81ecdd534ad5aad3aad65365deda', 'request_id': 'req-17f50ee2-b88a-4dac-98fc-136a3947724d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:08.537486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] The token cache is being invalidate because project 8bfe81ecdd534ad5aad3aad65365deda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:53:08.537998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:08.538975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-17f50ee2-b88a-4dac-98fc-136a3947724d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:08.541684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1150/2295] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:53:08 2022] DELETE /identity/v3/projects/8bfe81ecdd534ad5aad3aad65365deda => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:08.547943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c630d59-965d-4b74-b449-1120ba59019c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:08.548546 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c630d59-965d-4b74-b449-1120ba59019c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:08.548663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c630d59-965d-4b74-b449-1120ba59019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:08.570434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-6c630d59-965d-4b74-b449-1120ba59019c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:08.571669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6c630d59-965d-4b74-b449-1120ba59019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:08.580952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:08.651688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1146/2296] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:08.659782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a9ff2-0c44-460b-8acc-8882047c3026 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:08.660061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a9ff2-0c44-460b-8acc-8882047c3026 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:08.660359 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a9ff2-0c44-460b-8acc-8882047c3026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:08.682962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e71a9ff2-0c44-460b-8acc-8882047c3026 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:08.691775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e71a9ff2-0c44-460b-8acc-8882047c3026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:08.698530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1151/2297] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:08.703069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c630d59-965d-4b74-b449-1120ba59019c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:08.712784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c630d59-965d-4b74-b449-1120ba59019c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:08.717930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a94c-e987-4f85-80be-339dfec56869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:08.718538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a94c-e987-4f85-80be-339dfec56869 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:08.718812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a94c-e987-4f85-80be-339dfec56869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:08.719084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707a94c-e987-4f85-80be-339dfec56869 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:08.719724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a94c-e987-4f85-80be-339dfec56869 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:53:08.720023 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a94c-e987-4f85-80be-339dfec56869 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:08.721707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707a94c-e987-4f85-80be-339dfec56869 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:08.739746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1147/2298] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:53:08.741042 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a9ff2-0c44-460b-8acc-8882047c3026 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:08.752197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a9ff2-0c44-460b-8acc-8882047c3026 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:08.757017 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787752e2-5a0d-43b8-a1a8-11be13b3a8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:08.757624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787752e2-5a0d-43b8-a1a8-11be13b3a8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:08.757899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787752e2-5a0d-43b8-a1a8-11be13b3a8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:08.758173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787752e2-5a0d-43b8-a1a8-11be13b3a8d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:08.758803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787752e2-5a0d-43b8-a1a8-11be13b3a8d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:08.760731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787752e2-5a0d-43b8-a1a8-11be13b3a8d0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:08.993447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1152/2299] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:53:08 2022] POST /identity/v3/projects => generated 371 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:53:08.993763 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a94c-e987-4f85-80be-339dfec56869 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:09.003247 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707a94c-e987-4f85-80be-339dfec56869 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:09.082465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394b9d0-b795-471d-b614-17467f7752e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:09.083076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394b9d0-b795-471d-b614-17467f7752e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:09.083331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394b9d0-b795-471d-b614-17467f7752e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:09.083605 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394b9d0-b795-471d-b614-17467f7752e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:09.084263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394b9d0-b795-471d-b614-17467f7752e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:09.089725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394b9d0-b795-471d-b614-17467f7752e4 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:09.194593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1148/2300] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:53:08 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:53:09.194848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787752e2-5a0d-43b8-a1a8-11be13b3a8d0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:09.208018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787752e2-5a0d-43b8-a1a8-11be13b3a8d0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:09.214364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97b284-7bc8-405d-b465-657912d70275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:09.215666 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97b284-7bc8-405d-b465-657912d70275 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:09.216148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97b284-7bc8-405d-b465-657912d70275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:09.216455 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97b284-7bc8-405d-b465-657912d70275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:09.217166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97b284-7bc8-405d-b465-657912d70275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:09.219005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97b284-7bc8-405d-b465-657912d70275 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:09.230718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1153/2301] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:53:09.241069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394b9d0-b795-471d-b614-17467f7752e4 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:09.254525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394b9d0-b795-471d-b614-17467f7752e4 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:09.262121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebbb80-108e-4348-8471-c1b6aed12af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:09.264876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebbb80-108e-4348-8471-c1b6aed12af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:09.264876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebbb80-108e-4348-8471-c1b6aed12af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:09.264876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebbb80-108e-4348-8471-c1b6aed12af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:09.264876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebbb80-108e-4348-8471-c1b6aed12af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:09.266931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebbb80-108e-4348-8471-c1b6aed12af0 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:09.286442 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1149/2302] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:53:09.290834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97b284-7bc8-405d-b465-657912d70275 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:09.312434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97b284-7bc8-405d-b465-657912d70275 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:09.337695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc775b-fd7b-4306-a357-8702fa471fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:09.338912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc775b-fd7b-4306-a357-8702fa471fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:09.339219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc775b-fd7b-4306-a357-8702fa471fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:09.339519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc775b-fd7b-4306-a357-8702fa471fcc admin admin] PATH_INFO: `/v3/projects/ce23d6224f5c4ecb975e741a64ffcc9b/users/326a4e92cdf94f3a97fb97aadd2176b5/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:09.376936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc775b-fd7b-4306-a357-8702fa471fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce23d6224f5c4ecb975e741a64ffcc9b, user_id=326a4e92cdf94f3a97fb97aadd2176b5, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:09.379640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc775b-fd7b-4306-a357-8702fa471fcc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:09.535675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1154/2303] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:53:09 2022] PUT /identity/v3/projects/ce23d6224f5c4ecb975e741a64ffcc9b/users/326a4e92cdf94f3a97fb97aadd2176b5/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:09.549735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c916c-404a-459f-a081-e39e04057e7d None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:09.550320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c916c-404a-459f-a081-e39e04057e7d None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:09.550320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c916c-404a-459f-a081-e39e04057e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:09.602193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-592c916c-404a-459f-a081-e39e04057e7d None None] MFA Rules not processed for user `326a4e92cdf94f3a97fb97aadd2176b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:09.603645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-592c916c-404a-459f-a081-e39e04057e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:09.674826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1150/2304] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:09.686266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc775b-fd7b-4306-a357-8702fa471fcc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:09.687987 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b4bc775b-fd7b-4306-a357-8702fa471fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:09.754541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc775b-fd7b-4306-a357-8702fa471fcc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:09.759056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f216d0-3453-4390-818d-78ef98e7c105 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07be3fbf45dc407ba3b6ad4d1e6ea042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:09.760197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f216d0-3453-4390-818d-78ef98e7c105 service glance] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:09.760851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f216d0-3453-4390-818d-78ef98e7c105 service glance] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:09.761028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f216d0-3453-4390-818d-78ef98e7c105 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:09.770137 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f216d0-3453-4390-818d-78ef98e7c105 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:09.771662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f216d0-3453-4390-818d-78ef98e7c105 service glance] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:09.781832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1155/2305] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:10.076849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:11.342171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321748-5be2-4083-9cdf-b63ee3166095 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:11.343109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321748-5be2-4083-9cdf-b63ee3166095 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:11.343384 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321748-5be2-4083-9cdf-b63ee3166095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:11.371979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-96321748-5be2-4083-9cdf-b63ee3166095 None None] MFA Rules not processed for user `3f87b42c88954740914f36c5ea16368f`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:11.374568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-96321748-5be2-4083-9cdf-b63ee3166095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:11.388909 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:11.457776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1151/2306] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:12.418436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f95b-4b9e-4a82-a7a5-63af159be68d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:12.418999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f95b-4b9e-4a82-a7a5-63af159be68d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:12.419179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8672f95b-4b9e-4a82-a7a5-63af159be68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:12.451459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-8672f95b-4b9e-4a82-a7a5-63af159be68d None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:12.451459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8672f95b-4b9e-4a82-a7a5-63af159be68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:12.533655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1156/2307] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:53:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:12.545867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96321748-5be2-4083-9cdf-b63ee3166095 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:12.547516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-96321748-5be2-4083-9cdf-b63ee3166095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:12.607920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:12.645526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:12.658911 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96321748-5be2-4083-9cdf-b63ee3166095 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:12.664858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5c572-1348-4bce-950b-ebcc2464b66f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:12.665644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5c572-1348-4bce-950b-ebcc2464b66f service swift] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:12.665987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5c572-1348-4bce-950b-ebcc2464b66f service swift] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:12.666820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5c572-1348-4bce-950b-ebcc2464b66f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:12.676513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5c572-1348-4bce-950b-ebcc2464b66f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:12.678189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5c572-1348-4bce-950b-ebcc2464b66f service swift] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:12.687861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1152/2308] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:53:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:53:13.725596 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672f95b-4b9e-4a82-a7a5-63af159be68d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:13.738403 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8672f95b-4b9e-4a82-a7a5-63af159be68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:13.880962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8672f95b-4b9e-4a82-a7a5-63af159be68d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:13.889316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:13.891160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:13.891160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:13.891424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] PATH_INFO: `/v3/users/0c5e1d7e8f7144a6a8f7d912021a58a2` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:13.894254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5e1d7e8f7144a6a8f7d912021a58a2)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:13.898724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:14.132724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5e1d7e8f7144a6a8f7d912021a58a2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:14.168495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5e1d7e8f7144a6a8f7d912021a58a2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:14.171437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5e1d7e8f7144a6a8f7d912021a58a2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:14.371254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5e1d7e8f7144a6a8f7d912021a58a2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:14.371254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5e1d7e8f7144a6a8f7d912021a58a2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:14.411314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1157/2309] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:53:13 2022] DELETE /identity/v3/users/0c5e1d7e8f7144a6a8f7d912021a58a2 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:14.424055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ecf61-da89-4051-a69d-58448989f221 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:14.424660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ecf61-da89-4051-a69d-58448989f221 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:14.424865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ecf61-da89-4051-a69d-58448989f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:14.450608 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-153ecf61-da89-4051-a69d-58448989f221 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:14.452592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-153ecf61-da89-4051-a69d-58448989f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:14.581830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1153/2310] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:53:14.597962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:14.599516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:14.903176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dde23e-4198-45b3-8513-f56bcad7f3d5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:14.903176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d26decf-e16a-4fa5-b69a-cbbfe56153a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:14.903176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26decf-e16a-4fa5-b69a-cbbfe56153a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:14.903176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26decf-e16a-4fa5-b69a-cbbfe56153a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:14.904867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d26decf-e16a-4fa5-b69a-cbbfe56153a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:14.911460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26decf-e16a-4fa5-b69a-cbbfe56153a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:14.924944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d26decf-e16a-4fa5-b69a-cbbfe56153a8 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:14.938662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1158/2311] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:15.510871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:15.592934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:15.941651 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ecf61-da89-4051-a69d-58448989f221 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:15.943232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-153ecf61-da89-4051-a69d-58448989f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:15.957762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ecf61-da89-4051-a69d-58448989f221 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:15.994673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:15.997520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:15.998339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:15.998775 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] PATH_INFO: `/v3/projects/046c2227ad1742ba99686988515b8ad4` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:16.010351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=046c2227ad1742ba99686988515b8ad4)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:16.012372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:16.167277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '046c2227ad1742ba99686988515b8ad4', 'request_id': 'req-003a18de-6be5-40ca-8624-3b60d454c5ed'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:16.177689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '046c2227ad1742ba99686988515b8ad4', 'request_id': 'req-003a18de-6be5-40ca-8624-3b60d454c5ed'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:16.349832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '046c2227ad1742ba99686988515b8ad4', 'request_id': 'req-003a18de-6be5-40ca-8624-3b60d454c5ed'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:16.380944 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] The token cache is being invalidate because project 046c2227ad1742ba99686988515b8ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:53:16.381765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:16.383254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-003a18de-6be5-40ca-8624-3b60d454c5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:16.388332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1154/2312] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:53:15 2022] DELETE /identity/v3/projects/046c2227ad1742ba99686988515b8ad4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:16.394416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78e124-5a4d-422e-b0db-a365109beb3b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:16.396048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78e124-5a4d-422e-b0db-a365109beb3b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:16.397264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78e124-5a4d-422e-b0db-a365109beb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:16.428936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4b78e124-5a4d-422e-b0db-a365109beb3b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:16.430832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4b78e124-5a4d-422e-b0db-a365109beb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:16.584966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1159/2313] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:16.593292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cae93-8620-449e-a512-0c9a414c1c76 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:16.594186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cae93-8620-449e-a512-0c9a414c1c76 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:16.594186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cae93-8620-449e-a512-0c9a414c1c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:16.628007 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-f32cae93-8620-449e-a512-0c9a414c1c76 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:16.630426 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f32cae93-8620-449e-a512-0c9a414c1c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:16.642846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1155/2314] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:16.646957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78e124-5a4d-422e-b0db-a365109beb3b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:16.658162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78e124-5a4d-422e-b0db-a365109beb3b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:16.663451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2b4a6-70fa-4206-a7f8-ae021b881fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:16.664124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2b4a6-70fa-4206-a7f8-ae021b881fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:16.664408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2b4a6-70fa-4206-a7f8-ae021b881fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:16.671466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2b4a6-70fa-4206-a7f8-ae021b881fd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:16.671466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2b4a6-70fa-4206-a7f8-ae021b881fd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:53:16.671466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2b4a6-70fa-4206-a7f8-ae021b881fd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:16.671466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2b4a6-70fa-4206-a7f8-ae021b881fd2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:16.685152 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1160/2315] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:53:16.691673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cae93-8620-449e-a512-0c9a414c1c76 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:16.711691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cae93-8620-449e-a512-0c9a414c1c76 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:16.717332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c234334-c82a-4681-a2ae-db3101ab33d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:16.718849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234334-c82a-4681-a2ae-db3101ab33d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:16.718849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234334-c82a-4681-a2ae-db3101ab33d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:16.718849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c234334-c82a-4681-a2ae-db3101ab33d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:16.719149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c234334-c82a-4681-a2ae-db3101ab33d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:16.721725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c234334-c82a-4681-a2ae-db3101ab33d4 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:16.852276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1156/2316] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:53:16 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:53:16.858355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2b4a6-70fa-4206-a7f8-ae021b881fd2 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:16.874962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2b4a6-70fa-4206-a7f8-ae021b881fd2 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:16.971213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1d188-7457-4ee1-bcd6-56ce2a137409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:16.971868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1d188-7457-4ee1-bcd6-56ce2a137409 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:16.972133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1d188-7457-4ee1-bcd6-56ce2a137409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:16.972408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1d188-7457-4ee1-bcd6-56ce2a137409 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:16.973135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1d188-7457-4ee1-bcd6-56ce2a137409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:16.975123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1d188-7457-4ee1-bcd6-56ce2a137409 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:17.099963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1161/2317] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:53:16 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:53:17.106219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c234334-c82a-4681-a2ae-db3101ab33d4 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:17.118141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c234334-c82a-4681-a2ae-db3101ab33d4 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:17.123553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f1380-3ed7-42d5-8caa-1f238bd35b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:17.124370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f1380-3ed7-42d5-8caa-1f238bd35b44 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:17.124692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f1380-3ed7-42d5-8caa-1f238bd35b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:17.124971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f1380-3ed7-42d5-8caa-1f238bd35b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:17.125629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f1380-3ed7-42d5-8caa-1f238bd35b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:17.127419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f1380-3ed7-42d5-8caa-1f238bd35b44 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:17.146183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1157/2318] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:53:17.159907 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1d188-7457-4ee1-bcd6-56ce2a137409 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:17.174757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1d188-7457-4ee1-bcd6-56ce2a137409 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:17.180814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c822be-f715-4f1d-a22d-4186171e737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:17.181492 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c822be-f715-4f1d-a22d-4186171e737f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:17.181805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c822be-f715-4f1d-a22d-4186171e737f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:17.182051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c822be-f715-4f1d-a22d-4186171e737f admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:17.182713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c822be-f715-4f1d-a22d-4186171e737f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:17.184352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c822be-f715-4f1d-a22d-4186171e737f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:17.204758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1162/2319] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:53:17.220704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f1380-3ed7-42d5-8caa-1f238bd35b44 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:17.242234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f1380-3ed7-42d5-8caa-1f238bd35b44 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:17.250090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b2e67-46f2-4396-9b8e-dd25d6910b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:17.251219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b2e67-46f2-4396-9b8e-dd25d6910b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:17.252127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b2e67-46f2-4396-9b8e-dd25d6910b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:17.252843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b2e67-46f2-4396-9b8e-dd25d6910b3d admin admin] PATH_INFO: `/v3/projects/2e2eb26b682d4af588ab368531c3462f/users/03a381c5595b4deb9ad78bf542b8aeee/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:17.278208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:17.285452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b2e67-46f2-4396-9b8e-dd25d6910b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2eb26b682d4af588ab368531c3462f, user_id=03a381c5595b4deb9ad78bf542b8aeee, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:17.294409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b2e67-46f2-4396-9b8e-dd25d6910b3d admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:17.445003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1158/2320] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:53:17 2022] PUT /identity/v3/projects/2e2eb26b682d4af588ab368531c3462f/users/03a381c5595b4deb9ad78bf542b8aeee/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:17.460307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c8a6-a735-42c6-a59f-d044f1ef5182 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:17.461022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c8a6-a735-42c6-a59f-d044f1ef5182 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:17.461022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c8a6-a735-42c6-a59f-d044f1ef5182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:17.532833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9331c8a6-a735-42c6-a59f-d044f1ef5182 None None] MFA Rules not processed for user `03a381c5595b4deb9ad78bf542b8aeee`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:17.535894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9331c8a6-a735-42c6-a59f-d044f1ef5182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:17.657659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1163/2321] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:17.673356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b2e67-46f2-4396-9b8e-dd25d6910b3d admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:17.812994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b2e67-46f2-4396-9b8e-dd25d6910b3d admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:17.825665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4b00b-fe85-4dae-8762-1424b3c57122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:17.826307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b00b-fe85-4dae-8762-1424b3c57122 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:17.826756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b00b-fe85-4dae-8762-1424b3c57122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:17.827036 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c4b00b-fe85-4dae-8762-1424b3c57122 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:17.827692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4b00b-fe85-4dae-8762-1424b3c57122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:17.829692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c4b00b-fe85-4dae-8762-1424b3c57122 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:17.862066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:17.948988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1159/2322] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:53:17 2022] POST /identity/v3/projects => generated 375 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:53:17.953657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c8a6-a735-42c6-a59f-d044f1ef5182 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:17.965876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c8a6-a735-42c6-a59f-d044f1ef5182 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:18.061253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de6dd0-a027-47e3-8d17-2cad7b039046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:18.061932 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6dd0-a027-47e3-8d17-2cad7b039046 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:18.062219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6dd0-a027-47e3-8d17-2cad7b039046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:18.062497 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6dd0-a027-47e3-8d17-2cad7b039046 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:18.063163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de6dd0-a027-47e3-8d17-2cad7b039046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:18.066748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de6dd0-a027-47e3-8d17-2cad7b039046 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:18.175372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1164/2323] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:53:17 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:53:18.179919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4b00b-fe85-4dae-8762-1424b3c57122 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:18.199458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c4b00b-fe85-4dae-8762-1424b3c57122 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:18.213815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e94e9-d4aa-406c-a778-12900666bdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:18.214788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e94e9-d4aa-406c-a778-12900666bdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:18.215120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e94e9-d4aa-406c-a778-12900666bdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:18.215526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e94e9-d4aa-406c-a778-12900666bdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:18.216403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e94e9-d4aa-406c-a778-12900666bdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:18.218414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e94e9-d4aa-406c-a778-12900666bdb2 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:18.231551 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1160/2324] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:53:18.235805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de6dd0-a027-47e3-8d17-2cad7b039046 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:18.247946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de6dd0-a027-47e3-8d17-2cad7b039046 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:18.253136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239bcd4-a304-447f-9537-ed5c7da7ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:18.256780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239bcd4-a304-447f-9537-ed5c7da7ab9c admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:18.256780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239bcd4-a304-447f-9537-ed5c7da7ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:18.256780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239bcd4-a304-447f-9537-ed5c7da7ab9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:18.256780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239bcd4-a304-447f-9537-ed5c7da7ab9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:18.256780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239bcd4-a304-447f-9537-ed5c7da7ab9c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:18.267832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1165/2325] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:53:18.272447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e94e9-d4aa-406c-a778-12900666bdb2 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:18.286563 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e94e9-d4aa-406c-a778-12900666bdb2 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:18.291827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d4cfe-7b82-45a5-a661-6085598a893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:18.292526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4cfe-7b82-45a5-a661-6085598a893a admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:18.292827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4cfe-7b82-45a5-a661-6085598a893a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:18.293099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d4cfe-7b82-45a5-a661-6085598a893a admin admin] PATH_INFO: `/v3/projects/1993d03d6bd74ed9bdc8ed12697242b4/users/72cfcdc33be2439cac27dca4544f1ce8/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:18.316874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d4cfe-7b82-45a5-a661-6085598a893a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1993d03d6bd74ed9bdc8ed12697242b4, user_id=72cfcdc33be2439cac27dca4544f1ce8, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:18.320042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d4cfe-7b82-45a5-a661-6085598a893a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:18.432805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1161/2326] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:53:18 2022] PUT /identity/v3/projects/1993d03d6bd74ed9bdc8ed12697242b4/users/72cfcdc33be2439cac27dca4544f1ce8/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:18.444929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f113-506c-4f1d-a705-19ed8009fae9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:18.445626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f113-506c-4f1d-a705-19ed8009fae9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:18.446191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f113-506c-4f1d-a705-19ed8009fae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:18.491397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bf89f113-506c-4f1d-a705-19ed8009fae9 None None] MFA Rules not processed for user `72cfcdc33be2439cac27dca4544f1ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:18.494703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bf89f113-506c-4f1d-a705-19ed8009fae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:18.570555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1166/2327] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:53:18.576350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d4cfe-7b82-45a5-a661-6085598a893a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:18.686616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d4cfe-7b82-45a5-a661-6085598a893a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:18.692877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ff8c4-925e-4207-86c0-588d5162519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:18.692877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ff8c4-925e-4207-86c0-588d5162519e admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:18.692877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ff8c4-925e-4207-86c0-588d5162519e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:18.692877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ff8c4-925e-4207-86c0-588d5162519e admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:18.693694 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ff8c4-925e-4207-86c0-588d5162519e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:18.695507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ff8c4-925e-4207-86c0-588d5162519e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:18.825184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1162/2328] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:53:18 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:53:18.826381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89f113-506c-4f1d-a705-19ed8009fae9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:18.839507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89f113-506c-4f1d-a705-19ed8009fae9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:18.930554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992924b-6358-4b60-a568-3773468fe7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:18.931477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992924b-6358-4b60-a568-3773468fe7ae admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:18.931954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992924b-6358-4b60-a568-3773468fe7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:18.932398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992924b-6358-4b60-a568-3773468fe7ae admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:18.933366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992924b-6358-4b60-a568-3773468fe7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:18.935575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1992924b-6358-4b60-a568-3773468fe7ae admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:19.068839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1167/2329] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:53:18 2022] POST /identity/v3/users => generated 295 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:53:19.070503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ff8c4-925e-4207-86c0-588d5162519e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:19.082548 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ff8c4-925e-4207-86c0-588d5162519e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:19.089411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989d90-f767-4087-8eff-0aa543c50d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:19.092611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989d90-f767-4087-8eff-0aa543c50d3c admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:19.093471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989d90-f767-4087-8eff-0aa543c50d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:19.094145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989d90-f767-4087-8eff-0aa543c50d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:19.101415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55989d90-f767-4087-8eff-0aa543c50d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:19.106902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:19.106902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55989d90-f767-4087-8eff-0aa543c50d3c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:19.142877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1163/2330] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:53:19.146839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992924b-6358-4b60-a568-3773468fe7ae admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:19.158364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992924b-6358-4b60-a568-3773468fe7ae admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:19.163526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ae35e-3792-4942-b45f-768053ab0012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:19.164212 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ae35e-3792-4942-b45f-768053ab0012 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:19.164532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ae35e-3792-4942-b45f-768053ab0012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:19.164925 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ae35e-3792-4942-b45f-768053ab0012 admin admin] PATH_INFO: `/v3/projects/8547f39777f84d9e90199e364c184a41/users/9e2b2a60e0b54855a97b1666cb0bd74b/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:19.189508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:19.194529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ae35e-3792-4942-b45f-768053ab0012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8547f39777f84d9e90199e364c184a41, user_id=9e2b2a60e0b54855a97b1666cb0bd74b, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:19.197935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ae35e-3792-4942-b45f-768053ab0012 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:19.344894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1168/2331] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:53:19 2022] PUT /identity/v3/projects/8547f39777f84d9e90199e364c184a41/users/9e2b2a60e0b54855a97b1666cb0bd74b/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:19.349587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989d90-f767-4087-8eff-0aa543c50d3c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:19.361641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989d90-f767-4087-8eff-0aa543c50d3c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:19.452327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0d61d-aa48-46ac-83fc-1f7c33d9ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:19.452942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0d61d-aa48-46ac-83fc-1f7c33d9ab85 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:19.453375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0d61d-aa48-46ac-83fc-1f7c33d9ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:19.453659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0d61d-aa48-46ac-83fc-1f7c33d9ab85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:19.457949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0d61d-aa48-46ac-83fc-1f7c33d9ab85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:19.457949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0d61d-aa48-46ac-83fc-1f7c33d9ab85 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:19.467363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1164/2332] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:19 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:53:19.471898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ae35e-3792-4942-b45f-768053ab0012 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:19.482927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ae35e-3792-4942-b45f-768053ab0012 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:19.487670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa64cea-3735-4906-b505-93c31f53c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:19.488686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa64cea-3735-4906-b505-93c31f53c174 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:19.488969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa64cea-3735-4906-b505-93c31f53c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:19.489298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa64cea-3735-4906-b505-93c31f53c174 admin admin] PATH_INFO: `/v3/projects/8547f39777f84d9e90199e364c184a41/users/9e2b2a60e0b54855a97b1666cb0bd74b/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:19.491278 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa64cea-3735-4906-b505-93c31f53c174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8547f39777f84d9e90199e364c184a41, user_id=9e2b2a60e0b54855a97b1666cb0bd74b, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:19.494570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa64cea-3735-4906-b505-93c31f53c174 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:19.514436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1169/2333] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:53:19 2022] PUT /identity/v3/projects/8547f39777f84d9e90199e364c184a41/users/9e2b2a60e0b54855a97b1666cb0bd74b/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:19.526948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c09c-f7ca-444d-b73c-ead38356247e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:19.527228 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c09c-f7ca-444d-b73c-ead38356247e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:19.527526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c09c-f7ca-444d-b73c-ead38356247e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:19.572942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-d547c09c-f7ca-444d-b73c-ead38356247e None None] MFA Rules not processed for user `9e2b2a60e0b54855a97b1666cb0bd74b`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:19.574556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d547c09c-f7ca-444d-b73c-ead38356247e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:19.693091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1165/2334] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:19.705520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa64cea-3735-4906-b505-93c31f53c174 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:19.707556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-afa64cea-3735-4906-b505-93c31f53c174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:19.802125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa64cea-3735-4906-b505-93c31f53c174 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:19.806412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625d9fb-4009-43f3-aaab-2191c818f836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:19.807412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625d9fb-4009-43f3-aaab-2191c818f836 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:19.807805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625d9fb-4009-43f3-aaab-2191c818f836 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:19.808088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e625d9fb-4009-43f3-aaab-2191c818f836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:19.876834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625d9fb-4009-43f3-aaab-2191c818f836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:19.878172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e625d9fb-4009-43f3-aaab-2191c818f836 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:19.890230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1170/2335] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:22.165375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:22.263634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:23.506372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c09c-f7ca-444d-b73c-ead38356247e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:23.517328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c09c-f7ca-444d-b73c-ead38356247e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:23.520934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7412-4f8d-4298-9369-be95b4469a65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:23.521569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7412-4f8d-4298-9369-be95b4469a65 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:23.521865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7412-4f8d-4298-9369-be95b4469a65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:23.522140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7412-4f8d-4298-9369-be95b4469a65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:23.617794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7412-4f8d-4298-9369-be95b4469a65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:23.619784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7412-4f8d-4298-9369-be95b4469a65 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:23.630321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1166/2336] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:25.843251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625d9fb-4009-43f3-aaab-2191c818f836 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:25.853318 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e625d9fb-4009-43f3-aaab-2191c818f836 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:25.857365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23aa35-2fa1-462d-9749-926de743e46f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:25.858013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23aa35-2fa1-462d-9749-926de743e46f service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:25.858294 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23aa35-2fa1-462d-9749-926de743e46f service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:25.858732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23aa35-2fa1-462d-9749-926de743e46f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:25.869757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23aa35-2fa1-462d-9749-926de743e46f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:25.871353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23aa35-2fa1-462d-9749-926de743e46f service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:25.881700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1171/2337] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:26.332315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:26.649760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:30.721527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:30.963759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:31.751769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7412-4f8d-4298-9369-be95b4469a65 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:31.919943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7412-4f8d-4298-9369-be95b4469a65 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:31.932387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:31.932387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:31.932387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:31.932387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] PATH_INFO: `/v3/users/03a381c5595b4deb9ad78bf542b8aeee` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:31.935779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a381c5595b4deb9ad78bf542b8aeee)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:31.938248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:32.284768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a381c5595b4deb9ad78bf542b8aeee'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:32.304534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a381c5595b4deb9ad78bf542b8aeee'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:32.307554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a381c5595b4deb9ad78bf542b8aeee'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:32.514489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a381c5595b4deb9ad78bf542b8aeee'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:32.539141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a381c5595b4deb9ad78bf542b8aeee'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:32.549137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1167/2338] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:53:31 2022] DELETE /identity/v3/users/03a381c5595b4deb9ad78bf542b8aeee => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:53:32.553656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f823c1-9fb3-448b-be46-3fa38cdf2acf None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:32.554487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f823c1-9fb3-448b-be46-3fa38cdf2acf None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:32.554487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f823c1-9fb3-448b-be46-3fa38cdf2acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:32.577708 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e8f823c1-9fb3-448b-be46-3fa38cdf2acf None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:32.579137 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e8f823c1-9fb3-448b-be46-3fa38cdf2acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:32.662449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1172/2339] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:32.676894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:32.681740 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:32.836392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576df17a-c66a-4fe7-9d05-e4ed2dc6c828 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:32.845425 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615447bb-dbd7-4247-bcdb-1c7d97b03aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:32.846264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615447bb-dbd7-4247-bcdb-1c7d97b03aef service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:32.846697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615447bb-dbd7-4247-bcdb-1c7d97b03aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:32.847125 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615447bb-dbd7-4247-bcdb-1c7d97b03aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:32.859153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615447bb-dbd7-4247-bcdb-1c7d97b03aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:32.860553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615447bb-dbd7-4247-bcdb-1c7d97b03aef service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:32.882128 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1168/2340] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:33.603887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f823c1-9fb3-448b-be46-3fa38cdf2acf None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:33.603887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e8f823c1-9fb3-448b-be46-3fa38cdf2acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:33.617253 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f823c1-9fb3-448b-be46-3fa38cdf2acf None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:33.626912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:33.628630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:33.629327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:33.629847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] PATH_INFO: `/v3/projects/2e2eb26b682d4af588ab368531c3462f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:33.632135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2eb26b682d4af588ab368531c3462f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:33.636132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:33.743172 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291555b-6d9f-4f9f-a00b-e1e94bfb1036 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:33.744453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291555b-6d9f-4f9f-a00b-e1e94bfb1036 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:33.745090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8291555b-6d9f-4f9f-a00b-e1e94bfb1036 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:33.748466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1169/2341] 10.222.0.83 () {54 vars in 961 bytes} [Mon Aug 29 21:53:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:53:33.760456 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a020ad-c71d-4214-8b4b-a88942f312ce None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:33.761601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a020ad-c71d-4214-8b4b-a88942f312ce None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:33.762417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a020ad-c71d-4214-8b4b-a88942f312ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:33.812437 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-91a020ad-c71d-4214-8b4b-a88942f312ce None None] MFA Rules not processed for user `dca09f6fe11f4b878dd11c4cb69ca7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:33.819150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:33.820356 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-91a020ad-c71d-4214-8b4b-a88942f312ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:33.879187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2eb26b682d4af588ab368531c3462f', 'request_id': 'req-e473892d-5228-4993-a128-5e9f52bce389'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:33.887760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2eb26b682d4af588ab368531c3462f', 'request_id': 'req-e473892d-5228-4993-a128-5e9f52bce389'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:33.942782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1170/2342] 10.222.0.83 () {58 vars in 1058 bytes} [Mon Aug 29 21:53:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:33.944137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb58b-1bd3-4d2c-8aac-29735689554e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:33.944572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb58b-1bd3-4d2c-8aac-29735689554e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:33.944921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87deb58b-1bd3-4d2c-8aac-29735689554e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:33.965952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-87deb58b-1bd3-4d2c-8aac-29735689554e None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:33.967340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-87deb58b-1bd3-4d2c-8aac-29735689554e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:34.026137 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2eb26b682d4af588ab368531c3462f', 'request_id': 'req-e473892d-5228-4993-a128-5e9f52bce389'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:34.029442 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1171/2343] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 21:53:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:34.030291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb58b-1bd3-4d2c-8aac-29735689554e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:34.070656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] The token cache is being invalidate because project 2e2eb26b682d4af588ab368531c3462f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:53:34.070656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:34.072210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:34.074656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1173/2344] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:53:33 2022] DELETE /identity/v3/projects/2e2eb26b682d4af588ab368531c3462f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:34.075579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:34.078620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:34.175697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473892d-5228-4993-a128-5e9f52bce389 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:34.185290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b7f3a-262a-4d6e-85d9-f45b9d9d07ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:34.186320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b7f3a-262a-4d6e-85d9-f45b9d9d07ca service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:34.186792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b7f3a-262a-4d6e-85d9-f45b9d9d07ca service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:34.187258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2b7f3a-262a-4d6e-85d9-f45b9d9d07ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:34.192458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4f2b7f3a-262a-4d6e-85d9-f45b9d9d07ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:34.201056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87deb58b-1bd3-4d2c-8aac-29735689554e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:34.206742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817792d-7104-4d19-937f-cd5664cee7cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca09f6fe11f4b878dd11c4cb69ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:34.207369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817792d-7104-4d19-937f-cd5664cee7cd service placement] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:34.207798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817792d-7104-4d19-937f-cd5664cee7cd service placement] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:34.208083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817792d-7104-4d19-937f-cd5664cee7cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:34.210039 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b817792d-7104-4d19-937f-cd5664cee7cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:34.212056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b7f3a-262a-4d6e-85d9-f45b9d9d07ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:34.215556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2b7f3a-262a-4d6e-85d9-f45b9d9d07ca service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:34.232003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1174/2345] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:53:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:53:34.235155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b7f3a-262a-4d6e-85d9-f45b9d9d07ca service swift] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:34.237418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4f2b7f3a-262a-4d6e-85d9-f45b9d9d07ca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:34.294045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817792d-7104-4d19-937f-cd5664cee7cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:34.297929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817792d-7104-4d19-937f-cd5664cee7cd service placement] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:34.318488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1172/2346] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:34.367683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2b7f3a-262a-4d6e-85d9-f45b9d9d07ca service swift] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:34.373197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:34.373899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:34.374181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:34.374465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] PATH_INFO: `/v3/users/72cfcdc33be2439cac27dca4544f1ce8` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:34.375751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72cfcdc33be2439cac27dca4544f1ce8)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:34.377832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:34.761291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72cfcdc33be2439cac27dca4544f1ce8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:34.772187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72cfcdc33be2439cac27dca4544f1ce8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:34.773303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72cfcdc33be2439cac27dca4544f1ce8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:34.924036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72cfcdc33be2439cac27dca4544f1ce8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:34.925281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72cfcdc33be2439cac27dca4544f1ce8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:34.956063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1175/2347] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:53:34 2022] DELETE /identity/v3/users/72cfcdc33be2439cac27dca4544f1ce8 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:35.426679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:35.772871 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817792d-7104-4d19-937f-cd5664cee7cd service placement] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:35.789669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817792d-7104-4d19-937f-cd5664cee7cd service placement] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:35.875801 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:35.876623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:35.879059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:35.879059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] PATH_INFO: `/v3/projects/1993d03d6bd74ed9bdc8ed12697242b4` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:35.879059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1993d03d6bd74ed9bdc8ed12697242b4)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:35.880460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:36.100659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1993d03d6bd74ed9bdc8ed12697242b4', 'request_id': 'req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:36.108274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1993d03d6bd74ed9bdc8ed12697242b4', 'request_id': 'req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:36.304159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1993d03d6bd74ed9bdc8ed12697242b4', 'request_id': 'req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:36.321591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] The token cache is being invalidate because project 1993d03d6bd74ed9bdc8ed12697242b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:53:36.322075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:36.322996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:36.324914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1173/2348] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:53:35 2022] DELETE /identity/v3/projects/1993d03d6bd74ed9bdc8ed12697242b4 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:36.329694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:36.332390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:36.350605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee0bef-86c3-43bb-80e6-ac6df7d932c2 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:36.415021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:36.416918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:36.416918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:36.416918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] PATH_INFO: `/v3/users/9e2b2a60e0b54855a97b1666cb0bd74b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:36.418956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e2b2a60e0b54855a97b1666cb0bd74b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:36.421648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:36.808262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2b2a60e0b54855a97b1666cb0bd74b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:36.816889 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2b2a60e0b54855a97b1666cb0bd74b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:36.817634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2b2a60e0b54855a97b1666cb0bd74b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:36.940929 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2b2a60e0b54855a97b1666cb0bd74b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:36.942039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-302b05dc-fed1-46bb-a3aa-76a9219e45f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2b2a60e0b54855a97b1666cb0bd74b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:36.965509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1176/2349] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:53:36 2022] DELETE /identity/v3/users/9e2b2a60e0b54855a97b1666cb0bd74b => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:37.666108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:37.668162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:37.690967 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0c750-2bd0-4284-98d8-68d3ab96bfb5 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:37.778209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:37.778854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:37.779365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:37.779854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] PATH_INFO: `/v3/projects/8547f39777f84d9e90199e364c184a41` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:37.781148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8547f39777f84d9e90199e364c184a41)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:37.783220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:37.939083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8547f39777f84d9e90199e364c184a41', 'request_id': 'req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:37.945578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8547f39777f84d9e90199e364c184a41', 'request_id': 'req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:38.135316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8547f39777f84d9e90199e364c184a41', 'request_id': 'req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:38.147031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] The token cache is being invalidate because project 8547f39777f84d9e90199e364c184a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:53:38.147325 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:38.148024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-36c3e8cd-5b62-4d10-b49b-1dc4e80d7322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:38.150409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1174/2350] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:53:37 2022] DELETE /identity/v3/projects/8547f39777f84d9e90199e364c184a41 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:38.155980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e581c4-5fb8-47ea-b650-7efdffc1238f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:38.156660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e581c4-5fb8-47ea-b650-7efdffc1238f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:38.156770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e581c4-5fb8-47ea-b650-7efdffc1238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:38.178122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e5e581c4-5fb8-47ea-b650-7efdffc1238f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:38.179356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e5e581c4-5fb8-47ea-b650-7efdffc1238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:38.246324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1177/2351] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:53:38.253869 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02ca87-2b3b-4688-b2f9-1f3077f58c54 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:38.254150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02ca87-2b3b-4688-b2f9-1f3077f58c54 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:38.254480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02ca87-2b3b-4688-b2f9-1f3077f58c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:38.279494 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-8e02ca87-2b3b-4688-b2f9-1f3077f58c54 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:38.280808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8e02ca87-2b3b-4688-b2f9-1f3077f58c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:38.289641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1175/2352] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:38.298097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e581c4-5fb8-47ea-b650-7efdffc1238f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:38.308928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e581c4-5fb8-47ea-b650-7efdffc1238f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:38.315279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9627f-cd17-43c1-98d1-34e951df4057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:38.316324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9627f-cd17-43c1-98d1-34e951df4057 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:38.316733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9627f-cd17-43c1-98d1-34e951df4057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:38.317075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9627f-cd17-43c1-98d1-34e951df4057 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:38.317888 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9627f-cd17-43c1-98d1-34e951df4057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:53:38.318260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9627f-cd17-43c1-98d1-34e951df4057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:38.320169 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de9627f-cd17-43c1-98d1-34e951df4057 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:38.340202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1178/2353] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:53:38.345280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02ca87-2b3b-4688-b2f9-1f3077f58c54 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:38.359119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02ca87-2b3b-4688-b2f9-1f3077f58c54 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:38.364602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df70c38-6d42-4620-9901-982c201dc774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:38.365404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df70c38-6d42-4620-9901-982c201dc774 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:38.365404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df70c38-6d42-4620-9901-982c201dc774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:38.365635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df70c38-6d42-4620-9901-982c201dc774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:38.366162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df70c38-6d42-4620-9901-982c201dc774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:38.368150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df70c38-6d42-4620-9901-982c201dc774 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:38.503828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1176/2354] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:53:38 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:53:38.508143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9627f-cd17-43c1-98d1-34e951df4057 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:38.518639 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9627f-cd17-43c1-98d1-34e951df4057 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:38.574352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc639058-8af9-411d-b831-cbcfe10165da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:38.575020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc639058-8af9-411d-b831-cbcfe10165da admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:38.575231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc639058-8af9-411d-b831-cbcfe10165da admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:38.575497 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc639058-8af9-411d-b831-cbcfe10165da admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:38.576160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc639058-8af9-411d-b831-cbcfe10165da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:38.578123 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc639058-8af9-411d-b831-cbcfe10165da admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:39.005172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1179/2355] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:53:38 2022] POST /identity/v3/users => generated 287 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:53:39.009898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df70c38-6d42-4620-9901-982c201dc774 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:39.021280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df70c38-6d42-4620-9901-982c201dc774 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:39.029086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747c425-fa7e-4926-b3fb-e6c86f75bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:39.029713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747c425-fa7e-4926-b3fb-e6c86f75bf6c admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:39.030570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747c425-fa7e-4926-b3fb-e6c86f75bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:39.030570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747c425-fa7e-4926-b3fb-e6c86f75bf6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:39.031091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747c425-fa7e-4926-b3fb-e6c86f75bf6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:39.033553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747c425-fa7e-4926-b3fb-e6c86f75bf6c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:39.036392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:39.049220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1177/2356] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:53:39.050941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc639058-8af9-411d-b831-cbcfe10165da admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:39.064663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc639058-8af9-411d-b831-cbcfe10165da admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:39.066559 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3170f-3a93-4f5d-9f44-60d3fab32806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:39.067261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3170f-3a93-4f5d-9f44-60d3fab32806 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:39.067539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3170f-3a93-4f5d-9f44-60d3fab32806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:39.067812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3170f-3a93-4f5d-9f44-60d3fab32806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:39.068527 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3170f-3a93-4f5d-9f44-60d3fab32806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:39.070366 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3170f-3a93-4f5d-9f44-60d3fab32806 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:39.082238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1180/2357] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:53:39.091019 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747c425-fa7e-4926-b3fb-e6c86f75bf6c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:39.101204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747c425-fa7e-4926-b3fb-e6c86f75bf6c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:39.105906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb116e6a-26cf-4020-8c7c-b198350e9d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:39.106633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb116e6a-26cf-4020-8c7c-b198350e9d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:39.106910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb116e6a-26cf-4020-8c7c-b198350e9d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:39.107183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb116e6a-26cf-4020-8c7c-b198350e9d6a admin admin] PATH_INFO: `/v3/projects/914dca3de66e476bb9a73c0e7fe97188/users/aae8fa0892fe4f37b6ba6b3cf70506a8/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:39.129082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb116e6a-26cf-4020-8c7c-b198350e9d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=914dca3de66e476bb9a73c0e7fe97188, user_id=aae8fa0892fe4f37b6ba6b3cf70506a8, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:39.131875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb116e6a-26cf-4020-8c7c-b198350e9d6a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:39.249432 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1178/2358] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:53:39 2022] PUT /identity/v3/projects/914dca3de66e476bb9a73c0e7fe97188/users/aae8fa0892fe4f37b6ba6b3cf70506a8/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:39.254943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae1f39-4c4d-4928-9344-e859deb26d54 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:39.255425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae1f39-4c4d-4928-9344-e859deb26d54 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:39.255717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae1f39-4c4d-4928-9344-e859deb26d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:39.279834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b8ae1f39-4c4d-4928-9344-e859deb26d54 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:39.281216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b8ae1f39-4c4d-4928-9344-e859deb26d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:39.349546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1181/2359] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:39.359347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb116e6a-26cf-4020-8c7c-b198350e9d6a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:39.361139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-eb116e6a-26cf-4020-8c7c-b198350e9d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:39.431595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb116e6a-26cf-4020-8c7c-b198350e9d6a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:39.435362 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8ed16-e66d-422b-8f0a-6f51fc9dd720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:39.435968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8ed16-e66d-422b-8f0a-6f51fc9dd720 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:39.436244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8ed16-e66d-422b-8f0a-6f51fc9dd720 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:39.436549 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8ed16-e66d-422b-8f0a-6f51fc9dd720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:39.445870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8ed16-e66d-422b-8f0a-6f51fc9dd720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:39.447933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8ed16-e66d-422b-8f0a-6f51fc9dd720 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:39.457695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1179/2360] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:40.715377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:41.231986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002cc1-10f6-482b-a11e-b449d1dc0c79 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:41.231986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002cc1-10f6-482b-a11e-b449d1dc0c79 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:41.231986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e002cc1-10f6-482b-a11e-b449d1dc0c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:41.262581 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2e002cc1-10f6-482b-a11e-b449d1dc0c79 None None] MFA Rules not processed for user `aae8fa0892fe4f37b6ba6b3cf70506a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:41.264079 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2e002cc1-10f6-482b-a11e-b449d1dc0c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:41.363711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1182/2361] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:41.382077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8ed16-e66d-422b-8f0a-6f51fc9dd720 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:41.384587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a9e8ed16-e66d-422b-8f0a-6f51fc9dd720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:41.479487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8ed16-e66d-422b-8f0a-6f51fc9dd720 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:41.483640 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5dfaf-5d9b-42c9-8cc9-dea64be5fe5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:41.484195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5dfaf-5d9b-42c9-8cc9-dea64be5fe5a service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:41.484498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5dfaf-5d9b-42c9-8cc9-dea64be5fe5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:41.484783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5dfaf-5d9b-42c9-8cc9-dea64be5fe5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:41.510800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5dfaf-5d9b-42c9-8cc9-dea64be5fe5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:41.512282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5dfaf-5d9b-42c9-8cc9-dea64be5fe5a service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:41.546155 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1180/2362] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:42.172749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:44.020333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e002cc1-10f6-482b-a11e-b449d1dc0c79 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:44.021986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2e002cc1-10f6-482b-a11e-b449d1dc0c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:44.049681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e002cc1-10f6-482b-a11e-b449d1dc0c79 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:44.057052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:44.057656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:44.057940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:44.058213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] PATH_INFO: `/v3/users/326a4e92cdf94f3a97fb97aadd2176b5` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:44.060264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=326a4e92cdf94f3a97fb97aadd2176b5)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:44.062395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:44.471486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '326a4e92cdf94f3a97fb97aadd2176b5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:44.480030 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '326a4e92cdf94f3a97fb97aadd2176b5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:44.480774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '326a4e92cdf94f3a97fb97aadd2176b5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:44.624102 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '326a4e92cdf94f3a97fb97aadd2176b5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:44.625327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '326a4e92cdf94f3a97fb97aadd2176b5'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:44.648985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1183/2363] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:53:44 2022] DELETE /identity/v3/users/326a4e92cdf94f3a97fb97aadd2176b5 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:44.654265 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f188c4-998f-461d-9a7b-4c5bdf7cc804 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:44.654807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f188c4-998f-461d-9a7b-4c5bdf7cc804 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:44.654945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f188c4-998f-461d-9a7b-4c5bdf7cc804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:44.677741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-72f188c4-998f-461d-9a7b-4c5bdf7cc804 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:44.679635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-72f188c4-998f-461d-9a7b-4c5bdf7cc804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:44.745952 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1181/2364] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:53:44.755624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:44.757178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:44.830051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17b6f8-39f8-4598-b9b0-9f82938cef74 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:44.834687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aadf5-9129-4d6e-be41-56eee7b53a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:44.835547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aadf5-9129-4d6e-be41-56eee7b53a22 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:44.835849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aadf5-9129-4d6e-be41-56eee7b53a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:44.836111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aadf5-9129-4d6e-be41-56eee7b53a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:44.851325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aadf5-9129-4d6e-be41-56eee7b53a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:44.851877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aadf5-9129-4d6e-be41-56eee7b53a22 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:44.865879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1184/2365] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:53:44.986582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b23311-6b84-42d4-9dda-b9a845a6424e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:44.986912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b23311-6b84-42d4-9dda-b9a845a6424e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:44.987351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b23311-6b84-42d4-9dda-b9a845a6424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:45.009328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-62b23311-6b84-42d4-9dda-b9a845a6424e None None] MFA Rules not processed for user `aae8fa0892fe4f37b6ba6b3cf70506a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:45.011275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-62b23311-6b84-42d4-9dda-b9a845a6424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:45.079067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1182/2366] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:45.389336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050d175-be9f-4e0a-92a8-457c1270b623 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:45.390301 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050d175-be9f-4e0a-92a8-457c1270b623 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:45.390733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050d175-be9f-4e0a-92a8-457c1270b623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:45.417749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a050d175-be9f-4e0a-92a8-457c1270b623 None None] MFA Rules not processed for user `3575098818954a949e202397a1b20a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:53:45.419486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a050d175-be9f-4e0a-92a8-457c1270b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:45.491926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1185/2367] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:53:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:53:46.244638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b23311-6b84-42d4-9dda-b9a845a6424e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:46.246143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-62b23311-6b84-42d4-9dda-b9a845a6424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:46.262046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b23311-6b84-42d4-9dda-b9a845a6424e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:46.285514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:46.286190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:46.286465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:46.286745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] PATH_INFO: `/v3/projects/ce23d6224f5c4ecb975e741a64ffcc9b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:46.288116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce23d6224f5c4ecb975e741a64ffcc9b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:46.290198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:46.405200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:46.461519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce23d6224f5c4ecb975e741a64ffcc9b', 'request_id': 'req-76683d55-6ad1-484b-a528-517484341644'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:46.469757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:46.471418 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce23d6224f5c4ecb975e741a64ffcc9b', 'request_id': 'req-76683d55-6ad1-484b-a528-517484341644'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:46.563298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce23d6224f5c4ecb975e741a64ffcc9b', 'request_id': 'req-76683d55-6ad1-484b-a528-517484341644'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:46.589955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] The token cache is being invalidate because project ce23d6224f5c4ecb975e741a64ffcc9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:53:46.590295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:46.591295 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-76683d55-6ad1-484b-a528-517484341644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:53:46.603974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1183/2368] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:53:46 2022] DELETE /identity/v3/projects/ce23d6224f5c4ecb975e741a64ffcc9b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:53:47.700723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:50.043729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:50.197751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:53.027135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:53.052171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:54.011410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:54.047933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:54.482857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:55.632124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:56.551152 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:58.949394 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:53:59.635178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050d175-be9f-4e0a-92a8-457c1270b623 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:53:59.636725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a050d175-be9f-4e0a-92a8-457c1270b623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:59.651407 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050d175-be9f-4e0a-92a8-457c1270b623 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:53:59.713545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a95e6-d64d-4713-bea4-d895917eb99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:53:59.715271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a95e6-d64d-4713-bea4-d895917eb99f service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:53:59.715607 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a95e6-d64d-4713-bea4-d895917eb99f service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:53:59.715881 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a95e6-d64d-4713-bea4-d895917eb99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:53:59.718272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-404a95e6-d64d-4713-bea4-d895917eb99f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:53:59.794484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a95e6-d64d-4713-bea4-d895917eb99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:53:59.796217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a95e6-d64d-4713-bea4-d895917eb99f service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:53:59.808133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1186/2369] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:53:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:54:00.072205 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:00.937796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:03.149071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:03.762837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce42d62-c484-4285-9294-e53989d0e82f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:03.763359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce42d62-c484-4285-9294-e53989d0e82f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:03.763455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce42d62-c484-4285-9294-e53989d0e82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:03.783855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-4ce42d62-c484-4285-9294-e53989d0e82f None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:03.785290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4ce42d62-c484-4285-9294-e53989d0e82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:03.843084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1184/2370] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:54:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:03.865954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a95e6-d64d-4713-bea4-d895917eb99f service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:03.867419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-404a95e6-d64d-4713-bea4-d895917eb99f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:03.949694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a95e6-d64d-4713-bea4-d895917eb99f service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:03.952163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719cdd8-a415-496b-8f09-fd1205fe1270 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:03.952866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719cdd8-a415-496b-8f09-fd1205fe1270 service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:03.953157 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719cdd8-a415-496b-8f09-fd1205fe1270 service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:03.953451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719cdd8-a415-496b-8f09-fd1205fe1270 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:03.967347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719cdd8-a415-496b-8f09-fd1205fe1270 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:03.969662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719cdd8-a415-496b-8f09-fd1205fe1270 service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:03.980109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1187/2371] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:54:04.145413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:05.412389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af15fa-2a27-46c0-9b02-05106ab3bf00 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:05.413518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af15fa-2a27-46c0-9b02-05106ab3bf00 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:05.413518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af15fa-2a27-46c0-9b02-05106ab3bf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:05.433765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-62af15fa-2a27-46c0-9b02-05106ab3bf00 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:05.434969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-62af15fa-2a27-46c0-9b02-05106ab3bf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:05.442516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1185/2372] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 21:54:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:05.455792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719cdd8-a415-496b-8f09-fd1205fe1270 service swift] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:05.467660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719cdd8-a415-496b-8f09-fd1205fe1270 service swift] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:05.473507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baffed1-0aca-4d66-b99f-ba83df05ce42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:05.474364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baffed1-0aca-4d66-b99f-ba83df05ce42 service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:05.475691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:05.476176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baffed1-0aca-4d66-b99f-ba83df05ce42 service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:05.476534 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baffed1-0aca-4d66-b99f-ba83df05ce42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:05.485244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baffed1-0aca-4d66-b99f-ba83df05ce42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:05.486826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baffed1-0aca-4d66-b99f-ba83df05ce42 service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:05.495353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1188/2373] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:54:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:54:06.512781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b995-709c-4b41-bb33-d407c3066d90 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:06.513345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b995-709c-4b41-bb33-d407c3066d90 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:06.513345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b995-709c-4b41-bb33-d407c3066d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:06.534198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-fb08b995-709c-4b41-bb33-d407c3066d90 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:06.535428 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fb08b995-709c-4b41-bb33-d407c3066d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:06.543345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1186/2374] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:54:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:06.555872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baffed1-0aca-4d66-b99f-ba83df05ce42 service swift] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:06.570141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baffed1-0aca-4d66-b99f-ba83df05ce42 service swift] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:06.577871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db48c9-1562-42eb-a69a-7178ce31a663 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:06.578928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db48c9-1562-42eb-a69a-7178ce31a663 service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:06.579416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db48c9-1562-42eb-a69a-7178ce31a663 service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:06.579911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db48c9-1562-42eb-a69a-7178ce31a663 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:06.595353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db48c9-1562-42eb-a69a-7178ce31a663 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:06.598243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db48c9-1562-42eb-a69a-7178ce31a663 service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:06.613364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1189/2375] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:54:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:54:06.644047 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:07.412189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a5c2-3741-47ba-992e-1f959132e1d4 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:07.412508 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a5c2-3741-47ba-992e-1f959132e1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:07.423878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a5c2-3741-47ba-992e-1f959132e1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:07.433638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-bfe0a5c2-3741-47ba-992e-1f959132e1d4 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:07.434845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bfe0a5c2-3741-47ba-992e-1f959132e1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:07.448819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1187/2376] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 21:54:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:07.465801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db48c9-1562-42eb-a69a-7178ce31a663 service swift] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:07.477625 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db48c9-1562-42eb-a69a-7178ce31a663 service swift] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:07.484151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:07.489367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815f4b9-adfe-423c-abe2-23ad26c8b3fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:07.489994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f4b9-adfe-423c-abe2-23ad26c8b3fc service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:07.490272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f4b9-adfe-423c-abe2-23ad26c8b3fc service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:07.490544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815f4b9-adfe-423c-abe2-23ad26c8b3fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:07.500244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815f4b9-adfe-423c-abe2-23ad26c8b3fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:07.501892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815f4b9-adfe-423c-abe2-23ad26c8b3fc service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:07.511741 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1190/2377] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:54:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:54:08.506004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:10.642677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:11.016936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c8ceb-a7db-4d26-b2ae-9997cd629abd None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:11.017564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c8ceb-a7db-4d26-b2ae-9997cd629abd None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:11.018848 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c8ceb-a7db-4d26-b2ae-9997cd629abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:11.036831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815f4b9-adfe-423c-abe2-23ad26c8b3fc service swift] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:11.038419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f815f4b9-adfe-423c-abe2-23ad26c8b3fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:11.050043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-419c8ceb-a7db-4d26-b2ae-9997cd629abd None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:11.051446 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:11.051899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-419c8ceb-a7db-4d26-b2ae-9997cd629abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:11.135901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815f4b9-adfe-423c-abe2-23ad26c8b3fc service swift] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:11.137898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1188/2378] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:11.142272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:11.143063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:11.143670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:11.144099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] PATH_INFO: `/v3/users/3f87b42c88954740914f36c5ea16368f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:11.145244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f87b42c88954740914f36c5ea16368f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:11.147389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:11.167877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c8ceb-a7db-4d26-b2ae-9997cd629abd None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:11.169713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-419c8ceb-a7db-4d26-b2ae-9997cd629abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:11.255589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c8ceb-a7db-4d26-b2ae-9997cd629abd None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:11.262550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff926-bc5b-4e73-901e-8efe14953917 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:11.263345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff926-bc5b-4e73-901e-8efe14953917 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:11.263635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff926-bc5b-4e73-901e-8efe14953917 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:11.263914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff926-bc5b-4e73-901e-8efe14953917 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:11.274487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff926-bc5b-4e73-901e-8efe14953917 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:11.276449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff926-bc5b-4e73-901e-8efe14953917 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:11.289199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1189/2379] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:54:11.491444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f87b42c88954740914f36c5ea16368f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:54:11.499494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f87b42c88954740914f36c5ea16368f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:54:11.500224 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f87b42c88954740914f36c5ea16368f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:54:11.630978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f87b42c88954740914f36c5ea16368f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:54:11.631519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f87b42c88954740914f36c5ea16368f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:54:11.650400 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1191/2380] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:54:11 2022] DELETE /identity/v3/users/3f87b42c88954740914f36c5ea16368f => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:54:11.655055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0a3a7-dbeb-495a-9cf9-d1aa6a50141c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:11.655570 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0a3a7-dbeb-495a-9cf9-d1aa6a50141c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:11.655670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0a3a7-dbeb-495a-9cf9-d1aa6a50141c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:11.674748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-12f0a3a7-dbeb-495a-9cf9-d1aa6a50141c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:11.676308 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-12f0a3a7-dbeb-495a-9cf9-d1aa6a50141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:11.736274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1190/2381] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:11.746571 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:11.748027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:11.810250 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6757b0-42df-4d27-9c6b-f359bb72f20b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:11.813997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1eec9-e310-4f7a-b443-89c8d24bbaea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:11.814624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1eec9-e310-4f7a-b443-89c8d24bbaea service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:11.814899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1eec9-e310-4f7a-b443-89c8d24bbaea service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:11.815166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1eec9-e310-4f7a-b443-89c8d24bbaea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:11.825509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1eec9-e310-4f7a-b443-89c8d24bbaea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:11.826936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc1eec9-e310-4f7a-b443-89c8d24bbaea service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:11.838262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1192/2382] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:54:11.971933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:12.006662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:12.104156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0a3a7-dbeb-495a-9cf9-d1aa6a50141c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:12.105633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-12f0a3a7-dbeb-495a-9cf9-d1aa6a50141c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:12.117806 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0a3a7-dbeb-495a-9cf9-d1aa6a50141c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:12.122745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:12.123396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:12.123675 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:12.124085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] PATH_INFO: `/v3/projects/35e48d292397480b9b3191e957308c89` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:12.125168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e48d292397480b9b3191e957308c89)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:12.127087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:12.322029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e48d292397480b9b3191e957308c89', 'request_id': 'req-8c818de5-a9e0-4ee9-91bd-bf81662f806e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:54:12.331212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e48d292397480b9b3191e957308c89', 'request_id': 'req-8c818de5-a9e0-4ee9-91bd-bf81662f806e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:54:12.411590 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e48d292397480b9b3191e957308c89', 'request_id': 'req-8c818de5-a9e0-4ee9-91bd-bf81662f806e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:54:12.423731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] The token cache is being invalidate because project 35e48d292397480b9b3191e957308c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:54:12.424121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:54:12.424857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8c818de5-a9e0-4ee9-91bd-bf81662f806e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:54:12.426573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1191/2383] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:54:12 2022] DELETE /identity/v3/projects/35e48d292397480b9b3191e957308c89 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:54:12.432232 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28b17-0406-4fe5-866d-36e6af049cf8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:12.432780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28b17-0406-4fe5-866d-36e6af049cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:12.433137 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c28b17-0406-4fe5-866d-36e6af049cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:12.440645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:12.463186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-01c28b17-0406-4fe5-866d-36e6af049cf8 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:12.464448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-01c28b17-0406-4fe5-866d-36e6af049cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:12.531343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1193/2384] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:12.539930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe69d4-1309-4b3c-9b54-dcae0e831786 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:12.540204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe69d4-1309-4b3c-9b54-dcae0e831786 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:12.540473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe69d4-1309-4b3c-9b54-dcae0e831786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:12.562450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-c7fe69d4-1309-4b3c-9b54-dcae0e831786 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:12.563810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c7fe69d4-1309-4b3c-9b54-dcae0e831786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:12.575096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1192/2385] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:12.579957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c28b17-0406-4fe5-866d-36e6af049cf8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:12.589724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c28b17-0406-4fe5-866d-36e6af049cf8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:12.597120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae25621-d704-4217-a126-fa9ec8138156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:12.597750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25621-d704-4217-a126-fa9ec8138156 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:12.598025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25621-d704-4217-a126-fa9ec8138156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:12.598433 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae25621-d704-4217-a126-fa9ec8138156 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:12.598979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae25621-d704-4217-a126-fa9ec8138156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:54:12.599288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae25621-d704-4217-a126-fa9ec8138156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:12.600965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae25621-d704-4217-a126-fa9ec8138156 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:12.613775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1194/2386] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:54:12.618657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe69d4-1309-4b3c-9b54-dcae0e831786 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:12.629502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe69d4-1309-4b3c-9b54-dcae0e831786 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:12.635645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefb94d-76bf-417b-b314-97752b54f2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:12.636274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefb94d-76bf-417b-b314-97752b54f2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:12.636621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefb94d-76bf-417b-b314-97752b54f2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:12.636845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefb94d-76bf-417b-b314-97752b54f2a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:12.637498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefb94d-76bf-417b-b314-97752b54f2a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:12.639672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fefb94d-76bf-417b-b314-97752b54f2a6 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:12.764440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1193/2387] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:54:12 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:54:12.768303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae25621-d704-4217-a126-fa9ec8138156 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:12.778330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae25621-d704-4217-a126-fa9ec8138156 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:12.836650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d90d21-66c4-46b3-a6ed-2e8527a4fe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:12.837277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90d21-66c4-46b3-a6ed-2e8527a4fe99 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:12.837560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90d21-66c4-46b3-a6ed-2e8527a4fe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:12.837836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d90d21-66c4-46b3-a6ed-2e8527a4fe99 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:12.838473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d90d21-66c4-46b3-a6ed-2e8527a4fe99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:12.840425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d90d21-66c4-46b3-a6ed-2e8527a4fe99 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:12.848793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:12.961489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1195/2388] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:54:12 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:54:12.966011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefb94d-76bf-417b-b314-97752b54f2a6 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:12.976838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefb94d-76bf-417b-b314-97752b54f2a6 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:12.982082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67e6a8-d44a-45ac-88f1-0726a25104a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:12.982706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67e6a8-d44a-45ac-88f1-0726a25104a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:12.982965 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67e6a8-d44a-45ac-88f1-0726a25104a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:12.983232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67e6a8-d44a-45ac-88f1-0726a25104a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:12.983957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67e6a8-d44a-45ac-88f1-0726a25104a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:12.985601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67e6a8-d44a-45ac-88f1-0726a25104a6 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:13.000342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1194/2389] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:54:13.006194 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d90d21-66c4-46b3-a6ed-2e8527a4fe99 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:13.017543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d90d21-66c4-46b3-a6ed-2e8527a4fe99 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:13.022440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccc8a7-4573-4bd9-ae48-37a00c524fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:13.023068 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccc8a7-4573-4bd9-ae48-37a00c524fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:13.023360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccc8a7-4573-4bd9-ae48-37a00c524fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:13.023620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccc8a7-4573-4bd9-ae48-37a00c524fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:13.024283 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccc8a7-4573-4bd9-ae48-37a00c524fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:13.025959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccc8a7-4573-4bd9-ae48-37a00c524fe8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:13.037825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1196/2390] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:54:13.048734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67e6a8-d44a-45ac-88f1-0726a25104a6 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:13.061426 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67e6a8-d44a-45ac-88f1-0726a25104a6 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:13.066948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c40b7-2894-4dd7-9d84-1aaf09fafbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:13.067671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c40b7-2894-4dd7-9d84-1aaf09fafbd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:13.068078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c40b7-2894-4dd7-9d84-1aaf09fafbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:13.068416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c40b7-2894-4dd7-9d84-1aaf09fafbd5 admin admin] PATH_INFO: `/v3/projects/cae92c45ec304a2da9a7cafe49bb8b20/users/7dcd703ad58a4807b99266f82e8988ca/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:13.084612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c40b7-2894-4dd7-9d84-1aaf09fafbd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae92c45ec304a2da9a7cafe49bb8b20, user_id=7dcd703ad58a4807b99266f82e8988ca, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:13.087857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c40b7-2894-4dd7-9d84-1aaf09fafbd5 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:13.189534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1195/2391] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:54:13 2022] PUT /identity/v3/projects/cae92c45ec304a2da9a7cafe49bb8b20/users/7dcd703ad58a4807b99266f82e8988ca/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:54:13.195084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661d478-4a75-4c8b-a78a-862146f6d08d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:13.195520 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661d478-4a75-4c8b-a78a-862146f6d08d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:13.195905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6661d478-4a75-4c8b-a78a-862146f6d08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:13.222648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6661d478-4a75-4c8b-a78a-862146f6d08d None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:13.223902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6661d478-4a75-4c8b-a78a-862146f6d08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:13.288360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1197/2392] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:13.299347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c40b7-2894-4dd7-9d84-1aaf09fafbd5 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:13.302537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6f9c40b7-2894-4dd7-9d84-1aaf09fafbd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:13.362230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c40b7-2894-4dd7-9d84-1aaf09fafbd5 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:13.366024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75523c37-d5c0-440c-a3bb-f22547897a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:13.366636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75523c37-d5c0-440c-a3bb-f22547897a55 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:13.366920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75523c37-d5c0-440c-a3bb-f22547897a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:13.367195 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75523c37-d5c0-440c-a3bb-f22547897a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:13.380599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75523c37-d5c0-440c-a3bb-f22547897a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:13.382091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75523c37-d5c0-440c-a3bb-f22547897a55 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:13.392868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1196/2393] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:54:13.854962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:13.920598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:15.063085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:16.083485 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:16.267199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:18.567438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d719-f3b6-4a2d-957b-df8be2119ccd None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:18.570028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d719-f3b6-4a2d-957b-df8be2119ccd None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:18.570028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d719-f3b6-4a2d-957b-df8be2119ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:18.600664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b590d719-f3b6-4a2d-957b-df8be2119ccd None None] MFA Rules not processed for user `aae8fa0892fe4f37b6ba6b3cf70506a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:18.603261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b590d719-f3b6-4a2d-957b-df8be2119ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:18.703924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1198/2394] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:54:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:19.442505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644659-6b94-4589-88cc-715292612cb4 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:19.443896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644659-6b94-4589-88cc-715292612cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:19.444375 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644659-6b94-4589-88cc-715292612cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:19.475479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b2644659-6b94-4589-88cc-715292612cb4 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:19.478208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b2644659-6b94-4589-88cc-715292612cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:19.491406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1197/2395] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:19.516274 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590d719-f3b6-4a2d-957b-df8be2119ccd None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:19.520667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b590d719-f3b6-4a2d-957b-df8be2119ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:19.637903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590d719-f3b6-4a2d-957b-df8be2119ccd None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:19.646077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a07af-74fb-4adb-8037-784eb01c88c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:19.647244 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a07af-74fb-4adb-8037-784eb01c88c4 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:19.647633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a07af-74fb-4adb-8037-784eb01c88c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:19.648264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a07af-74fb-4adb-8037-784eb01c88c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:19.676049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a07af-74fb-4adb-8037-784eb01c88c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:19.682911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a07af-74fb-4adb-8037-784eb01c88c4 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:19.712269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1199/2396] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:54:19.905750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:19.945623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:20.616311 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea089ca-cc9c-4ae7-a71a-2940972d962a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:20.617045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea089ca-cc9c-4ae7-a71a-2940972d962a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:20.617045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea089ca-cc9c-4ae7-a71a-2940972d962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:20.655738 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-dea089ca-cc9c-4ae7-a71a-2940972d962a None None] MFA Rules not processed for user `7dcd703ad58a4807b99266f82e8988ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:20.657852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-dea089ca-cc9c-4ae7-a71a-2940972d962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:20.755433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1198/2397] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:54:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:20.760815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a07af-74fb-4adb-8037-784eb01c88c4 service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:20.772612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a07af-74fb-4adb-8037-784eb01c88c4 service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:20.778995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860c56a-3867-4e59-a66f-feb0658333ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:20.779664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860c56a-3867-4e59-a66f-feb0658333ab admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:20.779891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860c56a-3867-4e59-a66f-feb0658333ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:20.780166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6860c56a-3867-4e59-a66f-feb0658333ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:20.780858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860c56a-3867-4e59-a66f-feb0658333ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:20.782782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6860c56a-3867-4e59-a66f-feb0658333ab admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:20.871708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:20.885252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1200/2398] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:54:20 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:54:20.889693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea089ca-cc9c-4ae7-a71a-2940972d962a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:20.918569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea089ca-cc9c-4ae7-a71a-2940972d962a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:20.989794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ddd8c-21fd-421f-b4ea-93cc3897ba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:20.990420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ddd8c-21fd-421f-b4ea-93cc3897ba76 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:20.990704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ddd8c-21fd-421f-b4ea-93cc3897ba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:20.990984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ddd8c-21fd-421f-b4ea-93cc3897ba76 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:20.991673 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ddd8c-21fd-421f-b4ea-93cc3897ba76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:20.994337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ddd8c-21fd-421f-b4ea-93cc3897ba76 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:21.135279 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1199/2399] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:54:20 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:54:21.141240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860c56a-3867-4e59-a66f-feb0658333ab admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:21.151709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6860c56a-3867-4e59-a66f-feb0658333ab admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:21.156352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606a123-9d48-469c-a091-7a45ddb70b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:21.157743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606a123-9d48-469c-a091-7a45ddb70b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:21.158254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606a123-9d48-469c-a091-7a45ddb70b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:21.158568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606a123-9d48-469c-a091-7a45ddb70b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:21.159265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606a123-9d48-469c-a091-7a45ddb70b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:21.161260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606a123-9d48-469c-a091-7a45ddb70b74 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:21.173077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1201/2400] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:54:21.177428 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ddd8c-21fd-421f-b4ea-93cc3897ba76 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:21.188539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ddd8c-21fd-421f-b4ea-93cc3897ba76 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:21.193460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352d065-b5e5-4a39-a890-42585ca54389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:21.194129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352d065-b5e5-4a39-a890-42585ca54389 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:21.194405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352d065-b5e5-4a39-a890-42585ca54389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:21.194676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352d065-b5e5-4a39-a890-42585ca54389 admin admin] PATH_INFO: `/v3/projects/863be9826a204a00b097535d1f1532b2/users/4d69fa731fbc4710b92f3043f93428b1/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:21.211505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352d065-b5e5-4a39-a890-42585ca54389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863be9826a204a00b097535d1f1532b2, user_id=4d69fa731fbc4710b92f3043f93428b1, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:21.214309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1352d065-b5e5-4a39-a890-42585ca54389 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:21.298532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1200/2401] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:54:21 2022] PUT /identity/v3/projects/863be9826a204a00b097535d1f1532b2/users/4d69fa731fbc4710b92f3043f93428b1/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:54:21.302199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606a123-9d48-469c-a091-7a45ddb70b74 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:21.315978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606a123-9d48-469c-a091-7a45ddb70b74 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:21.399630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08394809-37b4-468c-a139-d2adb55c4f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:21.399853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08394809-37b4-468c-a139-d2adb55c4f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:21.400078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08394809-37b4-468c-a139-d2adb55c4f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:21.400575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08394809-37b4-468c-a139-d2adb55c4f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:21.401241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08394809-37b4-468c-a139-d2adb55c4f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:21.403088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08394809-37b4-468c-a139-d2adb55c4f93 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:21.415372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1202/2402] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:54:21.419936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352d065-b5e5-4a39-a890-42585ca54389 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:21.434589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352d065-b5e5-4a39-a890-42585ca54389 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:21.439774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e32e-bddc-4352-b55c-ca0b0cb9fb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:21.440455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e32e-bddc-4352-b55c-ca0b0cb9fb58 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:21.440768 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e32e-bddc-4352-b55c-ca0b0cb9fb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:21.441047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e32e-bddc-4352-b55c-ca0b0cb9fb58 admin admin] PATH_INFO: `/v3/projects/863be9826a204a00b097535d1f1532b2/users/4d69fa731fbc4710b92f3043f93428b1/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:21.443049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158e32e-bddc-4352-b55c-ca0b0cb9fb58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863be9826a204a00b097535d1f1532b2, user_id=4d69fa731fbc4710b92f3043f93428b1, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:21.445905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158e32e-bddc-4352-b55c-ca0b0cb9fb58 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:21.458970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1201/2403] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:54:21 2022] PUT /identity/v3/projects/863be9826a204a00b097535d1f1532b2/users/4d69fa731fbc4710b92f3043f93428b1/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:54:21.807302 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:22.869683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:24.036787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:25.011999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:25.283420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb0acd-bd63-43ca-ad6c-048012f3010f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:25.284442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb0acd-bd63-43ca-ad6c-048012f3010f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:25.285776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb0acd-bd63-43ca-ad6c-048012f3010f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:25.320997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-47fb0acd-bd63-43ca-ad6c-048012f3010f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:25.325362 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-47fb0acd-bd63-43ca-ad6c-048012f3010f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:25.453292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1203/2404] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:25.498386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e32e-bddc-4352-b55c-ca0b0cb9fb58 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:25.648932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e32e-bddc-4352-b55c-ca0b0cb9fb58 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:25.668562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a50b8-92b6-4a35-a7ac-8273d093cb37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:25.669870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a50b8-92b6-4a35-a7ac-8273d093cb37 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:25.670378 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a50b8-92b6-4a35-a7ac-8273d093cb37 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:25.671204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a50b8-92b6-4a35-a7ac-8273d093cb37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:25.701132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a50b8-92b6-4a35-a7ac-8273d093cb37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:25.702810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a50b8-92b6-4a35-a7ac-8273d093cb37 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:25.728773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1202/2405] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:54:26.386008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:26.435134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:27.047914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:28.179914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:28.317906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef3e5-8d7c-47d2-90d4-a9d861ceb6ca None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:28.317906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef3e5-8d7c-47d2-90d4-a9d861ceb6ca None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:28.323379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdef3e5-8d7c-47d2-90d4-a9d861ceb6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:28.366542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4fdef3e5-8d7c-47d2-90d4-a9d861ceb6ca None None] MFA Rules not processed for user `4d69fa731fbc4710b92f3043f93428b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:28.380951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4fdef3e5-8d7c-47d2-90d4-a9d861ceb6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:28.452717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1204/2406] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:54:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:28.466167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a50b8-92b6-4a35-a7ac-8273d093cb37 service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:28.467845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0b4a50b8-92b6-4a35-a7ac-8273d093cb37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:28.476280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:28.551390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a50b8-92b6-4a35-a7ac-8273d093cb37 service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:28.557159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b10e4-8633-40f1-bdc9-7e5ac7a8a18f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07be3fbf45dc407ba3b6ad4d1e6ea042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:28.557808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b10e4-8633-40f1-bdc9-7e5ac7a8a18f service glance] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:28.558090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b10e4-8633-40f1-bdc9-7e5ac7a8a18f service glance] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:28.558364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b10e4-8633-40f1-bdc9-7e5ac7a8a18f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:28.667856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b10e4-8633-40f1-bdc9-7e5ac7a8a18f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:28.671835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b10e4-8633-40f1-bdc9-7e5ac7a8a18f service glance] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:28.693395 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1203/2407] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:54:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:54:29.054914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418b5e-42d5-4c27-923c-01177a37a041 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:29.055220 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418b5e-42d5-4c27-923c-01177a37a041 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:29.055449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d418b5e-42d5-4c27-923c-01177a37a041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:29.078034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-8d418b5e-42d5-4c27-923c-01177a37a041 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:29.079309 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8d418b5e-42d5-4c27-923c-01177a37a041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:29.167770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1205/2408] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:54:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:29.176421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b10e4-8633-40f1-bdc9-7e5ac7a8a18f service glance] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:29.179490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-756b10e4-8633-40f1-bdc9-7e5ac7a8a18f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:29.279495 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b10e4-8633-40f1-bdc9-7e5ac7a8a18f service glance] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:29.285010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b5946-d257-49d7-90de-229361ecc333 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:29.285731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b5946-d257-49d7-90de-229361ecc333 service swift] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:29.286124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b5946-d257-49d7-90de-229361ecc333 service swift] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:29.286403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b5946-d257-49d7-90de-229361ecc333 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:29.297682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b5946-d257-49d7-90de-229361ecc333 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:29.299919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b5946-d257-49d7-90de-229361ecc333 service swift] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:29.310520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1204/2409] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:54:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:54:29.841533 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:30.099767 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce4c98-3845-4e04-8510-c8197bb0c0c0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:30.100419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce4c98-3845-4e04-8510-c8197bb0c0c0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:30.101674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce4c98-3845-4e04-8510-c8197bb0c0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:30.131738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b9ce4c98-3845-4e04-8510-c8197bb0c0c0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:30.134872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b9ce4c98-3845-4e04-8510-c8197bb0c0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:30.149069 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1206/2410] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:30.167966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:30.215427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b5946-d257-49d7-90de-229361ecc333 service swift] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:30.240679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b5946-d257-49d7-90de-229361ecc333 service swift] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:30.254006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf528a-3e2f-45a4-aa74-d6c5c63e1dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:30.254711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf528a-3e2f-45a4-aa74-d6c5c63e1dd5 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:30.256307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf528a-3e2f-45a4-aa74-d6c5c63e1dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:30.256307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf528a-3e2f-45a4-aa74-d6c5c63e1dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:30.265906 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf528a-3e2f-45a4-aa74-d6c5c63e1dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:30.267608 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf528a-3e2f-45a4-aa74-d6c5c63e1dd5 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:30.281899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1205/2411] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:54:30.505505 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:30.870441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:31.174189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:31.260996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:31.972075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:32.406887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:33.560352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:33.854660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:34.131977 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:34.323078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:34.402709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:34.437942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:34.692833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:34.716296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:34.984001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:35.011779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:35.211587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:35.300240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:35.513438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:35.589136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:35.734305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:35.901671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:36.324399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:37.116865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:37.228828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:37.631969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:37.682779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:37.973757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:38.011897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:38.065707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:38.167825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:38.276211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:38.368894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:38.847184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07551e5a-5a51-4503-a58e-5243cd8357a0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:38.847184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07551e5a-5a51-4503-a58e-5243cd8357a0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:38.847184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07551e5a-5a51-4503-a58e-5243cd8357a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:38.888934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-07551e5a-5a51-4503-a58e-5243cd8357a0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:38.890460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-07551e5a-5a51-4503-a58e-5243cd8357a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:38.909900 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1207/2412] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:38.940357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf528a-3e2f-45a4-aa74-d6c5c63e1dd5 service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:38.942529 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f1cf528a-3e2f-45a4-aa74-d6c5c63e1dd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:38.966072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf528a-3e2f-45a4-aa74-d6c5c63e1dd5 service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:38.972707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111aef9b-3a36-48eb-acbb-3069d37ab864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:38.973600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aef9b-3a36-48eb-acbb-3069d37ab864 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:38.974059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aef9b-3a36-48eb-acbb-3069d37ab864 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:38.974496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111aef9b-3a36-48eb-acbb-3069d37ab864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:38.986291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aef9b-3a36-48eb-acbb-3069d37ab864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:38.988521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111aef9b-3a36-48eb-acbb-3069d37ab864 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:39.000285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1206/2413] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:54:41.308363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ef72f-9c9c-40c6-9c7f-b2bb5cee2f28 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:41.308860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ef72f-9c9c-40c6-9c7f-b2bb5cee2f28 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:41.308860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ef72f-9c9c-40c6-9c7f-b2bb5cee2f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:41.338933 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-078ef72f-9c9c-40c6-9c7f-b2bb5cee2f28 None None] MFA Rules not processed for user `7dcd703ad58a4807b99266f82e8988ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:41.340466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-078ef72f-9c9c-40c6-9c7f-b2bb5cee2f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:41.349280 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1208/2414] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:54:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:47.309131 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22c496-2091-4ca6-9ecc-12e97039dbb0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:47.309679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22c496-2091-4ca6-9ecc-12e97039dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:47.309776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22c496-2091-4ca6-9ecc-12e97039dbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:47.330878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7d22c496-2091-4ca6-9ecc-12e97039dbb0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:47.336413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7d22c496-2091-4ca6-9ecc-12e97039dbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:47.340936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1207/2415] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:47.368720 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ef72f-9c9c-40c6-9c7f-b2bb5cee2f28 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:47.387372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ef72f-9c9c-40c6-9c7f-b2bb5cee2f28 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:47.393319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8bd7a-5e0c-4368-8e02-98a82e3541dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:47.404971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8bd7a-5e0c-4368-8e02-98a82e3541dc service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:47.404971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8bd7a-5e0c-4368-8e02-98a82e3541dc service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:47.404971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8bd7a-5e0c-4368-8e02-98a82e3541dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:47.410269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8bd7a-5e0c-4368-8e02-98a82e3541dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:47.411913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8bd7a-5e0c-4368-8e02-98a82e3541dc service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:47.423694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1209/2416] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:54:51.994310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c32dc-6ce8-4373-bb98-f7f2f6ef9786 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:51.994907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c32dc-6ce8-4373-bb98-f7f2f6ef9786 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:51.994907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c32dc-6ce8-4373-bb98-f7f2f6ef9786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:52.017936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-403c32dc-6ce8-4373-bb98-f7f2f6ef9786 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:52.019399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-403c32dc-6ce8-4373-bb98-f7f2f6ef9786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:52.032072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1208/2417] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:54:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:52.048199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8bd7a-5e0c-4368-8e02-98a82e3541dc service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:52.063176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8bd7a-5e0c-4368-8e02-98a82e3541dc service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:52.078765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c861d7-d1e4-4d0c-8936-bd706954d005 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:52.079988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c861d7-d1e4-4d0c-8936-bd706954d005 service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:52.079988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c861d7-d1e4-4d0c-8936-bd706954d005 service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:52.080437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c861d7-d1e4-4d0c-8936-bd706954d005 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:52.096674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c861d7-d1e4-4d0c-8936-bd706954d005 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:52.098323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c861d7-d1e4-4d0c-8936-bd706954d005 service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:52.109152 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1210/2418] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:54:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:54:54.810215 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8dbc-31bb-4719-a2d2-758e2a6771c0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:54.810784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8dbc-31bb-4719-a2d2-758e2a6771c0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:54.810984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de8dbc-31bb-4719-a2d2-758e2a6771c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:54.835196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-f0de8dbc-31bb-4719-a2d2-758e2a6771c0 None None] MFA Rules not processed for user `fb465b4782514e7d8e75a7dc14c0a1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:54.839483 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f0de8dbc-31bb-4719-a2d2-758e2a6771c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:54.863015 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:54:54.920439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1209/2419] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:54:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:55.642007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f10e-bbb6-47b1-acab-b7054e2b5aef None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:55.642007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f10e-bbb6-47b1-acab-b7054e2b5aef None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:55.642677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f10e-bbb6-47b1-acab-b7054e2b5aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:55.664660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c7a1f10e-bbb6-47b1-acab-b7054e2b5aef None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:54:55.666202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c7a1f10e-bbb6-47b1-acab-b7054e2b5aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:54:55.674965 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1211/2420] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:54:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:54:55.687867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8dbc-31bb-4719-a2d2-758e2a6771c0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:54:55.701840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de8dbc-31bb-4719-a2d2-758e2a6771c0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:54:55.709832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b055950-7f61-4808-a9b6-1257034a6a14 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:54:55.711828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b055950-7f61-4808-a9b6-1257034a6a14 service swift] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:54:55.712442 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b055950-7f61-4808-a9b6-1257034a6a14 service swift] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:54:55.713006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b055950-7f61-4808-a9b6-1257034a6a14 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:54:55.724212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b055950-7f61-4808-a9b6-1257034a6a14 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:54:55.727368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b055950-7f61-4808-a9b6-1257034a6a14 service swift] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:54:55.739654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1210/2421] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:54:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 21:55:05.665175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=71 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:05.734154 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=22 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:18.706311 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6a64-bf00-4caf-88ca-c36a3814115d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:18.707300 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6a64-bf00-4caf-88ca-c36a3814115d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:18.707835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6a64-bf00-4caf-88ca-c36a3814115d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:18.735420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c62c6a64-bf00-4caf-88ca-c36a3814115d None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:55:18.736694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c62c6a64-bf00-4caf-88ca-c36a3814115d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:18.746333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1212/2422] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 21:55:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:55:18.761186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b055950-7f61-4808-a9b6-1257034a6a14 service swift] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:18.777559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b055950-7f61-4808-a9b6-1257034a6a14 service swift] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:18.797543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff2000-04bc-4e92-a721-a4cf19928666 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:18.800819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff2000-04bc-4e92-a721-a4cf19928666 service swift] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:18.801720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff2000-04bc-4e92-a721-a4cf19928666 service swift] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:18.804889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff2000-04bc-4e92-a721-a4cf19928666 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:18.820915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff2000-04bc-4e92-a721-a4cf19928666 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:18.823325 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff2000-04bc-4e92-a721-a4cf19928666 service swift] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:18.834469 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1211/2423] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:55:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:55:22.816142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c6a64-bf00-4caf-88ca-c36a3814115d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:22.818585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c62c6a64-bf00-4caf-88ca-c36a3814115d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:22.841597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c6a64-bf00-4caf-88ca-c36a3814115d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:22.847777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:22.848831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:22.849121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:22.849563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] PATH_INFO: `/v3/users/aae8fa0892fe4f37b6ba6b3cf70506a8` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:22.850904 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae8fa0892fe4f37b6ba6b3cf70506a8)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:22.852932 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:23.217757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae8fa0892fe4f37b6ba6b3cf70506a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:23.226920 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae8fa0892fe4f37b6ba6b3cf70506a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:23.227590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae8fa0892fe4f37b6ba6b3cf70506a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:23.322095 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae8fa0892fe4f37b6ba6b3cf70506a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:23.323329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b31a2222-160c-4bd9-a729-bae84b60d0c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae8fa0892fe4f37b6ba6b3cf70506a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:23.368909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1213/2424] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:55:22 2022] DELETE /identity/v3/users/aae8fa0892fe4f37b6ba6b3cf70506a8 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:55:23.810064 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff2000-04bc-4e92-a721-a4cf19928666 service swift] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:23.821262 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff2000-04bc-4e92-a721-a4cf19928666 service swift] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:23.888316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:23.889070 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:23.889346 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:23.889620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] PATH_INFO: `/v3/projects/914dca3de66e476bb9a73c0e7fe97188` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:23.890883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=914dca3de66e476bb9a73c0e7fe97188)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:23.892935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:24.021569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914dca3de66e476bb9a73c0e7fe97188', 'request_id': 'req-0285f53e-7812-46f4-be0f-a761c17f5558'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:24.030602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914dca3de66e476bb9a73c0e7fe97188', 'request_id': 'req-0285f53e-7812-46f4-be0f-a761c17f5558'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:24.113794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914dca3de66e476bb9a73c0e7fe97188', 'request_id': 'req-0285f53e-7812-46f4-be0f-a761c17f5558'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:24.131746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] The token cache is being invalidate because project 914dca3de66e476bb9a73c0e7fe97188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:55:24.132145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:24.132897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0285f53e-7812-46f4-be0f-a761c17f5558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:24.135475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1212/2425] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:55:23 2022] DELETE /identity/v3/projects/914dca3de66e476bb9a73c0e7fe97188 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:55:24.140680 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a394705-3b72-4beb-b6b1-46cc5e6c4f61 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:24.141204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a394705-3b72-4beb-b6b1-46cc5e6c4f61 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:24.141332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a394705-3b72-4beb-b6b1-46cc5e6c4f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:24.165261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1a394705-3b72-4beb-b6b1-46cc5e6c4f61 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:55:24.174211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1a394705-3b72-4beb-b6b1-46cc5e6c4f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:24.260899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1214/2426] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:55:24.270482 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3d6f-6a14-427c-a7d9-2ab02c036c1c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:24.270778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3d6f-6a14-427c-a7d9-2ab02c036c1c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:24.271439 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea3d6f-6a14-427c-a7d9-2ab02c036c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:24.301431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-17ea3d6f-6a14-427c-a7d9-2ab02c036c1c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:55:24.302888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-17ea3d6f-6a14-427c-a7d9-2ab02c036c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:24.317462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1213/2427] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:55:24.318955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a394705-3b72-4beb-b6b1-46cc5e6c4f61 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:24.329535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a394705-3b72-4beb-b6b1-46cc5e6c4f61 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:24.336545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771d183-fb05-42bf-8655-be38e8c0e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:24.337546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d183-fb05-42bf-8655-be38e8c0e667 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:24.338163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d183-fb05-42bf-8655-be38e8c0e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:24.338584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d183-fb05-42bf-8655-be38e8c0e667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:24.339422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771d183-fb05-42bf-8655-be38e8c0e667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:55:24.340056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771d183-fb05-42bf-8655-be38e8c0e667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:24.341891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771d183-fb05-42bf-8655-be38e8c0e667 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:24.378615 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1215/2428] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:55:24.393544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea3d6f-6a14-427c-a7d9-2ab02c036c1c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:24.399326 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42ea99-397d-48bf-b66e-3d3483b9bb83 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:24.399813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42ea99-397d-48bf-b66e-3d3483b9bb83 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:24.405622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea3d6f-6a14-427c-a7d9-2ab02c036c1c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:24.405789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42ea99-397d-48bf-b66e-3d3483b9bb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:24.415521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62042e3-8612-4976-a0fd-143cf5854a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:24.416254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62042e3-8612-4976-a0fd-143cf5854a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:24.416571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62042e3-8612-4976-a0fd-143cf5854a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:24.416899 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62042e3-8612-4976-a0fd-143cf5854a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:24.417502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62042e3-8612-4976-a0fd-143cf5854a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:24.419646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62042e3-8612-4976-a0fd-143cf5854a12 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:24.443670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1f42ea99-397d-48bf-b66e-3d3483b9bb83 None None] MFA Rules not processed for user `9f617d6e3f3444cda7307794d7b8d837`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:55:24.447230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1f42ea99-397d-48bf-b66e-3d3483b9bb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:24.527152 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:24.558591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1216/2429] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:55:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:55:24.686430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1214/2430] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:55:24 2022] POST /identity/v3/projects => generated 369 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:55:24.691565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42ea99-397d-48bf-b66e-3d3483b9bb83 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:24.709673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42ea99-397d-48bf-b66e-3d3483b9bb83 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:24.811701 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8da9d-ea5a-4098-bb13-4dd7fa6bbccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:24.812434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8da9d-ea5a-4098-bb13-4dd7fa6bbccf admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:24.812921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8da9d-ea5a-4098-bb13-4dd7fa6bbccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:24.813105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8da9d-ea5a-4098-bb13-4dd7fa6bbccf admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:24.813727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8da9d-ea5a-4098-bb13-4dd7fa6bbccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:24.815689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8da9d-ea5a-4098-bb13-4dd7fa6bbccf admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:24.935812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1217/2431] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:55:24 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:55:24.941968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62042e3-8612-4976-a0fd-143cf5854a12 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:24.942604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2cfb2-c12a-43f8-82a3-dbb9fac8f1ec None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:24.943036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2cfb2-c12a-43f8-82a3-dbb9fac8f1ec None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:24.943485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2cfb2-c12a-43f8-82a3-dbb9fac8f1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:24.955246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62042e3-8612-4976-a0fd-143cf5854a12 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:24.961604 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be760b70-ea89-485c-8feb-6c4662077f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:24.962232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be760b70-ea89-485c-8feb-6c4662077f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:24.962511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be760b70-ea89-485c-8feb-6c4662077f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:24.963019 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be760b70-ea89-485c-8feb-6c4662077f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:24.963864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be760b70-ea89-485c-8feb-6c4662077f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:24.965979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be760b70-ea89-485c-8feb-6c4662077f49 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:24.972114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e5c2cfb2-c12a-43f8-82a3-dbb9fac8f1ec None None] MFA Rules not processed for user `ed8ef9f9eafd4248bae86f0e8ec72731`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:55:24.974084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e5c2cfb2-c12a-43f8-82a3-dbb9fac8f1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:24.978094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1215/2432] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:55:24.983089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be760b70-ea89-485c-8feb-6c4662077f49 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:24.993826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be760b70-ea89-485c-8feb-6c4662077f49 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:24.999035 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d37250-e8b8-4259-a097-40aae10d0a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:24.999699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d37250-e8b8-4259-a097-40aae10d0a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:25.000156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d37250-e8b8-4259-a097-40aae10d0a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:25.004728 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d37250-e8b8-4259-a097-40aae10d0a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:25.007469 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d37250-e8b8-4259-a097-40aae10d0a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:25.010028 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d37250-e8b8-4259-a097-40aae10d0a90 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:25.027317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1216/2433] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:55:25.033900 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d37250-e8b8-4259-a097-40aae10d0a90 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:25.052063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d37250-e8b8-4259-a097-40aae10d0a90 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:25.060400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840468-4fc2-4fa2-a5a2-d2adb25ac1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:25.061535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840468-4fc2-4fa2-a5a2-d2adb25ac1d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:25.076312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1218/2434] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:55:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:55:25.076509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840468-4fc2-4fa2-a5a2-d2adb25ac1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:25.076509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05840468-4fc2-4fa2-a5a2-d2adb25ac1d9 admin admin] PATH_INFO: `/v3/projects/d99e33b948d34ffb889afe9c3a1e3615/users/64b108e279bc4dc78bee652b585b950a/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:25.090226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05840468-4fc2-4fa2-a5a2-d2adb25ac1d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d99e33b948d34ffb889afe9c3a1e3615, user_id=64b108e279bc4dc78bee652b585b950a, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:25.094686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05840468-4fc2-4fa2-a5a2-d2adb25ac1d9 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:25.173707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1217/2435] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:55:25 2022] PUT /identity/v3/projects/d99e33b948d34ffb889afe9c3a1e3615/users/64b108e279bc4dc78bee652b585b950a/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:55:25.187892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5ea02-9910-4dfa-a2cf-eca23286938b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:25.190053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5ea02-9910-4dfa-a2cf-eca23286938b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:25.190677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5ea02-9910-4dfa-a2cf-eca23286938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:25.228973 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3fd5ea02-9910-4dfa-a2cf-eca23286938b None None] MFA Rules not processed for user `64b108e279bc4dc78bee652b585b950a`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:55:25.230209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3fd5ea02-9910-4dfa-a2cf-eca23286938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:25.335974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1219/2436] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:55:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:55:25.348132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840468-4fc2-4fa2-a5a2-d2adb25ac1d9 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:25.349964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-05840468-4fc2-4fa2-a5a2-d2adb25ac1d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:25.356093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:25.465692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05840468-4fc2-4fa2-a5a2-d2adb25ac1d9 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:25.479133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10931f-1c35-42c8-8214-d805c2252df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:25.479930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10931f-1c35-42c8-8214-d805c2252df7 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:25.480213 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10931f-1c35-42c8-8214-d805c2252df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:25.485344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10931f-1c35-42c8-8214-d805c2252df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:25.492307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10931f-1c35-42c8-8214-d805c2252df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:25.493803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10931f-1c35-42c8-8214-d805c2252df7 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:25.504124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1218/2437] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:55:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:55:25.520167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5ea02-9910-4dfa-a2cf-eca23286938b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:25.521444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3fd5ea02-9910-4dfa-a2cf-eca23286938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:25.558324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:25.628604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5ea02-9910-4dfa-a2cf-eca23286938b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:25.640676 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd547121-1102-4048-8a38-3358d8b6fe87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:25.642132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd547121-1102-4048-8a38-3358d8b6fe87 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:25.642132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd547121-1102-4048-8a38-3358d8b6fe87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:25.642132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd547121-1102-4048-8a38-3358d8b6fe87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:25.647698 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bd547121-1102-4048-8a38-3358d8b6fe87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:25.759626 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd547121-1102-4048-8a38-3358d8b6fe87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:25.761940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd547121-1102-4048-8a38-3358d8b6fe87 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:25.778214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1220/2438] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:55:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:55:26.051187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10931f-1c35-42c8-8214-d805c2252df7 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:26.053033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-af10931f-1c35-42c8-8214-d805c2252df7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:26.074261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10931f-1c35-42c8-8214-d805c2252df7 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:26.086577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eeda52-b03a-4b9c-bcd7-91a43cc6de1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:26.087216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeda52-b03a-4b9c-bcd7-91a43cc6de1b service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:26.087547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeda52-b03a-4b9c-bcd7-91a43cc6de1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:26.087808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eeda52-b03a-4b9c-bcd7-91a43cc6de1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:26.089978 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-20eeda52-b03a-4b9c-bcd7-91a43cc6de1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:26.111385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eeda52-b03a-4b9c-bcd7-91a43cc6de1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:26.112801 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eeda52-b03a-4b9c-bcd7-91a43cc6de1b service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:26.129430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1219/2439] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:55:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:55:35.690603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd547121-1102-4048-8a38-3358d8b6fe87 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:35.711204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd547121-1102-4048-8a38-3358d8b6fe87 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:35.716618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc77d7b-7a97-4a6b-9cc8-beeab2c4f25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:35.717703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc77d7b-7a97-4a6b-9cc8-beeab2c4f25d service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:35.718268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc77d7b-7a97-4a6b-9cc8-beeab2c4f25d service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:35.718667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc77d7b-7a97-4a6b-9cc8-beeab2c4f25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:35.720790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-afc77d7b-7a97-4a6b-9cc8-beeab2c4f25d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:35.811842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc77d7b-7a97-4a6b-9cc8-beeab2c4f25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:35.813667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc77d7b-7a97-4a6b-9cc8-beeab2c4f25d service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:35.825732 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1221/2440] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:55:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:55:36.235912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=31 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:37.219599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9822b-0cc2-44b1-982b-561c0a8a31ae None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:37.219912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9822b-0cc2-44b1-982b-561c0a8a31ae None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:37.220140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9822b-0cc2-44b1-982b-561c0a8a31ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:37.241199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-56a9822b-0cc2-44b1-982b-561c0a8a31ae None None] MFA Rules not processed for user `3575098818954a949e202397a1b20a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:55:37.242352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-56a9822b-0cc2-44b1-982b-561c0a8a31ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:37.303651 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1220/2441] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:55:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:55:40.668706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc77d7b-7a97-4a6b-9cc8-beeab2c4f25d service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:40.732286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:40.737706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc77d7b-7a97-4a6b-9cc8-beeab2c4f25d service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:40.743733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:40.744673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:40.745150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:40.745429 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] PATH_INFO: `/v3/users/64b108e279bc4dc78bee652b585b950a` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:40.746634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b108e279bc4dc78bee652b585b950a)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:40.748696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:40.970942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b108e279bc4dc78bee652b585b950a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:40.987081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b108e279bc4dc78bee652b585b950a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:40.987081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b108e279bc4dc78bee652b585b950a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:41.081856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b108e279bc4dc78bee652b585b950a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:41.082839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b108e279bc4dc78bee652b585b950a'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:41.111806 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1222/2442] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:55:40 2022] DELETE /identity/v3/users/64b108e279bc4dc78bee652b585b950a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:55:41.117991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e545c-0d82-4238-b632-c08c01aecbb0 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:41.118589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e545c-0d82-4238-b632-c08c01aecbb0 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:41.118589 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e545c-0d82-4238-b632-c08c01aecbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:41.140343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-1e4e545c-0d82-4238-b632-c08c01aecbb0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:55:41.141686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-1e4e545c-0d82-4238-b632-c08c01aecbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:41.210830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1221/2443] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:55:41.221257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:41.223118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:41.304562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae364a-dc6e-4810-8fbf-b6a4fcee08b0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:41.308912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de626cd-59f5-4db8-9a62-e542372b3823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:41.309836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de626cd-59f5-4db8-9a62-e542372b3823 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:41.309836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de626cd-59f5-4db8-9a62-e542372b3823 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:41.310156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de626cd-59f5-4db8-9a62-e542372b3823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:41.322081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de626cd-59f5-4db8-9a62-e542372b3823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:41.323690 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de626cd-59f5-4db8-9a62-e542372b3823 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:41.336139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1223/2444] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:55:42.060569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e545c-0d82-4238-b632-c08c01aecbb0 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:42.064352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-1e4e545c-0d82-4238-b632-c08c01aecbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:42.091248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e545c-0d82-4238-b632-c08c01aecbb0 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:42.095200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de626cd-59f5-4db8-9a62-e542372b3823 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:42.098437 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:42.099603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:42.100934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:42.101290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] PATH_INFO: `/v3/projects/d99e33b948d34ffb889afe9c3a1e3615` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:42.102635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d99e33b948d34ffb889afe9c3a1e3615)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:42.104709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:42.112898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de626cd-59f5-4db8-9a62-e542372b3823 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:42.119082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc5067-755d-47b3-ba4a-ea0e2908fff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:42.120007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc5067-755d-47b3-ba4a-ea0e2908fff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:42.120424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc5067-755d-47b3-ba4a-ea0e2908fff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:42.120879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc5067-755d-47b3-ba4a-ea0e2908fff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:42.123388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-69bc5067-755d-47b3-ba4a-ea0e2908fff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:42.247368 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc5067-755d-47b3-ba4a-ea0e2908fff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:42.249817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc5067-755d-47b3-ba4a-ea0e2908fff1 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:42.269261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1224/2445] 10.222.0.83 () {60 vars in 1396 bytes} [Mon Aug 29 21:55:42 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:55:42.370405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd99e33b948d34ffb889afe9c3a1e3615', 'request_id': 'req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:42.400720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd99e33b948d34ffb889afe9c3a1e3615', 'request_id': 'req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:42.594942 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd99e33b948d34ffb889afe9c3a1e3615', 'request_id': 'req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:42.620968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] The token cache is being invalidate because project d99e33b948d34ffb889afe9c3a1e3615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:55:42.621633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:42.701816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:55:42.701816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1222/2446] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:55:42 2022] DELETE /identity/v3/projects/d99e33b948d34ffb889afe9c3a1e3615 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:55:52.261481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:52.615043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:55:53.090398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7488-11be-4adb-923b-9f5e2e652af0 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:53.090880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7488-11be-4adb-923b-9f5e2e652af0 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:53.091185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da7488-11be-4adb-923b-9f5e2e652af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:53.120068 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-82da7488-11be-4adb-923b-9f5e2e652af0 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:55:53.121358 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-82da7488-11be-4adb-923b-9f5e2e652af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:53.189808 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1225/2447] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:55:53.219922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:53.221648 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:53.311055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee89df-9dc2-4409-a7de-f5ec69ef38dc admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:53.316785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44afea-280e-4290-9c18-07c41a15d1cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:53.317480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44afea-280e-4290-9c18-07c41a15d1cc service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:53.317692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44afea-280e-4290-9c18-07c41a15d1cc service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:53.317970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44afea-280e-4290-9c18-07c41a15d1cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:53.327769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44afea-280e-4290-9c18-07c41a15d1cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:53.329426 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44afea-280e-4290-9c18-07c41a15d1cc service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:53.341269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1223/2448] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:55:58.909503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa9b6-33ac-4a87-b1a1-0497df9fc8ab None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:58.910050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa9b6-33ac-4a87-b1a1-0497df9fc8ab None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:58.910050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aa9b6-33ac-4a87-b1a1-0497df9fc8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:58.932475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d55aa9b6-33ac-4a87-b1a1-0497df9fc8ab None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:55:58.933814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d55aa9b6-33ac-4a87-b1a1-0497df9fc8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:58.942326 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1226/2449] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:55:58.973065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44afea-280e-4290-9c18-07c41a15d1cc service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:55:58.974514 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-de44afea-280e-4290-9c18-07c41a15d1cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:55:58.990266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44afea-280e-4290-9c18-07c41a15d1cc service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:55:59.008862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f021c7d-e894-4c0f-b221-1e1edb0aab0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:55:59.010889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f021c7d-e894-4c0f-b221-1e1edb0aab0e service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:55:59.011380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f021c7d-e894-4c0f-b221-1e1edb0aab0e service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:55:59.011859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f021c7d-e894-4c0f-b221-1e1edb0aab0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:55:59.025158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f021c7d-e894-4c0f-b221-1e1edb0aab0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:55:59.026939 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f021c7d-e894-4c0f-b221-1e1edb0aab0e service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:55:59.039257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1224/2450] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:56:03.661452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e621bb-8be1-42b5-b8d5-89a91a0d6491 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:03.662013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e621bb-8be1-42b5-b8d5-89a91a0d6491 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:03.662133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e621bb-8be1-42b5-b8d5-89a91a0d6491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:03.683183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-69e621bb-8be1-42b5-b8d5-89a91a0d6491 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:56:03.684371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-69e621bb-8be1-42b5-b8d5-89a91a0d6491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:03.692824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1227/2451] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:56:03.735772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f021c7d-e894-4c0f-b221-1e1edb0aab0e service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:03.747998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f021c7d-e894-4c0f-b221-1e1edb0aab0e service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:03.753973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08360195-2b93-43e6-9fa7-50e1720f16cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:03.754603 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08360195-2b93-43e6-9fa7-50e1720f16cd service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:03.754881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08360195-2b93-43e6-9fa7-50e1720f16cd service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:03.755157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08360195-2b93-43e6-9fa7-50e1720f16cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:03.764056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08360195-2b93-43e6-9fa7-50e1720f16cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:03.765649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08360195-2b93-43e6-9fa7-50e1720f16cd service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:03.775929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1225/2452] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:56:07.916322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb828f-3fc0-4d0e-a18c-b8e86ac81e69 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:07.916890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb828f-3fc0-4d0e-a18c-b8e86ac81e69 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:07.916890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb828f-3fc0-4d0e-a18c-b8e86ac81e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:07.939009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-1adb828f-3fc0-4d0e-a18c-b8e86ac81e69 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:56:07.940238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1adb828f-3fc0-4d0e-a18c-b8e86ac81e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:07.948393 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1228/2453] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:56:07.979064 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08360195-2b93-43e6-9fa7-50e1720f16cd service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:07.992029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08360195-2b93-43e6-9fa7-50e1720f16cd service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:07.999733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008b7d-4ecf-4f2d-99c0-0fd2744bf670 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:08.000593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008b7d-4ecf-4f2d-99c0-0fd2744bf670 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:08.000994 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008b7d-4ecf-4f2d-99c0-0fd2744bf670 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:08.001418 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f008b7d-4ecf-4f2d-99c0-0fd2744bf670 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:08.015582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f008b7d-4ecf-4f2d-99c0-0fd2744bf670 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:08.017429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f008b7d-4ecf-4f2d-99c0-0fd2744bf670 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:08.028017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1226/2454] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:56:12.206072 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ae0b8-58b3-4425-a748-8b754826def6 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:12.206675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ae0b8-58b3-4425-a748-8b754826def6 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:12.206675 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ae0b8-58b3-4425-a748-8b754826def6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:12.233122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-818ae0b8-58b3-4425-a748-8b754826def6 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:56:12.233122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-818ae0b8-58b3-4425-a748-8b754826def6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:12.239864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1229/2455] 10.222.0.121 () {58 vars in 1017 bytes} [Mon Aug 29 21:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:56:12.265057 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008b7d-4ecf-4f2d-99c0-0fd2744bf670 service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:12.277748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f008b7d-4ecf-4f2d-99c0-0fd2744bf670 service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:12.283896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0e75d-a1bd-46e6-9daa-3ecf73a8c0bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:12.284537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0e75d-a1bd-46e6-9daa-3ecf73a8c0bf service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:12.284829 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0e75d-a1bd-46e6-9daa-3ecf73a8c0bf service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:12.285139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0e75d-a1bd-46e6-9daa-3ecf73a8c0bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:12.295060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0e75d-a1bd-46e6-9daa-3ecf73a8c0bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:12.296689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0e75d-a1bd-46e6-9daa-3ecf73a8c0bf service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:12.306878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1227/2456] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:56:14.989053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ae0b8-58b3-4425-a748-8b754826def6 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:14.991500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-818ae0b8-58b3-4425-a748-8b754826def6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:15.089828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ae0b8-58b3-4425-a748-8b754826def6 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:15.093776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073386d9-a76f-4c55-a31e-e2f18b7e21be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:15.094402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073386d9-a76f-4c55-a31e-e2f18b7e21be service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:15.094679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073386d9-a76f-4c55-a31e-e2f18b7e21be service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:15.094948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073386d9-a76f-4c55-a31e-e2f18b7e21be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:15.096869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-073386d9-a76f-4c55-a31e-e2f18b7e21be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:15.108420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073386d9-a76f-4c55-a31e-e2f18b7e21be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:15.109909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073386d9-a76f-4c55-a31e-e2f18b7e21be service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:15.119840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1230/2457] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:56:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:56:16.513659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0e75d-a1bd-46e6-9daa-3ecf73a8c0bf service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:16.526779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0e75d-a1bd-46e6-9daa-3ecf73a8c0bf service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:16.534533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67044fe-10fa-4a91-ae85-ea559fe492df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:16.535077 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67044fe-10fa-4a91-ae85-ea559fe492df service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:16.535359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67044fe-10fa-4a91-ae85-ea559fe492df service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:16.535635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67044fe-10fa-4a91-ae85-ea559fe492df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:16.537562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a67044fe-10fa-4a91-ae85-ea559fe492df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:16.616787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67044fe-10fa-4a91-ae85-ea559fe492df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:16.616787 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67044fe-10fa-4a91-ae85-ea559fe492df service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:16.623310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1228/2458] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:56:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:56:25.115186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=65 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:26.284214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073386d9-a76f-4c55-a31e-e2f18b7e21be service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:26.300977 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073386d9-a76f-4c55-a31e-e2f18b7e21be service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:26.307536 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef1114-c5a5-442d-a774-8f149a40ebbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:26.308171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef1114-c5a5-442d-a774-8f149a40ebbf service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:26.309073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef1114-c5a5-442d-a774-8f149a40ebbf service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:26.309073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef1114-c5a5-442d-a774-8f149a40ebbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:26.311230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c6ef1114-c5a5-442d-a774-8f149a40ebbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:26.331257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef1114-c5a5-442d-a774-8f149a40ebbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:26.333718 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef1114-c5a5-442d-a774-8f149a40ebbf service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:26.350795 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1231/2459] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:56:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:56:26.619075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=86 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:36.343792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:48.281520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa987a1-39ff-487d-8210-a1f00e7df0d1 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:48.281520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa987a1-39ff-487d-8210-a1f00e7df0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:48.281520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa987a1-39ff-487d-8210-a1f00e7df0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:48.357606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-4fa987a1-39ff-487d-8210-a1f00e7df0d1 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:56:48.359249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4fa987a1-39ff-487d-8210-a1f00e7df0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:48.373682 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef1114-c5a5-442d-a774-8f149a40ebbf service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:48.472158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef1114-c5a5-442d-a774-8f149a40ebbf service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:48.477073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1229/2460] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:56:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:56:48.483931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e4bb9-dc73-4701-8936-7a17fb3362f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:48.483931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e4bb9-dc73-4701-8936-7a17fb3362f8 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:48.483931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e4bb9-dc73-4701-8936-7a17fb3362f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:48.483931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e4bb9-dc73-4701-8936-7a17fb3362f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:48.484408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1c3e4bb9-dc73-4701-8936-7a17fb3362f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:48.497528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e4bb9-dc73-4701-8936-7a17fb3362f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:48.499118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e4bb9-dc73-4701-8936-7a17fb3362f8 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:48.525897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1232/2461] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:56:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:56:48.681613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa987a1-39ff-487d-8210-a1f00e7df0d1 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:48.683060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4fa987a1-39ff-487d-8210-a1f00e7df0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:48.778625 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa987a1-39ff-487d-8210-a1f00e7df0d1 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:48.784246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a455d45-57e9-4bd5-a27c-de7337cc13cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:48.786575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a455d45-57e9-4bd5-a27c-de7337cc13cc service swift] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:48.786575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a455d45-57e9-4bd5-a27c-de7337cc13cc service swift] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:48.786575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a455d45-57e9-4bd5-a27c-de7337cc13cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:48.794739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a455d45-57e9-4bd5-a27c-de7337cc13cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:48.796378 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a455d45-57e9-4bd5-a27c-de7337cc13cc service swift] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:48.807383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1230/2462] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:56:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:56:50.761365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0759ef-b4b0-49f0-b196-da5d018c225c None None] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:50.763166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0759ef-b4b0-49f0-b196-da5d018c225c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:50.763166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0759ef-b4b0-49f0-b196-da5d018c225c None None] PATH_INFO: `/` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:50.764871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1233/2463] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:56:50.771093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fb172-3cc7-4be9-a0f7-75a7817c3a30 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:50.772136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fb172-3cc7-4be9-a0f7-75a7817c3a30 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:50.772254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fb172-3cc7-4be9-a0f7-75a7817c3a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:50.824056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-299fb172-3cc7-4be9-a0f7-75a7817c3a30 None None] MFA Rules not processed for user `2adcc3ba3bdf4b92bd719f60e0b263ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:56:50.825421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-299fb172-3cc7-4be9-a0f7-75a7817c3a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:50.876723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0759ef-b4b0-49f0-b196-da5d018c225c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:50.879002 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9e0759ef-b4b0-49f0-b196-da5d018c225c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:50.882622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1231/2464] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:56:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:56:50.897950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0759ef-b4b0-49f0-b196-da5d018c225c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:50.902208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c1506-8701-4159-b1ad-2fd2c863383f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:50.903196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c1506-8701-4159-b1ad-2fd2c863383f service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:50.903631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c1506-8701-4159-b1ad-2fd2c863383f service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:50.904133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c1506-8701-4159-b1ad-2fd2c863383f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:50.914495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c1506-8701-4159-b1ad-2fd2c863383f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:50.916063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c1506-8701-4159-b1ad-2fd2c863383f service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:50.949928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1234/2465] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:56:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:56:51.130782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b0d7f-2154-4691-88e8-dcea239ef018 None None] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:51.131846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b0d7f-2154-4691-88e8-dcea239ef018 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:51.132198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b0d7f-2154-4691-88e8-dcea239ef018 None None] PATH_INFO: `/` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:51.134119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1232/2466] 10.222.0.83 () {54 vars in 921 bytes} [Mon Aug 29 21:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 21:56:51.144045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed69f-6216-4dc6-84d1-153a478495ca None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:51.144443 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed69f-6216-4dc6-84d1-153a478495ca None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:51.144832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed69f-6216-4dc6-84d1-153a478495ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:51.183064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d55ed69f-6216-4dc6-84d1-153a478495ca None None] MFA Rules not processed for user `8434659c6b164b97b5ac27fb7e4d6a26`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:56:51.184434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d55ed69f-6216-4dc6-84d1-153a478495ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:51.194475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1235/2467] 10.222.0.83 () {58 vars in 1018 bytes} [Mon Aug 29 21:56:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:56:51.207101 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b0d7f-2154-4691-88e8-dcea239ef018 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:51.224022 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b0d7f-2154-4691-88e8-dcea239ef018 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:51.235860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bcffc-69ab-4b54-aa72-2abef54d05e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:51.235860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bcffc-69ab-4b54-aa72-2abef54d05e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:51.235860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bcffc-69ab-4b54-aa72-2abef54d05e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:51.235860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bcffc-69ab-4b54-aa72-2abef54d05e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:51.249521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bcffc-69ab-4b54-aa72-2abef54d05e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:51.251161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bcffc-69ab-4b54-aa72-2abef54d05e9 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:51.267474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1233/2468] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:56:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:56:51.355995 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ed69f-6216-4dc6-84d1-153a478495ca None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:51.357484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d55ed69f-6216-4dc6-84d1-153a478495ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:51.467986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ed69f-6216-4dc6-84d1-153a478495ca None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:51.468946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64901a6-2594-43d9-9867-61e9f2579692 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca09f6fe11f4b878dd11c4cb69ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:51.470461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64901a6-2594-43d9-9867-61e9f2579692 service placement] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:51.470983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64901a6-2594-43d9-9867-61e9f2579692 service placement] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:51.471755 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64901a6-2594-43d9-9867-61e9f2579692 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:51.482852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f64901a6-2594-43d9-9867-61e9f2579692 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:51.552211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64901a6-2594-43d9-9867-61e9f2579692 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:51.552211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64901a6-2594-43d9-9867-61e9f2579692 service placement] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:51.589351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1236/2469] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:56:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:56:55.627184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bcffc-69ab-4b54-aa72-2abef54d05e9 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:55.630462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fb4bcffc-69ab-4b54-aa72-2abef54d05e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:56:55.658600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:55.698874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bcffc-69ab-4b54-aa72-2abef54d05e9 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:55.704407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:55.705400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:55.705759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:55.706106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] PATH_INFO: `/v3/users/9f617d6e3f3444cda7307794d7b8d837` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:55.707836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f617d6e3f3444cda7307794d7b8d837)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:55.711066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:55.926594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f617d6e3f3444cda7307794d7b8d837'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:56:55.937385 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f617d6e3f3444cda7307794d7b8d837'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:56:55.938433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f617d6e3f3444cda7307794d7b8d837'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:56:56.023089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f617d6e3f3444cda7307794d7b8d837'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:56:56.046170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f617d6e3f3444cda7307794d7b8d837'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:56:56.053972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1234/2470] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:56:55 2022] DELETE /identity/v3/users/9f617d6e3f3444cda7307794d7b8d837 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:56:56.869255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64901a6-2594-43d9-9867-61e9f2579692 service placement] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:56:56.904835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64901a6-2594-43d9-9867-61e9f2579692 service placement] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:56:56.984586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:56:56.985166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:56:56.985591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:56:56.985869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] PATH_INFO: `/v3/projects/1515d87b44484ec4904ec2303c9f1f33` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:56:56.987050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1515d87b44484ec4904ec2303c9f1f33)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:56:56.989029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:56:57.108475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:56:57.133994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1515d87b44484ec4904ec2303c9f1f33', 'request_id': 'req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:56:57.145192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1515d87b44484ec4904ec2303c9f1f33', 'request_id': 'req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:56:57.228398 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1515d87b44484ec4904ec2303c9f1f33', 'request_id': 'req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:56:57.255434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] The token cache is being invalidate because project 1515d87b44484ec4904ec2303c9f1f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:56:57.258673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:56:57.258673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:56:57.258673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1237/2471] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:56:56 2022] DELETE /identity/v3/projects/1515d87b44484ec4904ec2303c9f1f33 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:02.426127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:02.426127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:02.518834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d855387-5fda-4043-96c5-93a6f2cb34a9 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:02.580038 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:02.595119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362263-eafe-4c26-b4c4-46a7e105cc83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:02.595751 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362263-eafe-4c26-b4c4-46a7e105cc83 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:02.596039 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362263-eafe-4c26-b4c4-46a7e105cc83 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:02.596307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd362263-eafe-4c26-b4c4-46a7e105cc83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:02.600623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bd362263-eafe-4c26-b4c4-46a7e105cc83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:02.696843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd362263-eafe-4c26-b4c4-46a7e105cc83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:02.699079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd362263-eafe-4c26-b4c4-46a7e105cc83 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:02.713670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1235/2472] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:07.599881 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:13.048768 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:13.050493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:13.113082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed75b7-bbc0-4dea-ac5e-decaaa4dc3cc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:13.118213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8ec48-21c9-4b7c-90a1-70ab29abc717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:13.118838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8ec48-21c9-4b7c-90a1-70ab29abc717 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:13.119114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8ec48-21c9-4b7c-90a1-70ab29abc717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:13.119389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8ec48-21c9-4b7c-90a1-70ab29abc717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:13.121177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f1e8ec48-21c9-4b7c-90a1-70ab29abc717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:13.208824 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8ec48-21c9-4b7c-90a1-70ab29abc717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:13.211542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8ec48-21c9-4b7c-90a1-70ab29abc717 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:13.227885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1238/2473] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:13.342735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=31 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:16.708181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362263-eafe-4c26-b4c4-46a7e105cc83 service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:16.719758 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd362263-eafe-4c26-b4c4-46a7e105cc83 service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:16.724171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf428f-0ae4-4a93-b738-11b870e639c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:16.726602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf428f-0ae4-4a93-b738-11b870e639c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:16.727031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf428f-0ae4-4a93-b738-11b870e639c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:16.727230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf428f-0ae4-4a93-b738-11b870e639c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:16.729269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-94cf428f-0ae4-4a93-b738-11b870e639c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:16.743476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf428f-0ae4-4a93-b738-11b870e639c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:16.746568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf428f-0ae4-4a93-b738-11b870e639c3 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:16.764601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1236/2474] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:18.598678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8ec48-21c9-4b7c-90a1-70ab29abc717 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:18.601463 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f1e8ec48-21c9-4b7c-90a1-70ab29abc717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:18.733186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8ec48-21c9-4b7c-90a1-70ab29abc717 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:18.741119 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee45e-6ee0-44ab-a12d-b37a34ed562c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca09f6fe11f4b878dd11c4cb69ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:18.742489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee45e-6ee0-44ab-a12d-b37a34ed562c service placement] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:18.742955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee45e-6ee0-44ab-a12d-b37a34ed562c service placement] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:18.744021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cee45e-6ee0-44ab-a12d-b37a34ed562c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:18.747931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-68cee45e-6ee0-44ab-a12d-b37a34ed562c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:18.762367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf428f-0ae4-4a93-b738-11b870e639c3 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:18.764407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-94cf428f-0ae4-4a93-b738-11b870e639c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:18.778419 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cee45e-6ee0-44ab-a12d-b37a34ed562c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:18.781269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cee45e-6ee0-44ab-a12d-b37a34ed562c service placement] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:18.794633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1239/2475] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:18.803709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf428f-0ae4-4a93-b738-11b870e639c3 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:18.824404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:18.825491 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:18.826238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:18.826704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] PATH_INFO: `/v3/users/3575098818954a949e202397a1b20a6a` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:18.828339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3575098818954a949e202397a1b20a6a)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:18.830695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:19.061029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3575098818954a949e202397a1b20a6a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:19.072596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3575098818954a949e202397a1b20a6a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:19.073588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3575098818954a949e202397a1b20a6a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:19.187888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3575098818954a949e202397a1b20a6a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:19.204756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3697a29d-5800-4579-92c6-df4e9c0d63f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3575098818954a949e202397a1b20a6a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:19.217552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1237/2476] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:57:18 2022] DELETE /identity/v3/users/3575098818954a949e202397a1b20a6a => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:19.639215 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee45e-6ee0-44ab-a12d-b37a34ed562c service placement] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:19.654050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cee45e-6ee0-44ab-a12d-b37a34ed562c service placement] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:19.706608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:19.728860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:19.729594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:19.729913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:19.730245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] PATH_INFO: `/v3/projects/f8ca070dc59e4a69bdaca0150f92bcc4` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:19.731789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ca070dc59e4a69bdaca0150f92bcc4)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:19.736323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:19.896033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'request_id': 'req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:19.902031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'request_id': 'req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:19.976391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ca070dc59e4a69bdaca0150f92bcc4', 'request_id': 'req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:19.989612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] The token cache is being invalidate because project f8ca070dc59e4a69bdaca0150f92bcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:57:19.990487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:19.991208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0fb67b5a-2d8f-4dcf-9e84-5d50a1bb7703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:19.992869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1240/2477] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:57:19 2022] DELETE /identity/v3/projects/f8ca070dc59e4a69bdaca0150f92bcc4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:19.997963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a125a-42c1-4f2e-876a-10ba1b7aae3c None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:19.998697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a125a-42c1-4f2e-876a-10ba1b7aae3c None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:19.998697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a125a-42c1-4f2e-876a-10ba1b7aae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:20.058494 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-115a125a-42c1-4f2e-876a-10ba1b7aae3c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:20.059747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-115a125a-42c1-4f2e-876a-10ba1b7aae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:20.152710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1238/2478] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:20.161125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f89a18-cefc-429f-9802-81bf33422021 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:20.161569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f89a18-cefc-429f-9802-81bf33422021 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:20.162036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f89a18-cefc-429f-9802-81bf33422021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:20.185303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f3f89a18-cefc-429f-9802-81bf33422021 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:20.186560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f3f89a18-cefc-429f-9802-81bf33422021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:20.195779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1241/2479] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:57:20.201452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a125a-42c1-4f2e-876a-10ba1b7aae3c None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:20.214190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a125a-42c1-4f2e-876a-10ba1b7aae3c None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:20.220525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43babb51-29de-46e0-b6cc-557bf0f839a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:20.221266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43babb51-29de-46e0-b6cc-557bf0f839a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:20.221618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43babb51-29de-46e0-b6cc-557bf0f839a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:20.221962 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43babb51-29de-46e0-b6cc-557bf0f839a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:20.222709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43babb51-29de-46e0-b6cc-557bf0f839a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:57:20.223085 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43babb51-29de-46e0-b6cc-557bf0f839a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:20.224905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43babb51-29de-46e0-b6cc-557bf0f839a2 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:20.249438 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1239/2480] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:57:20.251207 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f89a18-cefc-429f-9802-81bf33422021 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:20.262941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f89a18-cefc-429f-9802-81bf33422021 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:20.269591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395a470-b50c-431a-ad6d-2202d53c86a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:20.270528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395a470-b50c-431a-ad6d-2202d53c86a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:20.270805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395a470-b50c-431a-ad6d-2202d53c86a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:20.271077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395a470-b50c-431a-ad6d-2202d53c86a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:20.271759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395a470-b50c-431a-ad6d-2202d53c86a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:20.273911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395a470-b50c-431a-ad6d-2202d53c86a9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:20.414820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1242/2481] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:57:20 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:20.419421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43babb51-29de-46e0-b6cc-557bf0f839a2 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:20.434931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43babb51-29de-46e0-b6cc-557bf0f839a2 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:20.466199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:20.518843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a56a5-604b-4b89-9279-76c295cf74ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:20.519458 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a56a5-604b-4b89-9279-76c295cf74ef admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:20.519744 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a56a5-604b-4b89-9279-76c295cf74ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:20.520020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a56a5-604b-4b89-9279-76c295cf74ef admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:20.520724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a56a5-604b-4b89-9279-76c295cf74ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:20.522811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a56a5-604b-4b89-9279-76c295cf74ef admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:20.630535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1240/2482] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:57:20 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:57:20.632102 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395a470-b50c-431a-ad6d-2202d53c86a9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:20.645501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395a470-b50c-431a-ad6d-2202d53c86a9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:20.651524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37a59-ea80-4fc1-a9c4-5baa501a0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:20.652177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37a59-ea80-4fc1-a9c4-5baa501a0152 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:20.652456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37a59-ea80-4fc1-a9c4-5baa501a0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:20.652755 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db37a59-ea80-4fc1-a9c4-5baa501a0152 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:20.653406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37a59-ea80-4fc1-a9c4-5baa501a0152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:20.655062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db37a59-ea80-4fc1-a9c4-5baa501a0152 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:20.670320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1243/2483] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:57:20.671487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a56a5-604b-4b89-9279-76c295cf74ef admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:20.682649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a56a5-604b-4b89-9279-76c295cf74ef admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:20.687847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22a14e-af91-499c-925b-bbcde095bc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:20.688471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22a14e-af91-499c-925b-bbcde095bc05 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:20.688790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22a14e-af91-499c-925b-bbcde095bc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:20.689106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22a14e-af91-499c-925b-bbcde095bc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:20.689708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22a14e-af91-499c-925b-bbcde095bc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:20.691344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22a14e-af91-499c-925b-bbcde095bc05 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:20.703837 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1241/2484] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:57:20.708260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37a59-ea80-4fc1-a9c4-5baa501a0152 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:20.723671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db37a59-ea80-4fc1-a9c4-5baa501a0152 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:20.735616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff95641-617e-417a-b099-3ec01ee30ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:20.736582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff95641-617e-417a-b099-3ec01ee30ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:20.736957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff95641-617e-417a-b099-3ec01ee30ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:20.737323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff95641-617e-417a-b099-3ec01ee30ac7 admin admin] PATH_INFO: `/v3/projects/926837c28a3743deab8a4849571ecd19/users/3a878450743f4843a5e8cc04ca94184d/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:20.757910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff95641-617e-417a-b099-3ec01ee30ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926837c28a3743deab8a4849571ecd19, user_id=3a878450743f4843a5e8cc04ca94184d, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:20.761321 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff95641-617e-417a-b099-3ec01ee30ac7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:20.873874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1244/2485] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:57:20 2022] PUT /identity/v3/projects/926837c28a3743deab8a4849571ecd19/users/3a878450743f4843a5e8cc04ca94184d/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:20.879488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755bb1b-7a73-45bc-ae21-58f43e0216f6 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:20.879767 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755bb1b-7a73-45bc-ae21-58f43e0216f6 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:20.880043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755bb1b-7a73-45bc-ae21-58f43e0216f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:20.902321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-d755bb1b-7a73-45bc-ae21-58f43e0216f6 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:20.903565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d755bb1b-7a73-45bc-ae21-58f43e0216f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:21.013183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1242/2486] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:21.029200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff95641-617e-417a-b099-3ec01ee30ac7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:21.038104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8ff95641-617e-417a-b099-3ec01ee30ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:21.105737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff95641-617e-417a-b099-3ec01ee30ac7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:21.109660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc3f6-2097-4eb4-bfb8-95cff2ef94c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:21.110872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc3f6-2097-4eb4-bfb8-95cff2ef94c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:21.111150 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc3f6-2097-4eb4-bfb8-95cff2ef94c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:21.111422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bc3f6-2097-4eb4-bfb8-95cff2ef94c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:21.122474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bc3f6-2097-4eb4-bfb8-95cff2ef94c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:21.124000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64bc3f6-2097-4eb4-bfb8-95cff2ef94c2 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:21.129353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:21.135228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1245/2487] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:57:21.297610 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd08a-ff8c-4474-a20e-97bb74f42560 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:21.297897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd08a-ff8c-4474-a20e-97bb74f42560 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:21.298171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bd08a-ff8c-4474-a20e-97bb74f42560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:21.322887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e53bd08a-ff8c-4474-a20e-97bb74f42560 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:21.324153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e53bd08a-ff8c-4474-a20e-97bb74f42560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:21.396271 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1243/2488] 10.222.0.83 () {58 vars in 1009 bytes} [Mon Aug 29 21:57:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:21.410294 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc3f6-2097-4eb4-bfb8-95cff2ef94c2 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:21.411979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c64bc3f6-2097-4eb4-bfb8-95cff2ef94c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:21.502621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bc3f6-2097-4eb4-bfb8-95cff2ef94c2 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:21.508887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d330ff-e1bf-4a96-87dc-b0ba487ad29d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:21.509591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d330ff-e1bf-4a96-87dc-b0ba487ad29d service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:21.509866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d330ff-e1bf-4a96-87dc-b0ba487ad29d service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:21.510136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d330ff-e1bf-4a96-87dc-b0ba487ad29d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:21.523264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d330ff-e1bf-4a96-87dc-b0ba487ad29d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:21.523264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d330ff-e1bf-4a96-87dc-b0ba487ad29d service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:21.530259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1246/2489] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:57:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:57:25.184221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd08a-ff8c-4474-a20e-97bb74f42560 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:25.207072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bd08a-ff8c-4474-a20e-97bb74f42560 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:25.220233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973b01f-5258-4c94-a887-f73dd358b69b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:25.221197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973b01f-5258-4c94-a887-f73dd358b69b service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:25.221517 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973b01f-5258-4c94-a887-f73dd358b69b service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:25.221847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973b01f-5258-4c94-a887-f73dd358b69b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:25.224991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0973b01f-5258-4c94-a887-f73dd358b69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:25.245988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973b01f-5258-4c94-a887-f73dd358b69b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:25.248071 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973b01f-5258-4c94-a887-f73dd358b69b service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:25.277097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1244/2490] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:31.286425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fd564-4047-49b0-8e7e-c64781b9a296 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:31.287177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fd564-4047-49b0-8e7e-c64781b9a296 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:31.287177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fd564-4047-49b0-8e7e-c64781b9a296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:31.339961 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d90fd564-4047-49b0-8e7e-c64781b9a296 None None] MFA Rules not processed for user `3a878450743f4843a5e8cc04ca94184d`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:31.341724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d90fd564-4047-49b0-8e7e-c64781b9a296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:31.470979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1247/2491] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:31.486123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973b01f-5258-4c94-a887-f73dd358b69b service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:31.487670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0973b01f-5258-4c94-a887-f73dd358b69b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:31.542697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:31.596126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973b01f-5258-4c94-a887-f73dd358b69b service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:31.608664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124171-c081-4512-9a23-c69ca748aeda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:31.609621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124171-c081-4512-9a23-c69ca748aeda service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:31.610147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124171-c081-4512-9a23-c69ca748aeda service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:31.610657 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124171-c081-4512-9a23-c69ca748aeda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:31.644011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e124171-c081-4512-9a23-c69ca748aeda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:31.644011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e124171-c081-4512-9a23-c69ca748aeda service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:31.655475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1245/2492] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:33.381747 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fd564-4047-49b0-8e7e-c64781b9a296 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:33.384453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d90fd564-4047-49b0-8e7e-c64781b9a296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:33.486736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fd564-4047-49b0-8e7e-c64781b9a296 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:33.496270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08511a97-b7d3-454c-8e06-ff596d3162c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca09f6fe11f4b878dd11c4cb69ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:33.496270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08511a97-b7d3-454c-8e06-ff596d3162c5 service placement] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:33.496270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08511a97-b7d3-454c-8e06-ff596d3162c5 service placement] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:33.496270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08511a97-b7d3-454c-8e06-ff596d3162c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:33.499517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-08511a97-b7d3-454c-8e06-ff596d3162c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:33.513711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08511a97-b7d3-454c-8e06-ff596d3162c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:33.515345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08511a97-b7d3-454c-8e06-ff596d3162c5 service placement] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:33.565115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1248/2493] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:33.565503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124171-c081-4512-9a23-c69ca748aeda service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:33.565503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9e124171-c081-4512-9a23-c69ca748aeda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:33.584259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124171-c081-4512-9a23-c69ca748aeda service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:33.594354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:33.599770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:33.599770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:33.599770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] PATH_INFO: `/v3/users/ed8ef9f9eafd4248bae86f0e8ec72731` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:33.599770 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8ef9f9eafd4248bae86f0e8ec72731)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:33.606817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:33.926091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8ef9f9eafd4248bae86f0e8ec72731'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:33.934112 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8ef9f9eafd4248bae86f0e8ec72731'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:33.935364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8ef9f9eafd4248bae86f0e8ec72731'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:34.006509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8ef9f9eafd4248bae86f0e8ec72731'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:34.027888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4e303189-ff8b-4a12-bc97-bee9f85deff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8ef9f9eafd4248bae86f0e8ec72731'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:34.040502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1246/2494] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:57:33 2022] DELETE /identity/v3/users/ed8ef9f9eafd4248bae86f0e8ec72731 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:34.366850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08511a97-b7d3-454c-8e06-ff596d3162c5 service placement] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:34.389035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08511a97-b7d3-454c-8e06-ff596d3162c5 service placement] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:34.402058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:34.479034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:34.479910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:34.480303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:34.481659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] PATH_INFO: `/v3/projects/d45ce54651ad4326bccecbeea8b5b084` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:34.487116 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45ce54651ad4326bccecbeea8b5b084)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:34.489493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:34.705500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45ce54651ad4326bccecbeea8b5b084', 'request_id': 'req-a63ddf57-2949-493f-afaf-2da130badaed'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:34.733357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45ce54651ad4326bccecbeea8b5b084', 'request_id': 'req-a63ddf57-2949-493f-afaf-2da130badaed'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:34.857216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45ce54651ad4326bccecbeea8b5b084', 'request_id': 'req-a63ddf57-2949-493f-afaf-2da130badaed'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:34.888133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] The token cache is being invalidate because project d45ce54651ad4326bccecbeea8b5b084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:57:34.888677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:34.891099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a63ddf57-2949-493f-afaf-2da130badaed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:34.894075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1249/2495] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:57:34 2022] DELETE /identity/v3/projects/d45ce54651ad4326bccecbeea8b5b084 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:34.900963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6550c-8582-40e6-a045-1a72c827ac97 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:34.901929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6550c-8582-40e6-a045-1a72c827ac97 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:34.902360 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6550c-8582-40e6-a045-1a72c827ac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:34.940627 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e4e6550c-8582-40e6-a045-1a72c827ac97 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:34.942174 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e4e6550c-8582-40e6-a045-1a72c827ac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:35.078146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1247/2496] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:35.079853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abf3d-24eb-477b-98f3-f014cdde86ab None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:35.080141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abf3d-24eb-477b-98f3-f014cdde86ab None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:35.080435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543abf3d-24eb-477b-98f3-f014cdde86ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:35.110609 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-543abf3d-24eb-477b-98f3-f014cdde86ab None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:35.111479 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-543abf3d-24eb-477b-98f3-f014cdde86ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:35.124779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1250/2497] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:35.126668 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6550c-8582-40e6-a045-1a72c827ac97 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:35.138803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6550c-8582-40e6-a045-1a72c827ac97 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:35.144171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f020b4-4dc6-496c-8295-467905121adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:35.144898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f020b4-4dc6-496c-8295-467905121adf admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:35.145186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f020b4-4dc6-496c-8295-467905121adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:35.145466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f020b4-4dc6-496c-8295-467905121adf admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:35.146213 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f020b4-4dc6-496c-8295-467905121adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:57:35.146515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f020b4-4dc6-496c-8295-467905121adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:35.148222 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f020b4-4dc6-496c-8295-467905121adf admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:35.166127 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1248/2498] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:57:35.174273 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543abf3d-24eb-477b-98f3-f014cdde86ab None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:35.179237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543abf3d-24eb-477b-98f3-f014cdde86ab None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:35.186143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad6aae0-d045-41bb-80ea-431585d7f5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:35.186774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6aae0-d045-41bb-80ea-431585d7f5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:35.187046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6aae0-d045-41bb-80ea-431585d7f5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:35.187314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad6aae0-d045-41bb-80ea-431585d7f5d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:35.187955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6aae0-d045-41bb-80ea-431585d7f5d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:35.189930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad6aae0-d045-41bb-80ea-431585d7f5d6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:35.358644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1251/2499] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:57:35 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:35.362983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f020b4-4dc6-496c-8295-467905121adf admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:35.376433 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84692-6f0e-40c9-bc32-62ebc2a6b1b7 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:35.377223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84692-6f0e-40c9-bc32-62ebc2a6b1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:35.377604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba84692-6f0e-40c9-bc32-62ebc2a6b1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:35.384662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f020b4-4dc6-496c-8295-467905121adf admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:35.402480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-9ba84692-6f0e-40c9-bc32-62ebc2a6b1b7 None None] MFA Rules not processed for user `3a878450743f4843a5e8cc04ca94184d`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:35.403713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-9ba84692-6f0e-40c9-bc32-62ebc2a6b1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:35.415522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:35.473671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1252/2500] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:35.522805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f1336-d93f-43e5-a086-71f5255c198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:35.524259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f1336-d93f-43e5-a086-71f5255c198b admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:35.525067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f1336-d93f-43e5-a086-71f5255c198b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:35.525744 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f1336-d93f-43e5-a086-71f5255c198b admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:35.527396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f1336-d93f-43e5-a086-71f5255c198b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:35.531497 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f1336-d93f-43e5-a086-71f5255c198b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:35.724841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1249/2501] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:57:35 2022] POST /identity/v3/users => generated 287 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:35.727812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba84692-6f0e-40c9-bc32-62ebc2a6b1b7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:35.747264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba84692-6f0e-40c9-bc32-62ebc2a6b1b7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:35.756314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecac699-b06f-4196-b38f-b6f17df486d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:35.757431 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecac699-b06f-4196-b38f-b6f17df486d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:35.757917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecac699-b06f-4196-b38f-b6f17df486d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:35.758436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecac699-b06f-4196-b38f-b6f17df486d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:35.759661 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecac699-b06f-4196-b38f-b6f17df486d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:35.768210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecac699-b06f-4196-b38f-b6f17df486d1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:35.781220 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1253/2502] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:57:35.786574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f1336-d93f-43e5-a086-71f5255c198b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:35.806274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f1336-d93f-43e5-a086-71f5255c198b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:35.813408 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11f7e-d661-4e3f-9101-2f4ff5ef942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:35.814423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11f7e-d661-4e3f-9101-2f4ff5ef942d admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:35.815664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11f7e-d661-4e3f-9101-2f4ff5ef942d admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:35.816189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11f7e-d661-4e3f-9101-2f4ff5ef942d admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:35.817292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a11f7e-d661-4e3f-9101-2f4ff5ef942d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:35.819219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a11f7e-d661-4e3f-9101-2f4ff5ef942d admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:35.843020 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1250/2503] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:57:35.846826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecac699-b06f-4196-b38f-b6f17df486d1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:35.855543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:35.865286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecac699-b06f-4196-b38f-b6f17df486d1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:35.865286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e617c-9f6c-4489-8d55-156d7034cb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:35.866132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e617c-9f6c-4489-8d55-156d7034cb96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:35.866473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e617c-9f6c-4489-8d55-156d7034cb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:35.866815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e617c-9f6c-4489-8d55-156d7034cb96 admin admin] PATH_INFO: `/v3/projects/367162137f054d4a9a87931392fb375e/users/19655684a2d140779944ca800528754c/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:35.886412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e617c-9f6c-4489-8d55-156d7034cb96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=367162137f054d4a9a87931392fb375e, user_id=19655684a2d140779944ca800528754c, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:35.889598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e617c-9f6c-4489-8d55-156d7034cb96 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:35.976530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1254/2504] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:57:35 2022] PUT /identity/v3/projects/367162137f054d4a9a87931392fb375e/users/19655684a2d140779944ca800528754c/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:57:35.989315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c987e4c-560f-4dfb-8e57-d3f394ffa945 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:35.989891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c987e4c-560f-4dfb-8e57-d3f394ffa945 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:35.990278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c987e4c-560f-4dfb-8e57-d3f394ffa945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:36.033332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-2c987e4c-560f-4dfb-8e57-d3f394ffa945 None None] MFA Rules not processed for user `19655684a2d140779944ca800528754c`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:36.034789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2c987e4c-560f-4dfb-8e57-d3f394ffa945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:36.158406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1251/2505] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:36.163467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e617c-9f6c-4489-8d55-156d7034cb96 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:36.342926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e617c-9f6c-4489-8d55-156d7034cb96 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:36.355544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dad2a-717e-49c5-b244-d23ec9045243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:36.355544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dad2a-717e-49c5-b244-d23ec9045243 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:36.355936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dad2a-717e-49c5-b244-d23ec9045243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:36.356303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dad2a-717e-49c5-b244-d23ec9045243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:36.357387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dad2a-717e-49c5-b244-d23ec9045243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:36.360724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dad2a-717e-49c5-b244-d23ec9045243 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:36.517159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1255/2506] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:57:36 2022] POST /identity/v3/projects => generated 373 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:36.522505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c987e4c-560f-4dfb-8e57-d3f394ffa945 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:36.541807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c987e4c-560f-4dfb-8e57-d3f394ffa945 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:36.698568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62545783-ce63-4acd-85cf-83c8b0d155eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:36.699705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62545783-ce63-4acd-85cf-83c8b0d155eb admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:36.700342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62545783-ce63-4acd-85cf-83c8b0d155eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:36.701423 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62545783-ce63-4acd-85cf-83c8b0d155eb admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:36.712645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62545783-ce63-4acd-85cf-83c8b0d155eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:36.712645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62545783-ce63-4acd-85cf-83c8b0d155eb admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:36.863638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1252/2507] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:57:36 2022] POST /identity/v3/users => generated 293 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:36.864617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dad2a-717e-49c5-b244-d23ec9045243 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:36.878209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dad2a-717e-49c5-b244-d23ec9045243 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:36.891737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1518f6d-ee9b-4ff8-9bd8-605565f59ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:36.892807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1518f6d-ee9b-4ff8-9bd8-605565f59ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:36.896931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1518f6d-ee9b-4ff8-9bd8-605565f59ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:36.897228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1518f6d-ee9b-4ff8-9bd8-605565f59ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:36.902108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1518f6d-ee9b-4ff8-9bd8-605565f59ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:36.903902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1518f6d-ee9b-4ff8-9bd8-605565f59ccf admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:36.928268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1256/2508] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:57:36.932936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62545783-ce63-4acd-85cf-83c8b0d155eb admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:36.949588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62545783-ce63-4acd-85cf-83c8b0d155eb admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:36.966976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc00638-2eae-42d3-9958-1869c1332508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:36.967858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc00638-2eae-42d3-9958-1869c1332508 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:36.968243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc00638-2eae-42d3-9958-1869c1332508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:36.969438 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc00638-2eae-42d3-9958-1869c1332508 admin admin] PATH_INFO: `/v3/projects/d34f4dabd3ee445c84c29e44a8568ba6/users/83656ce7b0cf427dba7d915d181ba542/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:36.996377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc00638-2eae-42d3-9958-1869c1332508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34f4dabd3ee445c84c29e44a8568ba6, user_id=83656ce7b0cf427dba7d915d181ba542, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:37.007363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc00638-2eae-42d3-9958-1869c1332508 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:37.132643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1253/2509] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:57:36 2022] PUT /identity/v3/projects/d34f4dabd3ee445c84c29e44a8568ba6/users/83656ce7b0cf427dba7d915d181ba542/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:37.137159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1518f6d-ee9b-4ff8-9bd8-605565f59ccf admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:37.148130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1518f6d-ee9b-4ff8-9bd8-605565f59ccf admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:37.237251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25bf9c5-5be4-4d33-8294-8a06a8b83741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:37.238181 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bf9c5-5be4-4d33-8294-8a06a8b83741 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:37.238707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bf9c5-5be4-4d33-8294-8a06a8b83741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:37.238879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25bf9c5-5be4-4d33-8294-8a06a8b83741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:37.242097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bf9c5-5be4-4d33-8294-8a06a8b83741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:37.242097 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25bf9c5-5be4-4d33-8294-8a06a8b83741 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:37.259891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1257/2510] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:57:37.260776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc00638-2eae-42d3-9958-1869c1332508 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:37.277599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc00638-2eae-42d3-9958-1869c1332508 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:37.284008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3cda7-7e98-4345-a549-ebc6f786c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:37.284926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3cda7-7e98-4345-a549-ebc6f786c220 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:37.285348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3cda7-7e98-4345-a549-ebc6f786c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:37.285632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3cda7-7e98-4345-a549-ebc6f786c220 admin admin] PATH_INFO: `/v3/projects/d34f4dabd3ee445c84c29e44a8568ba6/users/83656ce7b0cf427dba7d915d181ba542/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:37.287922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3cda7-7e98-4345-a549-ebc6f786c220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34f4dabd3ee445c84c29e44a8568ba6, user_id=83656ce7b0cf427dba7d915d181ba542, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:37.291300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3cda7-7e98-4345-a549-ebc6f786c220 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:37.309402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1254/2511] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:57:37 2022] PUT /identity/v3/projects/d34f4dabd3ee445c84c29e44a8568ba6/users/83656ce7b0cf427dba7d915d181ba542/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:37.320840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065560d9-f40c-471a-8922-146b6776eb58 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:37.321294 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065560d9-f40c-471a-8922-146b6776eb58 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:37.321424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065560d9-f40c-471a-8922-146b6776eb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:37.352756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-065560d9-f40c-471a-8922-146b6776eb58 None None] MFA Rules not processed for user `83656ce7b0cf427dba7d915d181ba542`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:37.354066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-065560d9-f40c-471a-8922-146b6776eb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:37.429865 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1258/2512] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:37.442259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3cda7-7e98-4345-a549-ebc6f786c220 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:37.444887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a5d3cda7-7e98-4345-a549-ebc6f786c220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:37.556263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3cda7-7e98-4345-a549-ebc6f786c220 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:37.561062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4c4c3-4799-4240-982c-25f726c6623b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:37.561681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4c4c3-4799-4240-982c-25f726c6623b service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:37.562141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4c4c3-4799-4240-982c-25f726c6623b service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:37.562675 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4c4c3-4799-4240-982c-25f726c6623b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:37.578737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4c4c3-4799-4240-982c-25f726c6623b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:37.580354 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c4c4c3-4799-4240-982c-25f726c6623b service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:37.592640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065560d9-f40c-471a-8922-146b6776eb58 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:37.592640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-065560d9-f40c-471a-8922-146b6776eb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:37.593240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1255/2513] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:37.697926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:37.737548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065560d9-f40c-471a-8922-146b6776eb58 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:37.745008 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706475b6-e008-4e08-ae3c-70a61ca47805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:37.745745 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706475b6-e008-4e08-ae3c-70a61ca47805 service nova] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:37.746110 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706475b6-e008-4e08-ae3c-70a61ca47805 service nova] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:37.746619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706475b6-e008-4e08-ae3c-70a61ca47805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:37.748707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-706475b6-e008-4e08-ae3c-70a61ca47805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:37.762195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706475b6-e008-4e08-ae3c-70a61ca47805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:37.764108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706475b6-e008-4e08-ae3c-70a61ca47805 service nova] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:37.777545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1259/2514] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:38.198432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:38.684651 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de101cf-bcf0-4458-936f-5c90e26855fe None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:38.685215 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de101cf-bcf0-4458-936f-5c90e26855fe None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:38.685215 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de101cf-bcf0-4458-936f-5c90e26855fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:38.712917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-4de101cf-bcf0-4458-936f-5c90e26855fe None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:38.715485 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4de101cf-bcf0-4458-936f-5c90e26855fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:38.843089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1256/2515] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 21:57:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:38.857569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706475b6-e008-4e08-ae3c-70a61ca47805 service nova] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:38.859240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-706475b6-e008-4e08-ae3c-70a61ca47805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:38.914949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de101cf-bcf0-4458-936f-5c90e26855fe None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:38.945165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706475b6-e008-4e08-ae3c-70a61ca47805 service nova] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:38.952934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30307e66-260b-46df-be0f-f6598a8465b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:38.953799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30307e66-260b-46df-be0f-f6598a8465b9 service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:38.954306 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30307e66-260b-46df-be0f-f6598a8465b9 service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:38.954777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30307e66-260b-46df-be0f-f6598a8465b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:38.965720 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30307e66-260b-46df-be0f-f6598a8465b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:38.968863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30307e66-260b-46df-be0f-f6598a8465b9 service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:38.983590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1260/2516] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:57:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:57:39.019180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de101cf-bcf0-4458-936f-5c90e26855fe None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:39.026891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:39.027652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:39.027998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:39.028337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] PATH_INFO: `/v3/users/19655684a2d140779944ca800528754c` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:39.029618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19655684a2d140779944ca800528754c)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:39.031886 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:39.046611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:39.217269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19655684a2d140779944ca800528754c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:39.233543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19655684a2d140779944ca800528754c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:39.234309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19655684a2d140779944ca800528754c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:39.393642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19655684a2d140779944ca800528754c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:39.409753 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19655684a2d140779944ca800528754c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:39.421324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1257/2517] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:57:38 2022] DELETE /identity/v3/users/19655684a2d140779944ca800528754c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:39.423243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9651b-4bc8-417b-acec-3dcfac519716 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:39.424016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9651b-4bc8-417b-acec-3dcfac519716 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:39.426485 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9651b-4bc8-417b-acec-3dcfac519716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:39.449630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d0e9651b-4bc8-417b-acec-3dcfac519716 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:39.451146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d0e9651b-4bc8-417b-acec-3dcfac519716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:39.508765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:39.531293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1261/2518] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:39.545290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:39.547107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:39.628535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5ca0dc-d6de-42b8-af8e-1a3dbe5db903 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:39.632328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5516a3-a6bd-401a-940e-34a8e22ddf68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:39.632977 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5516a3-a6bd-401a-940e-34a8e22ddf68 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:39.633263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5516a3-a6bd-401a-940e-34a8e22ddf68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:39.633539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5516a3-a6bd-401a-940e-34a8e22ddf68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:39.642925 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5516a3-a6bd-401a-940e-34a8e22ddf68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:39.645048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5516a3-a6bd-401a-940e-34a8e22ddf68 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:39.656263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1258/2519] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:40.185857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9651b-4bc8-417b-acec-3dcfac519716 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:40.188402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d0e9651b-4bc8-417b-acec-3dcfac519716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:40.222327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9651b-4bc8-417b-acec-3dcfac519716 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:40.230831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:40.231796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:40.232081 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:40.232391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] PATH_INFO: `/v3/projects/367162137f054d4a9a87931392fb375e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:40.233590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=367162137f054d4a9a87931392fb375e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:40.235515 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:40.410094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367162137f054d4a9a87931392fb375e', 'request_id': 'req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:40.419476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367162137f054d4a9a87931392fb375e', 'request_id': 'req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:40.530500 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367162137f054d4a9a87931392fb375e', 'request_id': 'req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:40.543905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] The token cache is being invalidate because project 367162137f054d4a9a87931392fb375e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:57:40.544192 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:40.544899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:40.546480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1262/2520] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:57:40 2022] DELETE /identity/v3/projects/367162137f054d4a9a87931392fb375e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:40.551138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5516a3-a6bd-401a-940e-34a8e22ddf68 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:40.562218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5516a3-a6bd-401a-940e-34a8e22ddf68 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:40.626653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:40.627298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:40.627679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:40.627851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] PATH_INFO: `/v3/users/83656ce7b0cf427dba7d915d181ba542` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:40.629063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=83656ce7b0cf427dba7d915d181ba542)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:40.631037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:40.795081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:40.808853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83656ce7b0cf427dba7d915d181ba542'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:40.816527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83656ce7b0cf427dba7d915d181ba542'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:40.817303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83656ce7b0cf427dba7d915d181ba542'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:40.867382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83656ce7b0cf427dba7d915d181ba542'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:40.882078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-53c161ec-4999-46da-8372-ad209fec5a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83656ce7b0cf427dba7d915d181ba542'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:40.890382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1259/2521] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:57:40 2022] DELETE /identity/v3/users/83656ce7b0cf427dba7d915d181ba542 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:41.425849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:41.430055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:41.443863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb9941-7cf5-496e-b2b7-d108eab4e6e2 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:41.522775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:41.524651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:41.524651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:41.524651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] PATH_INFO: `/v3/projects/d34f4dabd3ee445c84c29e44a8568ba6` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:41.525234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34f4dabd3ee445c84c29e44a8568ba6)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:41.527430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:41.731599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34f4dabd3ee445c84c29e44a8568ba6', 'request_id': 'req-7a15f17c-02af-4a91-a044-2b52ff0f9c57'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:41.745120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34f4dabd3ee445c84c29e44a8568ba6', 'request_id': 'req-7a15f17c-02af-4a91-a044-2b52ff0f9c57'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:41.879651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34f4dabd3ee445c84c29e44a8568ba6', 'request_id': 'req-7a15f17c-02af-4a91-a044-2b52ff0f9c57'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:41.900213 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] The token cache is being invalidate because project d34f4dabd3ee445c84c29e44a8568ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:57:41.900546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:41.901261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7a15f17c-02af-4a91-a044-2b52ff0f9c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:41.902803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1263/2522] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:57:41 2022] DELETE /identity/v3/projects/d34f4dabd3ee445c84c29e44a8568ba6 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:57:41.907929 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727b33-42c7-4245-aa8e-5b912b0539bd None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:41.908472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727b33-42c7-4245-aa8e-5b912b0539bd None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:41.908472 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52727b33-42c7-4245-aa8e-5b912b0539bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:41.930310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-52727b33-42c7-4245-aa8e-5b912b0539bd None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:41.931545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-52727b33-42c7-4245-aa8e-5b912b0539bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:42.002944 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1260/2523] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:57:42.010638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f12cd-040f-4011-92f1-45d9d93356c8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:42.010926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f12cd-040f-4011-92f1-45d9d93356c8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:42.011262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f12cd-040f-4011-92f1-45d9d93356c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:42.020471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:42.032717 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-137f12cd-040f-4011-92f1-45d9d93356c8 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:42.039196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-137f12cd-040f-4011-92f1-45d9d93356c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:42.042912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1264/2524] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:42.047499 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727b33-42c7-4245-aa8e-5b912b0539bd None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:42.058693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52727b33-42c7-4245-aa8e-5b912b0539bd None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:42.064060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2390a-5f17-4d3f-8fa8-ce1a5905d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:42.064808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2390a-5f17-4d3f-8fa8-ce1a5905d8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:42.065225 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2390a-5f17-4d3f-8fa8-ce1a5905d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:42.069742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2390a-5f17-4d3f-8fa8-ce1a5905d8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:42.069742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2390a-5f17-4d3f-8fa8-ce1a5905d8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:57:42.069742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2390a-5f17-4d3f-8fa8-ce1a5905d8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:42.069742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2390a-5f17-4d3f-8fa8-ce1a5905d8b0 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:42.083678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1261/2525] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:57:42.088924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f12cd-040f-4011-92f1-45d9d93356c8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:42.099862 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f12cd-040f-4011-92f1-45d9d93356c8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:42.104914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfab1d-04f2-41f7-899d-4d2e576089f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:42.105554 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfab1d-04f2-41f7-899d-4d2e576089f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:42.105837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfab1d-04f2-41f7-899d-4d2e576089f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:42.106159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfab1d-04f2-41f7-899d-4d2e576089f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:42.106823 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfab1d-04f2-41f7-899d-4d2e576089f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:42.108803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfab1d-04f2-41f7-899d-4d2e576089f1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:42.215576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1265/2526] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:57:42 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:42.219520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2390a-5f17-4d3f-8fa8-ce1a5905d8b0 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:42.231421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2390a-5f17-4d3f-8fa8-ce1a5905d8b0 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:42.327640 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e9ee8-cda7-48e2-86f0-62338bc43339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:42.328275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e9ee8-cda7-48e2-86f0-62338bc43339 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:42.328585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e9ee8-cda7-48e2-86f0-62338bc43339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:42.328862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57e9ee8-cda7-48e2-86f0-62338bc43339 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:42.329505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e9ee8-cda7-48e2-86f0-62338bc43339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:42.331461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57e9ee8-cda7-48e2-86f0-62338bc43339 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:42.441567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1262/2527] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:57:42 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:42.450164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfab1d-04f2-41f7-899d-4d2e576089f1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:42.465271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfab1d-04f2-41f7-899d-4d2e576089f1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:42.470075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b80330-0b04-4812-aeb8-d16dc92cf78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:42.470634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b80330-0b04-4812-aeb8-d16dc92cf78c admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:42.470906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b80330-0b04-4812-aeb8-d16dc92cf78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:42.471182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b80330-0b04-4812-aeb8-d16dc92cf78c admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:42.471883 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b80330-0b04-4812-aeb8-d16dc92cf78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:42.473553 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b80330-0b04-4812-aeb8-d16dc92cf78c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:42.485440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1266/2528] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:57:42.489878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e9ee8-cda7-48e2-86f0-62338bc43339 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:42.501142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57e9ee8-cda7-48e2-86f0-62338bc43339 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:42.506305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f1d52-b28e-449e-99bd-929ddaa66c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:42.507043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f1d52-b28e-449e-99bd-929ddaa66c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:42.507408 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f1d52-b28e-449e-99bd-929ddaa66c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:42.507685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f1d52-b28e-449e-99bd-929ddaa66c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:42.508364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f1d52-b28e-449e-99bd-929ddaa66c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:42.510003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f1d52-b28e-449e-99bd-929ddaa66c8f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:42.522142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1263/2529] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:57:42.526293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b80330-0b04-4812-aeb8-d16dc92cf78c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:42.537297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b80330-0b04-4812-aeb8-d16dc92cf78c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:42.542024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a03e69-a7ab-4ad8-aebd-b702ca3f7d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:42.542679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a03e69-a7ab-4ad8-aebd-b702ca3f7d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:42.546528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a03e69-a7ab-4ad8-aebd-b702ca3f7d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:42.546528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a03e69-a7ab-4ad8-aebd-b702ca3f7d8e admin admin] PATH_INFO: `/v3/projects/99383224c343413fbe2df0d59ff86e89/users/d6c2549ea5c440e690415d8cd1d96d61/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:42.558830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a03e69-a7ab-4ad8-aebd-b702ca3f7d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99383224c343413fbe2df0d59ff86e89, user_id=d6c2549ea5c440e690415d8cd1d96d61, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:42.561530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a03e69-a7ab-4ad8-aebd-b702ca3f7d8e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:42.656373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1267/2530] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:57:42 2022] PUT /identity/v3/projects/99383224c343413fbe2df0d59ff86e89/users/d6c2549ea5c440e690415d8cd1d96d61/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:57:42.668938 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879672c-4ea9-474a-980c-ad3ce7b54a50 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:42.669231 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879672c-4ea9-474a-980c-ad3ce7b54a50 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:42.669641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879672c-4ea9-474a-980c-ad3ce7b54a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:42.698943 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7879672c-4ea9-474a-980c-ad3ce7b54a50 None None] MFA Rules not processed for user `d6c2549ea5c440e690415d8cd1d96d61`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:42.700179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7879672c-4ea9-474a-980c-ad3ce7b54a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:42.704575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:42.774840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1264/2531] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:42.779371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a03e69-a7ab-4ad8-aebd-b702ca3f7d8e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:42.846413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a03e69-a7ab-4ad8-aebd-b702ca3f7d8e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:42.851214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a365-ca6f-40d0-a6ef-d912d399b705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:42.851825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a365-ca6f-40d0-a6ef-d912d399b705 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:42.852103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a365-ca6f-40d0-a6ef-d912d399b705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:42.852376 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075a365-ca6f-40d0-a6ef-d912d399b705 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:42.853051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075a365-ca6f-40d0-a6ef-d912d399b705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:42.855004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1075a365-ca6f-40d0-a6ef-d912d399b705 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:42.949914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1268/2532] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:57:42 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:42.954091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879672c-4ea9-474a-980c-ad3ce7b54a50 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:42.967782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879672c-4ea9-474a-980c-ad3ce7b54a50 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:43.047745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cecc0-66f2-4bef-9cd9-adfe7b97e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:43.048545 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cecc0-66f2-4bef-9cd9-adfe7b97e789 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:43.048834 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cecc0-66f2-4bef-9cd9-adfe7b97e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:43.049109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cecc0-66f2-4bef-9cd9-adfe7b97e789 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:43.050003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cecc0-66f2-4bef-9cd9-adfe7b97e789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:43.051940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942cecc0-66f2-4bef-9cd9-adfe7b97e789 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:43.137731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1265/2533] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:57:42 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:43.142279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a365-ca6f-40d0-a6ef-d912d399b705 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:43.153245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075a365-ca6f-40d0-a6ef-d912d399b705 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:43.158709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71925ebd-e410-4e7a-8a63-d75b248fd899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:43.159327 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71925ebd-e410-4e7a-8a63-d75b248fd899 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:43.159633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71925ebd-e410-4e7a-8a63-d75b248fd899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:43.159906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71925ebd-e410-4e7a-8a63-d75b248fd899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:43.160621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71925ebd-e410-4e7a-8a63-d75b248fd899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:43.162228 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71925ebd-e410-4e7a-8a63-d75b248fd899 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:43.173986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1269/2534] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:57:43.179411 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cecc0-66f2-4bef-9cd9-adfe7b97e789 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:43.191186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cecc0-66f2-4bef-9cd9-adfe7b97e789 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:43.197528 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1878f-fc29-4a7b-a9b3-93006fe5f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:43.198466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1878f-fc29-4a7b-a9b3-93006fe5f341 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:43.198466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1878f-fc29-4a7b-a9b3-93006fe5f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:43.198676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1878f-fc29-4a7b-a9b3-93006fe5f341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:43.199314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1878f-fc29-4a7b-a9b3-93006fe5f341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:43.201056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1878f-fc29-4a7b-a9b3-93006fe5f341 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:43.217863 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1266/2535] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:57:43.222422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71925ebd-e410-4e7a-8a63-d75b248fd899 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:43.232888 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71925ebd-e410-4e7a-8a63-d75b248fd899 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:43.238185 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c5df7-0984-4ea3-a4a4-0bf1df90c177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:43.238857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5df7-0984-4ea3-a4a4-0bf1df90c177 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:43.239133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5df7-0984-4ea3-a4a4-0bf1df90c177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:43.239406 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c5df7-0984-4ea3-a4a4-0bf1df90c177 admin admin] PATH_INFO: `/v3/projects/8f3070ff4cd745c9a789ebfaadb24a76/users/f8aead14dfb5494c998f56979b5062f7/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:43.257266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c5df7-0984-4ea3-a4a4-0bf1df90c177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f3070ff4cd745c9a789ebfaadb24a76, user_id=f8aead14dfb5494c998f56979b5062f7, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:43.260012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c5df7-0984-4ea3-a4a4-0bf1df90c177 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:43.337063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1270/2536] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:57:43 2022] PUT /identity/v3/projects/8f3070ff4cd745c9a789ebfaadb24a76/users/f8aead14dfb5494c998f56979b5062f7/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:43.347961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778140d-9427-4d59-9a7f-cadfe0cd9c5f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:43.348248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778140d-9427-4d59-9a7f-cadfe0cd9c5f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:43.348578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778140d-9427-4d59-9a7f-cadfe0cd9c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:43.388543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9778140d-9427-4d59-9a7f-cadfe0cd9c5f None None] MFA Rules not processed for user `f8aead14dfb5494c998f56979b5062f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:43.389795 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9778140d-9427-4d59-9a7f-cadfe0cd9c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:43.455956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1267/2537] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:43.461142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c5df7-0984-4ea3-a4a4-0bf1df90c177 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:43.516363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:43.528018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c5df7-0984-4ea3-a4a4-0bf1df90c177 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:43.532930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a21eb-ba51-4de5-a6df-ff80aa9e90a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:43.533536 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a21eb-ba51-4de5-a6df-ff80aa9e90a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:43.533812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a21eb-ba51-4de5-a6df-ff80aa9e90a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:43.534087 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a21eb-ba51-4de5-a6df-ff80aa9e90a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:43.534726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a21eb-ba51-4de5-a6df-ff80aa9e90a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:43.537193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a21eb-ba51-4de5-a6df-ff80aa9e90a5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:43.675363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1271/2538] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:57:43 2022] POST /identity/v3/projects => generated 387 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:43.680210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778140d-9427-4d59-9a7f-cadfe0cd9c5f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:43.695437 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778140d-9427-4d59-9a7f-cadfe0cd9c5f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:43.704983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:43.754309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15b562-b08f-4a78-a30f-7e1e21ffb6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:43.755008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15b562-b08f-4a78-a30f-7e1e21ffb6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:43.755285 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15b562-b08f-4a78-a30f-7e1e21ffb6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:43.756174 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15b562-b08f-4a78-a30f-7e1e21ffb6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:43.757205 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15b562-b08f-4a78-a30f-7e1e21ffb6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:43.759201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15b562-b08f-4a78-a30f-7e1e21ffb6d0 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:43.839984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1268/2539] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:57:43 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:57:43.844184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a21eb-ba51-4de5-a6df-ff80aa9e90a5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:43.855881 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a21eb-ba51-4de5-a6df-ff80aa9e90a5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:43.862531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32778239-cb58-49ca-b1f8-042c88b5755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:43.864522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32778239-cb58-49ca-b1f8-042c88b5755a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:43.864522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32778239-cb58-49ca-b1f8-042c88b5755a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:43.864522 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32778239-cb58-49ca-b1f8-042c88b5755a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:43.865461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32778239-cb58-49ca-b1f8-042c88b5755a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:43.866954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32778239-cb58-49ca-b1f8-042c88b5755a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:43.879062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1272/2540] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:57:43.883124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15b562-b08f-4a78-a30f-7e1e21ffb6d0 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:43.894573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15b562-b08f-4a78-a30f-7e1e21ffb6d0 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:43.900934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb723c-e823-464b-83cb-c4d0216c1e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:43.901618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb723c-e823-464b-83cb-c4d0216c1e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:43.902053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb723c-e823-464b-83cb-c4d0216c1e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:43.902365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb723c-e823-464b-83cb-c4d0216c1e10 admin admin] PATH_INFO: `/v3/projects/ddcfaa4842f7487cbf853a601d43f591/users/b4ff159f119d446cbd2d4df3e4380672/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:43.920957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb723c-e823-464b-83cb-c4d0216c1e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcfaa4842f7487cbf853a601d43f591, user_id=b4ff159f119d446cbd2d4df3e4380672, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:43.923745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb723c-e823-464b-83cb-c4d0216c1e10 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:43.994087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1269/2541] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:57:43 2022] PUT /identity/v3/projects/ddcfaa4842f7487cbf853a601d43f591/users/b4ff159f119d446cbd2d4df3e4380672/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:43.998004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32778239-cb58-49ca-b1f8-042c88b5755a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:44.020606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32778239-cb58-49ca-b1f8-042c88b5755a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:44.084128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21a121-717f-46f7-b4c9-812773496b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:44.084776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21a121-717f-46f7-b4c9-812773496b35 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:44.085083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21a121-717f-46f7-b4c9-812773496b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:44.085345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21a121-717f-46f7-b4c9-812773496b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:44.087126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21a121-717f-46f7-b4c9-812773496b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:44.087594 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21a121-717f-46f7-b4c9-812773496b35 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:44.104715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1273/2542] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:57:44.108963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb723c-e823-464b-83cb-c4d0216c1e10 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:44.120772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb723c-e823-464b-83cb-c4d0216c1e10 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:44.125990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69189d-c1ab-4412-9622-f42a69a025af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:44.126635 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69189d-c1ab-4412-9622-f42a69a025af admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:44.127032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69189d-c1ab-4412-9622-f42a69a025af admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:44.127179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69189d-c1ab-4412-9622-f42a69a025af admin admin] PATH_INFO: `/v3/projects/ddcfaa4842f7487cbf853a601d43f591/users/b4ff159f119d446cbd2d4df3e4380672/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:44.129179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69189d-c1ab-4412-9622-f42a69a025af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcfaa4842f7487cbf853a601d43f591, user_id=b4ff159f119d446cbd2d4df3e4380672, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:44.131910 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69189d-c1ab-4412-9622-f42a69a025af admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:44.145584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1270/2543] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:57:44 2022] PUT /identity/v3/projects/ddcfaa4842f7487cbf853a601d43f591/users/b4ff159f119d446cbd2d4df3e4380672/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:44.156448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76dfe6-f377-42f7-b114-f93c2dea16be None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:44.157175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76dfe6-f377-42f7-b114-f93c2dea16be None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:44.157618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c76dfe6-f377-42f7-b114-f93c2dea16be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:44.189353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-8c76dfe6-f377-42f7-b114-f93c2dea16be None None] MFA Rules not processed for user `b4ff159f119d446cbd2d4df3e4380672`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:44.191188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8c76dfe6-f377-42f7-b114-f93c2dea16be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:44.274967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1274/2544] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:44.288956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69189d-c1ab-4412-9622-f42a69a025af admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:44.291053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0a69189d-c1ab-4412-9622-f42a69a025af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:44.354500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69189d-c1ab-4412-9622-f42a69a025af admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:44.358890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ada0a5-1959-4cc7-a9b0-a041921c7234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:44.359505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ada0a5-1959-4cc7-a9b0-a041921c7234 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:44.359783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ada0a5-1959-4cc7-a9b0-a041921c7234 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:44.360082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ada0a5-1959-4cc7-a9b0-a041921c7234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:44.370072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ada0a5-1959-4cc7-a9b0-a041921c7234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:44.371525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ada0a5-1959-4cc7-a9b0-a041921c7234 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:44.382592 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1271/2545] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:45.636728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76dfe6-f377-42f7-b114-f93c2dea16be None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:45.638202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8c76dfe6-f377-42f7-b114-f93c2dea16be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:45.651911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c76dfe6-f377-42f7-b114-f93c2dea16be None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:45.656062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69aa42-6e92-4b48-a00c-72e80d0d2802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:45.656815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69aa42-6e92-4b48-a00c-72e80d0d2802 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:45.657164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69aa42-6e92-4b48-a00c-72e80d0d2802 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:45.657514 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69aa42-6e92-4b48-a00c-72e80d0d2802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:45.706313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:45.719953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69aa42-6e92-4b48-a00c-72e80d0d2802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:45.721490 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69aa42-6e92-4b48-a00c-72e80d0d2802 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:45.732401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1275/2546] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:48.261852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691d7b-ec55-43c8-8c5f-62367b235618 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:48.262319 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691d7b-ec55-43c8-8c5f-62367b235618 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:48.262415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691d7b-ec55-43c8-8c5f-62367b235618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:48.283063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-b8691d7b-ec55-43c8-8c5f-62367b235618 None None] MFA Rules not processed for user `8ba9ea33e0f444b88acdc9560856dae5`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:48.284270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b8691d7b-ec55-43c8-8c5f-62367b235618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:48.350745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1272/2547] 10.222.0.83 () {58 vars in 967 bytes} [Mon Aug 29 21:57:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:48.364503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69aa42-6e92-4b48-a00c-72e80d0d2802 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:48.367089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ef69aa42-6e92-4b48-a00c-72e80d0d2802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:48.457401 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69aa42-6e92-4b48-a00c-72e80d0d2802 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:48.464270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67fd60-8d9e-4e96-b19e-dbd03b65cf8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87128016ec014aa8b8f2fcc8ecf1037d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:48.464938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67fd60-8d9e-4e96-b19e-dbd03b65cf8a service swift] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:48.467599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67fd60-8d9e-4e96-b19e-dbd03b65cf8a service swift] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:48.467599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67fd60-8d9e-4e96-b19e-dbd03b65cf8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:48.477182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67fd60-8d9e-4e96-b19e-dbd03b65cf8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:48.479341 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67fd60-8d9e-4e96-b19e-dbd03b65cf8a service swift] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:48.490858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1276/2548] 10.222.0.83 () {60 vars in 1384 bytes} [Mon Aug 29 21:57:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 21:57:50.941585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8691d7b-ec55-43c8-8c5f-62367b235618 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:50.953322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8691d7b-ec55-43c8-8c5f-62367b235618 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:50.958082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91902f3-e49c-492e-98dd-64a551e683e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:50.958801 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91902f3-e49c-492e-98dd-64a551e683e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:50.959167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91902f3-e49c-492e-98dd-64a551e683e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:50.959537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91902f3-e49c-492e-98dd-64a551e683e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:50.972861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:51.040566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91902f3-e49c-492e-98dd-64a551e683e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:51.042420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91902f3-e49c-492e-98dd-64a551e683e8 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:51.055585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1273/2549] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:55.830418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67fd60-8d9e-4e96-b19e-dbd03b65cf8a service swift] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:55.922749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67fd60-8d9e-4e96-b19e-dbd03b65cf8a service swift] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:55.929089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:55.930082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:55.930524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:55.931121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] PATH_INFO: `/v3/users/d6c2549ea5c440e690415d8cd1d96d61` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:55.932567 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c2549ea5c440e690415d8cd1d96d61)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:55.934880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:56.198452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c2549ea5c440e690415d8cd1d96d61'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:56.209378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c2549ea5c440e690415d8cd1d96d61'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:56.210147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c2549ea5c440e690415d8cd1d96d61'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:56.267470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c2549ea5c440e690415d8cd1d96d61'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:56.268545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c2549ea5c440e690415d8cd1d96d61'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:56.283445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:56.297505 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1277/2550] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:57:55 2022] DELETE /identity/v3/users/d6c2549ea5c440e690415d8cd1d96d61 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:56.299462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba1bdd-02ee-414f-9382-741b4cb01987 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:56.300231 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba1bdd-02ee-414f-9382-741b4cb01987 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:56.300582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba1bdd-02ee-414f-9382-741b4cb01987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:56.324677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-bfba1bdd-02ee-414f-9382-741b4cb01987 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:57:56.326173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bfba1bdd-02ee-414f-9382-741b4cb01987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:56.416788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1274/2551] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:57:56.426818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:56.429103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:56.506031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb31f77-79ce-4b5f-a9e8-10cc9da214b9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:56.510054 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc3a41-0c39-43c2-8fb6-0cd56a1305f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:56.510758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc3a41-0c39-43c2-8fb6-0cd56a1305f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:56.511099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc3a41-0c39-43c2-8fb6-0cd56a1305f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:56.511563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc3a41-0c39-43c2-8fb6-0cd56a1305f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:56.522440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc3a41-0c39-43c2-8fb6-0cd56a1305f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:56.523840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc3a41-0c39-43c2-8fb6-0cd56a1305f0 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:56.540787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1278/2552] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:57:57.089584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba1bdd-02ee-414f-9382-741b4cb01987 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:57.091200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-bfba1bdd-02ee-414f-9382-741b4cb01987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:57.106765 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba1bdd-02ee-414f-9382-741b4cb01987 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:57.112283 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:57.113089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:57.113447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:57.113780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] PATH_INFO: `/v3/projects/99383224c343413fbe2df0d59ff86e89` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:57.115983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=99383224c343413fbe2df0d59ff86e89)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:57.118578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:57.224723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99383224c343413fbe2df0d59ff86e89', 'request_id': 'req-cb188807-b189-4edd-925f-51e4129f32fe'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:57.231706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99383224c343413fbe2df0d59ff86e89', 'request_id': 'req-cb188807-b189-4edd-925f-51e4129f32fe'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:57.296308 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99383224c343413fbe2df0d59ff86e89', 'request_id': 'req-cb188807-b189-4edd-925f-51e4129f32fe'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:57.308700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] The token cache is being invalidate because project 99383224c343413fbe2df0d59ff86e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:57:57.309417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:57.309835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:57.311409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1275/2553] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:57:57 2022] DELETE /identity/v3/projects/99383224c343413fbe2df0d59ff86e89 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:57.315476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc3a41-0c39-43c2-8fb6-0cd56a1305f0 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:57.332435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc3a41-0c39-43c2-8fb6-0cd56a1305f0 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:57.390964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:57.391632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:57.391908 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:57.392187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] PATH_INFO: `/v3/users/f8aead14dfb5494c998f56979b5062f7` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:57.395976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8aead14dfb5494c998f56979b5062f7)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:57.397939 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:57.692725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8aead14dfb5494c998f56979b5062f7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:57.700740 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8aead14dfb5494c998f56979b5062f7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:57.701488 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8aead14dfb5494c998f56979b5062f7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:57.776111 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8aead14dfb5494c998f56979b5062f7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:57.776785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8aead14dfb5494c998f56979b5062f7'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:57.801713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1279/2554] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:57:57 2022] DELETE /identity/v3/users/f8aead14dfb5494c998f56979b5062f7 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:58.420058 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:58.422041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:58.437916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb188807-b189-4edd-925f-51e4129f32fe admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:58.480037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:58.511055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:58.511789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:58.512104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:58.512578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] PATH_INFO: `/v3/projects/8f3070ff4cd745c9a789ebfaadb24a76` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:58.513766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f3070ff4cd745c9a789ebfaadb24a76)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:58.518911 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:58.694321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f3070ff4cd745c9a789ebfaadb24a76', 'request_id': 'req-7e22a113-28fb-4fa2-9a96-c0b974432fa3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:58.703093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f3070ff4cd745c9a789ebfaadb24a76', 'request_id': 'req-7e22a113-28fb-4fa2-9a96-c0b974432fa3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:58.993917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f3070ff4cd745c9a789ebfaadb24a76', 'request_id': 'req-7e22a113-28fb-4fa2-9a96-c0b974432fa3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.008024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] The token cache is being invalidate because project 8f3070ff4cd745c9a789ebfaadb24a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:57:59.008324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.009018 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.012557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1276/2555] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:57:58 2022] DELETE /identity/v3/projects/8f3070ff4cd745c9a789ebfaadb24a76 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:57:59.012942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:59.015624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:59.016630 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:59.018112 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:59.032539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d9c54-99b8-4ce5-9bd7-711dd095fd4c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:59.049154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:59.089550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22a113-28fb-4fa2-9a96-c0b974432fa3 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:59.104199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:59.104199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:59.104199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:59.104199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] PATH_INFO: `/v3/users/b4ff159f119d446cbd2d4df3e4380672` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:59.104774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4ff159f119d446cbd2d4df3e4380672)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:59.104774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:59.106713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:57:59.107356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:57:59.107627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:57:59.107893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] PATH_INFO: `/v3/users/7dcd703ad58a4807b99266f82e8988ca` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:57:59.109072 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dcd703ad58a4807b99266f82e8988ca)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:57:59.111005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:57:59.365784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dcd703ad58a4807b99266f82e8988ca'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.366158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4ff159f119d446cbd2d4df3e4380672'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.373769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4ff159f119d446cbd2d4df3e4380672'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.374495 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4ff159f119d446cbd2d4df3e4380672'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.386157 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dcd703ad58a4807b99266f82e8988ca'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.386886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dcd703ad58a4807b99266f82e8988ca'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.491040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4ff159f119d446cbd2d4df3e4380672'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.497549 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:57:59.506495 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4ff159f119d446cbd2d4df3e4380672'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.512954 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1277/2556] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:57:59 2022] DELETE /identity/v3/users/b4ff159f119d446cbd2d4df3e4380672 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:59.558864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dcd703ad58a4807b99266f82e8988ca'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.559665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dcd703ad58a4807b99266f82e8988ca'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:57:59.580107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1280/2557] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:57:59 2022] DELETE /identity/v3/users/7dcd703ad58a4807b99266f82e8988ca => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:57:59.871767 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:59.873735 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:57:59.952855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135c88a-2ddd-44e2-a72f-eaba11e8e4c7 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:57:59.972769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:57:59.974440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:00.039582 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:00.040600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.041054 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.041509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] PATH_INFO: `/v3/projects/cae92c45ec304a2da9a7cafe49bb8b20` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.043078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae92c45ec304a2da9a7cafe49bb8b20)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:00.045421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:00.066292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faea9b-e368-4458-b50a-32fe73c63ce5 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:00.072880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:00.073523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.073807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.074082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] PATH_INFO: `/v3/projects/ddcfaa4842f7487cbf853a601d43f591` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.075218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddcfaa4842f7487cbf853a601d43f591)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:00.077186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:00.160572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae92c45ec304a2da9a7cafe49bb8b20', 'request_id': 'req-17182103-70b7-4882-abc6-9bade27dc25a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.168032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae92c45ec304a2da9a7cafe49bb8b20', 'request_id': 'req-17182103-70b7-4882-abc6-9bade27dc25a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.175988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:00.186991 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddcfaa4842f7487cbf853a601d43f591', 'request_id': 'req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.193349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddcfaa4842f7487cbf853a601d43f591', 'request_id': 'req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.233461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae92c45ec304a2da9a7cafe49bb8b20', 'request_id': 'req-17182103-70b7-4882-abc6-9bade27dc25a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.246540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] The token cache is being invalidate because project cae92c45ec304a2da9a7cafe49bb8b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:00.246847 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.247505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.249068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1278/2558] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:57:59 2022] DELETE /identity/v3/projects/cae92c45ec304a2da9a7cafe49bb8b20 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:00.252953 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:00.254311 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:00.283338 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:00.328367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17182103-70b7-4882-abc6-9bade27dc25a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:00.366221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddcfaa4842f7487cbf853a601d43f591', 'request_id': 'req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.385811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] The token cache is being invalidate because project ddcfaa4842f7487cbf853a601d43f591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:00.386386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.387173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-90f2be26-bd7c-41d0-aadf-7e961a0f80ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.388925 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1281/2559] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:57:59 2022] DELETE /identity/v3/projects/ddcfaa4842f7487cbf853a601d43f591 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:00.395530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6603f7e-d51d-4b1a-9af8-e5357414e454 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.397157 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6603f7e-d51d-4b1a-9af8-e5357414e454 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.397527 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6603f7e-d51d-4b1a-9af8-e5357414e454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.415684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:00.415684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.415684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.415684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] PATH_INFO: `/v3/users/4d69fa731fbc4710b92f3043f93428b1` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.416543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d69fa731fbc4710b92f3043f93428b1)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:00.416543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:00.422874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e6603f7e-d51d-4b1a-9af8-e5357414e454 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:00.424251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e6603f7e-d51d-4b1a-9af8-e5357414e454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:00.433395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1282/2560] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:00.441871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79578a71-a45a-411c-9aae-6fe63e4170d8 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.442234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79578a71-a45a-411c-9aae-6fe63e4170d8 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.442587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79578a71-a45a-411c-9aae-6fe63e4170d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.470632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-79578a71-a45a-411c-9aae-6fe63e4170d8 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:00.472779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-79578a71-a45a-411c-9aae-6fe63e4170d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:00.487388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1283/2561] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:58:00.492670 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79578a71-a45a-411c-9aae-6fe63e4170d8 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:00.502160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79578a71-a45a-411c-9aae-6fe63e4170d8 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:00.513641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac05b2-5573-43ba-beba-f0ac5490a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:00.513641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac05b2-5573-43ba-beba-f0ac5490a578 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.513641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac05b2-5573-43ba-beba-f0ac5490a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.513641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac05b2-5573-43ba-beba-f0ac5490a578 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.514031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac05b2-5573-43ba-beba-f0ac5490a578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:58:00.514031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac05b2-5573-43ba-beba-f0ac5490a578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:00.514031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac05b2-5573-43ba-beba-f0ac5490a578 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:00.524402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1284/2562] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:58:00.528967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac05b2-5573-43ba-beba-f0ac5490a578 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:00.539681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac05b2-5573-43ba-beba-f0ac5490a578 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:00.544361 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa482b-9781-4125-af49-6a1786d406ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:00.545003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa482b-9781-4125-af49-6a1786d406ba admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.545282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa482b-9781-4125-af49-6a1786d406ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.545603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa482b-9781-4125-af49-6a1786d406ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.546231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa482b-9781-4125-af49-6a1786d406ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:00.548125 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa482b-9781-4125-af49-6a1786d406ba admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:00.637160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d69fa731fbc4710b92f3043f93428b1'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.644089 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d69fa731fbc4710b92f3043f93428b1'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.645196 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d69fa731fbc4710b92f3043f93428b1'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.654316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1285/2563] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:00 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:58:00.658782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa482b-9781-4125-af49-6a1786d406ba admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:00.707431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d69fa731fbc4710b92f3043f93428b1'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.721856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d69fa731fbc4710b92f3043f93428b1'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:00.722236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa482b-9781-4125-af49-6a1786d406ba admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:00.727647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de65f8-a782-4572-bbcb-d227b0d99f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:00.728271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de65f8-a782-4572-bbcb-d227b0d99f52 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.728581 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de65f8-a782-4572-bbcb-d227b0d99f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.728859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de65f8-a782-4572-bbcb-d227b0d99f52 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.729113 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1279/2564] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:00 2022] DELETE /identity/v3/users/4d69fa731fbc4710b92f3043f93428b1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:00.729571 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de65f8-a782-4572-bbcb-d227b0d99f52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:00.731575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de65f8-a782-4572-bbcb-d227b0d99f52 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:00.799877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1286/2565] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:00 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:58:00.804553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:00.806048 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:00.867058 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:00.883931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29895b99-7460-43b3-977d-484d40773a7e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:00.889081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73834720-555d-481d-8489-c68efe8da408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:00.889704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73834720-555d-481d-8489-c68efe8da408 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.889986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73834720-555d-481d-8489-c68efe8da408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.890252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73834720-555d-481d-8489-c68efe8da408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.890903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73834720-555d-481d-8489-c68efe8da408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:00.892551 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73834720-555d-481d-8489-c68efe8da408 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:00.904292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1280/2566] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:00.910704 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de65f8-a782-4572-bbcb-d227b0d99f52 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:00.919458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de65f8-a782-4572-bbcb-d227b0d99f52 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:00.924498 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995d8d-825c-4836-a70a-8698872e9a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:00.925373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995d8d-825c-4836-a70a-8698872e9a6e admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.925656 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995d8d-825c-4836-a70a-8698872e9a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.926295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41995d8d-825c-4836-a70a-8698872e9a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.926964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41995d8d-825c-4836-a70a-8698872e9a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:00.928654 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41995d8d-825c-4836-a70a-8698872e9a6e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:00.939350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1287/2567] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:58:00.945495 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73834720-555d-481d-8489-c68efe8da408 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:00.955840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73834720-555d-481d-8489-c68efe8da408 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:00.961413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f90fa-3d8e-47d7-981c-f5121cb309c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:00.962010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f90fa-3d8e-47d7-981c-f5121cb309c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:00.962292 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f90fa-3d8e-47d7-981c-f5121cb309c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:00.962567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f90fa-3d8e-47d7-981c-f5121cb309c1 admin admin] PATH_INFO: `/v3/projects/5e0bf91d35684c17a1cf375ed3ec8222/users/d28726bc72704f7cac7b2012ac64f5fa/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:00.979185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f90fa-3d8e-47d7-981c-f5121cb309c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0bf91d35684c17a1cf375ed3ec8222, user_id=d28726bc72704f7cac7b2012ac64f5fa, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:00.990268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f90fa-3d8e-47d7-981c-f5121cb309c1 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:01.029858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995d8d-825c-4836-a70a-8698872e9a6e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:01.031809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-41995d8d-825c-4836-a70a-8698872e9a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:01.046614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41995d8d-825c-4836-a70a-8698872e9a6e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:01.052272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:01.052970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:01.053286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:01.053561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] PATH_INFO: `/v3/projects/863be9826a204a00b097535d1f1532b2` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:01.054814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=863be9826a204a00b097535d1f1532b2)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:01.056847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:01.070921 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1281/2568] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:00 2022] PUT /identity/v3/projects/5e0bf91d35684c17a1cf375ed3ec8222/users/d28726bc72704f7cac7b2012ac64f5fa/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:01.082907 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264ed5-c216-414d-a884-11ec6419761b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:01.084082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264ed5-c216-414d-a884-11ec6419761b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:01.085123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264ed5-c216-414d-a884-11ec6419761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:01.123922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e8264ed5-c216-414d-a884-11ec6419761b None None] MFA Rules not processed for user `d28726bc72704f7cac7b2012ac64f5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:01.125821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e8264ed5-c216-414d-a884-11ec6419761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:01.187156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863be9826a204a00b097535d1f1532b2', 'request_id': 'req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:01.188686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=87,keystone:DELETE=8,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:01.194683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863be9826a204a00b097535d1f1532b2', 'request_id': 'req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:01.204974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1282/2569] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:58:01.209825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8264ed5-c216-414d-a884-11ec6419761b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:01.274263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8264ed5-c216-414d-a884-11ec6419761b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:01.278707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863be9826a204a00b097535d1f1532b2', 'request_id': 'req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:01.292159 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] The token cache is being invalidate because project 863be9826a204a00b097535d1f1532b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:01.292445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:01.293163 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:01.294664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1288/2570] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:01 2022] DELETE /identity/v3/projects/863be9826a204a00b097535d1f1532b2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:01.349219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:01.359549 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72db21-cb8c-4dde-a700-cbe3704ff42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:01.360752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72db21-cb8c-4dde-a700-cbe3704ff42c admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:01.361573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72db21-cb8c-4dde-a700-cbe3704ff42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:01.361798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72db21-cb8c-4dde-a700-cbe3704ff42c admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:01.362716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72db21-cb8c-4dde-a700-cbe3704ff42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:01.367255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72db21-cb8c-4dde-a700-cbe3704ff42c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:01.495250 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1283/2571] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:01 2022] POST /identity/v3/projects => generated 381 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:58:01.500018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:01.501618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:01.515832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f193b5-1d0a-4fc7-b2ba-74d2ed7f4a8d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:01.576721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f94b-1bfc-4704-b56e-a9889bec5165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:01.577223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f94b-1bfc-4704-b56e-a9889bec5165 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:01.577499 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f94b-1bfc-4704-b56e-a9889bec5165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:01.577769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3f94b-1bfc-4704-b56e-a9889bec5165 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:01.578399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3f94b-1bfc-4704-b56e-a9889bec5165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:01.580348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f3f94b-1bfc-4704-b56e-a9889bec5165 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:01.669897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1289/2572] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:01 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:58:01.674233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72db21-cb8c-4dde-a700-cbe3704ff42c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:01.686838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72db21-cb8c-4dde-a700-cbe3704ff42c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:01.691909 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46f601-3737-4a79-9543-5ff0090b7456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:01.692573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46f601-3737-4a79-9543-5ff0090b7456 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:01.692891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46f601-3737-4a79-9543-5ff0090b7456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:01.693161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46f601-3737-4a79-9543-5ff0090b7456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:01.693817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46f601-3737-4a79-9543-5ff0090b7456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:01.695448 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46f601-3737-4a79-9543-5ff0090b7456 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:01.708575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1284/2573] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:01.713198 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f94b-1bfc-4704-b56e-a9889bec5165 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:01.723753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3f94b-1bfc-4704-b56e-a9889bec5165 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:01.729243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c447356-9d41-4d50-a7b5-5482f81c822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:01.730022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c447356-9d41-4d50-a7b5-5482f81c822c admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:01.730171 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c447356-9d41-4d50-a7b5-5482f81c822c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:01.730447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c447356-9d41-4d50-a7b5-5482f81c822c admin admin] PATH_INFO: `/v3/projects/249fb9ab70d044aeb5cd9ddd224621e6/users/35d0da789d95487d94be3569ce314cf8/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:01.747552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c447356-9d41-4d50-a7b5-5482f81c822c admin admin] RBAC: Authorizing `identity:create_grant(project_id=249fb9ab70d044aeb5cd9ddd224621e6, user_id=35d0da789d95487d94be3569ce314cf8, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:01.750276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c447356-9d41-4d50-a7b5-5482f81c822c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:01.822300 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1290/2574] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:01 2022] PUT /identity/v3/projects/249fb9ab70d044aeb5cd9ddd224621e6/users/35d0da789d95487d94be3569ce314cf8/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:01.826573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46f601-3737-4a79-9543-5ff0090b7456 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:01.837143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46f601-3737-4a79-9543-5ff0090b7456 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:01.897541 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbfbcd1-c87f-41cd-806a-fd4634e58149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:01.898152 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfbcd1-c87f-41cd-806a-fd4634e58149 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:01.898432 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfbcd1-c87f-41cd-806a-fd4634e58149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:01.898706 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbfbcd1-c87f-41cd-806a-fd4634e58149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:01.899350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfbcd1-c87f-41cd-806a-fd4634e58149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:01.901005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbfbcd1-c87f-41cd-806a-fd4634e58149 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:01.912750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1285/2575] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:01.917216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c447356-9d41-4d50-a7b5-5482f81c822c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:01.927981 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c447356-9d41-4d50-a7b5-5482f81c822c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:01.932678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcbc37-dfa8-4af1-b5b3-6c4ff495836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:01.933340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcbc37-dfa8-4af1-b5b3-6c4ff495836d admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:01.933613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcbc37-dfa8-4af1-b5b3-6c4ff495836d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:01.933880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbcbc37-dfa8-4af1-b5b3-6c4ff495836d admin admin] PATH_INFO: `/v3/projects/249fb9ab70d044aeb5cd9ddd224621e6/users/35d0da789d95487d94be3569ce314cf8/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:01.935766 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcbc37-dfa8-4af1-b5b3-6c4ff495836d admin admin] RBAC: Authorizing `identity:create_grant(project_id=249fb9ab70d044aeb5cd9ddd224621e6, user_id=35d0da789d95487d94be3569ce314cf8, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:01.938414 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbcbc37-dfa8-4af1-b5b3-6c4ff495836d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:01.949427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1291/2576] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:01 2022] PUT /identity/v3/projects/249fb9ab70d044aeb5cd9ddd224621e6/users/35d0da789d95487d94be3569ce314cf8/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:01.961349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035682e-0ede-4a81-ac1a-3a4c78ba012e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:01.961683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035682e-0ede-4a81-ac1a-3a4c78ba012e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:01.961927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035682e-0ede-4a81-ac1a-3a4c78ba012e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:01.993734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9035682e-0ede-4a81-ac1a-3a4c78ba012e None None] MFA Rules not processed for user `35d0da789d95487d94be3569ce314cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:01.993734 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9035682e-0ede-4a81-ac1a-3a4c78ba012e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:02.079897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1286/2577] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:01 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:58:02.092690 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcbc37-dfa8-4af1-b5b3-6c4ff495836d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:02.094503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-adbcbc37-dfa8-4af1-b5b3-6c4ff495836d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:02.153270 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbcbc37-dfa8-4af1-b5b3-6c4ff495836d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:02.157519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb3d06-4517-4c9e-b79f-d28a54eb6d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:02.158147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb3d06-4517-4c9e-b79f-d28a54eb6d96 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:02.158429 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb3d06-4517-4c9e-b79f-d28a54eb6d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:02.158703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb3d06-4517-4c9e-b79f-d28a54eb6d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:02.169713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb3d06-4517-4c9e-b79f-d28a54eb6d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:02.171162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb3d06-4517-4c9e-b79f-d28a54eb6d96 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:02.181697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1292/2578] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:02.335606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035682e-0ede-4a81-ac1a-3a4c78ba012e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:02.346160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035682e-0ede-4a81-ac1a-3a4c78ba012e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:02.349797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241c091-d634-4c00-88f5-12cec7c620e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:02.350457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c091-d634-4c00-88f5-12cec7c620e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:02.350742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c091-d634-4c00-88f5-12cec7c620e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:02.351014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241c091-d634-4c00-88f5-12cec7c620e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:02.353047 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2241c091-d634-4c00-88f5-12cec7c620e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:02.407669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:02.418624 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241c091-d634-4c00-88f5-12cec7c620e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:02.420100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241c091-d634-4c00-88f5-12cec7c620e6 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:02.435807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1287/2579] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:58:02.992999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb3d06-4517-4c9e-b79f-d28a54eb6d96 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:03.033921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:03.066539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb3d06-4517-4c9e-b79f-d28a54eb6d96 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:03.071196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:03.071825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:03.072098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:03.072369 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] PATH_INFO: `/v3/users/d28726bc72704f7cac7b2012ac64f5fa` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:03.073511 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28726bc72704f7cac7b2012ac64f5fa)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:03.075408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:03.225535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28726bc72704f7cac7b2012ac64f5fa'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:03.232725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28726bc72704f7cac7b2012ac64f5fa'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:03.233297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28726bc72704f7cac7b2012ac64f5fa'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:03.279084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28726bc72704f7cac7b2012ac64f5fa'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:03.279687 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28726bc72704f7cac7b2012ac64f5fa'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:03.298660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1293/2580] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:02 2022] DELETE /identity/v3/users/d28726bc72704f7cac7b2012ac64f5fa => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:03.304190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bb40-3f34-47d0-935c-d320f8151fda None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:03.304760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bb40-3f34-47d0-935c-d320f8151fda None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:03.304991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611bb40-3f34-47d0-935c-d320f8151fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:03.324920 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7611bb40-3f34-47d0-935c-d320f8151fda None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:03.326139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7611bb40-3f34-47d0-935c-d320f8151fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:03.397108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1288/2581] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:58:03.407495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:03.409103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:03.477063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019643ac-eb34-49df-a8cd-ace2b30b6727 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:03.480760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c79c9-907a-43b9-ba1c-6f3a8ca6bb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:03.481382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c79c9-907a-43b9-ba1c-6f3a8ca6bb0f service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:03.481669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c79c9-907a-43b9-ba1c-6f3a8ca6bb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:03.481943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c79c9-907a-43b9-ba1c-6f3a8ca6bb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:03.492007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c79c9-907a-43b9-ba1c-6f3a8ca6bb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:03.493524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c79c9-907a-43b9-ba1c-6f3a8ca6bb0f service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:03.503953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1294/2582] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:58:03.972171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611bb40-3f34-47d0-935c-d320f8151fda None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:03.973805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7611bb40-3f34-47d0-935c-d320f8151fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:03.991144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611bb40-3f34-47d0-935c-d320f8151fda None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:03.997903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:03.998561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:03.998986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:03.999180 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] PATH_INFO: `/v3/projects/5e0bf91d35684c17a1cf375ed3ec8222` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:04.006572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0bf91d35684c17a1cf375ed3ec8222)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:04.006572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:04.109376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0bf91d35684c17a1cf375ed3ec8222', 'request_id': 'req-77c95108-2896-4946-a6bd-35d73e5c9227'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:04.117377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0bf91d35684c17a1cf375ed3ec8222', 'request_id': 'req-77c95108-2896-4946-a6bd-35d73e5c9227'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:04.159059 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0bf91d35684c17a1cf375ed3ec8222', 'request_id': 'req-77c95108-2896-4946-a6bd-35d73e5c9227'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:04.172520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] The token cache is being invalidate because project 5e0bf91d35684c17a1cf375ed3ec8222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:04.172781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:04.173332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:04.174933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1289/2583] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:03 2022] DELETE /identity/v3/projects/5e0bf91d35684c17a1cf375ed3ec8222 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:04.179309 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c79c9-907a-43b9-ba1c-6f3a8ca6bb0f service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:04.189430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c79c9-907a-43b9-ba1c-6f3a8ca6bb0f service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:04.243314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:04.250351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:04.250987 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:04.251262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:04.251529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] PATH_INFO: `/v3/users/35d0da789d95487d94be3569ce314cf8` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:04.252711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d0da789d95487d94be3569ce314cf8)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:04.254682 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:04.471886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d0da789d95487d94be3569ce314cf8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:04.479483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d0da789d95487d94be3569ce314cf8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:04.482913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d0da789d95487d94be3569ce314cf8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:04.564738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d0da789d95487d94be3569ce314cf8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:04.565388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-322e9ba1-954e-49b0-9f1c-e29e986f83ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d0da789d95487d94be3569ce314cf8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:04.585989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1295/2584] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:04 2022] DELETE /identity/v3/users/35d0da789d95487d94be3569ce314cf8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:05.092446 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:05.096447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:05.110475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c95108-2896-4946-a6bd-35d73e5c9227 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:05.180124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:05.180816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:05.181103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:05.181373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] PATH_INFO: `/v3/projects/249fb9ab70d044aeb5cd9ddd224621e6` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:05.182586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=249fb9ab70d044aeb5cd9ddd224621e6)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:05.184527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:05.203586 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:05.279816 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249fb9ab70d044aeb5cd9ddd224621e6', 'request_id': 'req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:05.286168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249fb9ab70d044aeb5cd9ddd224621e6', 'request_id': 'req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:05.330369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249fb9ab70d044aeb5cd9ddd224621e6', 'request_id': 'req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:05.342596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] The token cache is being invalidate because project 249fb9ab70d044aeb5cd9ddd224621e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:05.342863 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:05.343438 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-ad364bee-cfe2-48fa-9b5f-794d853b1cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:05.345005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1290/2585] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:05 2022] DELETE /identity/v3/projects/249fb9ab70d044aeb5cd9ddd224621e6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:05.350613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4ac80-72c9-4c22-a5d9-c704fd12e6f3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:05.351158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4ac80-72c9-4c22-a5d9-c704fd12e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:05.351260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4ac80-72c9-4c22-a5d9-c704fd12e6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:05.372677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-69c4ac80-72c9-4c22-a5d9-c704fd12e6f3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:05.373925 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-69c4ac80-72c9-4c22-a5d9-c704fd12e6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:05.440509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1296/2586] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:05.453614 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d735ec-7769-4f30-bdc2-305873f643eb None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:05.453898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d735ec-7769-4f30-bdc2-305873f643eb None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:05.454236 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d735ec-7769-4f30-bdc2-305873f643eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:05.478301 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-17d735ec-7769-4f30-bdc2-305873f643eb None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:05.479519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-17d735ec-7769-4f30-bdc2-305873f643eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:05.487719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1291/2587] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:58:05.492721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4ac80-72c9-4c22-a5d9-c704fd12e6f3 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:05.502758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4ac80-72c9-4c22-a5d9-c704fd12e6f3 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:05.507638 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ba7ca-8665-4cae-9318-8d81abdb7d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:05.508254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ba7ca-8665-4cae-9318-8d81abdb7d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:05.508624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ba7ca-8665-4cae-9318-8d81abdb7d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:05.508896 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ba7ca-8665-4cae-9318-8d81abdb7d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:05.509550 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ba7ca-8665-4cae-9318-8d81abdb7d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:58:05.509850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ba7ca-8665-4cae-9318-8d81abdb7d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:05.511452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ba7ca-8665-4cae-9318-8d81abdb7d03 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:05.526191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1297/2588] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:58:05.530179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d735ec-7769-4f30-bdc2-305873f643eb None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:05.540716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d735ec-7769-4f30-bdc2-305873f643eb None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:05.545679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc181631-794c-4be5-a920-0d3711d30239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:05.546290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc181631-794c-4be5-a920-0d3711d30239 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:05.546569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc181631-794c-4be5-a920-0d3711d30239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:05.546844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc181631-794c-4be5-a920-0d3711d30239 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:05.547490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc181631-794c-4be5-a920-0d3711d30239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:05.549420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc181631-794c-4be5-a920-0d3711d30239 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:05.664917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1292/2589] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:05 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:05.668943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ba7ca-8665-4cae-9318-8d81abdb7d03 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:05.680681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ba7ca-8665-4cae-9318-8d81abdb7d03 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:05.742013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216be8ac-279e-466f-92d9-9d0969233a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:05.742630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216be8ac-279e-466f-92d9-9d0969233a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:05.742906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216be8ac-279e-466f-92d9-9d0969233a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:05.743175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216be8ac-279e-466f-92d9-9d0969233a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:05.743811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216be8ac-279e-466f-92d9-9d0969233a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:05.745901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216be8ac-279e-466f-92d9-9d0969233a19 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:05.755293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:05.880757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1298/2590] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:05 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:05.885276 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc181631-794c-4be5-a920-0d3711d30239 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:05.896779 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc181631-794c-4be5-a920-0d3711d30239 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:05.901598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553ccd3-3cfe-4379-be60-90012b70c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:05.902225 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ccd3-3cfe-4379-be60-90012b70c569 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:05.902503 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ccd3-3cfe-4379-be60-90012b70c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:05.902774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553ccd3-3cfe-4379-be60-90012b70c569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:05.903422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553ccd3-3cfe-4379-be60-90012b70c569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:05.905069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553ccd3-3cfe-4379-be60-90012b70c569 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:05.916784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1293/2591] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:05.921851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216be8ac-279e-466f-92d9-9d0969233a19 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:05.932971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216be8ac-279e-466f-92d9-9d0969233a19 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:05.937940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf6b19-1b16-46ea-b999-a1f949017e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:05.938561 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf6b19-1b16-46ea-b999-a1f949017e76 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:05.938917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf6b19-1b16-46ea-b999-a1f949017e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:05.939198 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf6b19-1b16-46ea-b999-a1f949017e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:05.939878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf6b19-1b16-46ea-b999-a1f949017e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:05.941548 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf6b19-1b16-46ea-b999-a1f949017e76 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:05.954257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1299/2592] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:05.961156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553ccd3-3cfe-4379-be60-90012b70c569 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:05.972310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553ccd3-3cfe-4379-be60-90012b70c569 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:05.977866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4d046-35f2-49e7-bbbf-06bfbe865acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:05.978574 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4d046-35f2-49e7-bbbf-06bfbe865acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:05.978852 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4d046-35f2-49e7-bbbf-06bfbe865acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:05.979126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4d046-35f2-49e7-bbbf-06bfbe865acd admin admin] PATH_INFO: `/v3/projects/b25b14d6f14942bcac738145d1d06c6d/users/aadf174cf3d544fd808bd05620fc2e52/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:05.995620 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4d046-35f2-49e7-bbbf-06bfbe865acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25b14d6f14942bcac738145d1d06c6d, user_id=aadf174cf3d544fd808bd05620fc2e52, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:05.998389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a4d046-35f2-49e7-bbbf-06bfbe865acd admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:06.074254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1294/2593] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:05 2022] PUT /identity/v3/projects/b25b14d6f14942bcac738145d1d06c6d/users/aadf174cf3d544fd808bd05620fc2e52/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:06.085572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db819-7fd5-4d42-b16d-b53e75d8019c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:06.085890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db819-7fd5-4d42-b16d-b53e75d8019c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:06.091085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657db819-7fd5-4d42-b16d-b53e75d8019c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:06.114351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-657db819-7fd5-4d42-b16d-b53e75d8019c None None] MFA Rules not processed for user `aadf174cf3d544fd808bd05620fc2e52`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:06.115586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-657db819-7fd5-4d42-b16d-b53e75d8019c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:06.190776 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1300/2594] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:06.196572 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4d046-35f2-49e7-bbbf-06bfbe865acd admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:06.265809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a4d046-35f2-49e7-bbbf-06bfbe865acd admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:06.271369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cad05a-89f1-4be2-a156-45502ac699f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:06.271987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cad05a-89f1-4be2-a156-45502ac699f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:06.272271 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cad05a-89f1-4be2-a156-45502ac699f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:06.272584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cad05a-89f1-4be2-a156-45502ac699f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:06.273237 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cad05a-89f1-4be2-a156-45502ac699f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:06.275144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cad05a-89f1-4be2-a156-45502ac699f1 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:06.390156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1295/2595] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:06 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:06.394735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db819-7fd5-4d42-b16d-b53e75d8019c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:06.406796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657db819-7fd5-4d42-b16d-b53e75d8019c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:06.469545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a05f0-d1ce-4e56-95ee-97c70b6a9c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:06.470077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a05f0-d1ce-4e56-95ee-97c70b6a9c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:06.470357 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a05f0-d1ce-4e56-95ee-97c70b6a9c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:06.470631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a05f0-d1ce-4e56-95ee-97c70b6a9c26 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:06.471282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a05f0-d1ce-4e56-95ee-97c70b6a9c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:06.473353 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a05f0-d1ce-4e56-95ee-97c70b6a9c26 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:06.618039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1301/2596] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:06 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:06.622500 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cad05a-89f1-4be2-a156-45502ac699f1 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:06.634671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cad05a-89f1-4be2-a156-45502ac699f1 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:06.639865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acd854-d20e-4661-8f9f-7fdd1688f15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:06.640523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acd854-d20e-4661-8f9f-7fdd1688f15a admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:06.640930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acd854-d20e-4661-8f9f-7fdd1688f15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:06.641208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acd854-d20e-4661-8f9f-7fdd1688f15a admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:06.641874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acd854-d20e-4661-8f9f-7fdd1688f15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:06.643718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acd854-d20e-4661-8f9f-7fdd1688f15a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:06.658139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1296/2597] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:58:06.663959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a05f0-d1ce-4e56-95ee-97c70b6a9c26 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:06.675021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a05f0-d1ce-4e56-95ee-97c70b6a9c26 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:06.680749 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280a10b-f960-4d87-92fd-8feb3dee5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:06.681430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a10b-f960-4d87-92fd-8feb3dee5884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:06.681713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a10b-f960-4d87-92fd-8feb3dee5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:06.681986 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280a10b-f960-4d87-92fd-8feb3dee5884 admin admin] PATH_INFO: `/v3/projects/093bc7babcde4ded8788b1630d4afab5/users/067953f57f7a48ffaa31623c1df40fde/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:06.700444 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280a10b-f960-4d87-92fd-8feb3dee5884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093bc7babcde4ded8788b1630d4afab5, user_id=067953f57f7a48ffaa31623c1df40fde, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:06.703226 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280a10b-f960-4d87-92fd-8feb3dee5884 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:06.794141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1302/2598] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:06 2022] PUT /identity/v3/projects/093bc7babcde4ded8788b1630d4afab5/users/067953f57f7a48ffaa31623c1df40fde/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:06.798343 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acd854-d20e-4661-8f9f-7fdd1688f15a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:06.810145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acd854-d20e-4661-8f9f-7fdd1688f15a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:06.822244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:06.873456 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc49ea-759a-4b34-9949-dcbecd46f216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:06.874067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc49ea-759a-4b34-9949-dcbecd46f216 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:06.874361 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc49ea-759a-4b34-9949-dcbecd46f216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:06.874607 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc49ea-759a-4b34-9949-dcbecd46f216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:06.875245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc49ea-759a-4b34-9949-dcbecd46f216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:06.876879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc49ea-759a-4b34-9949-dcbecd46f216 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:06.887296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1297/2599] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:06.891985 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280a10b-f960-4d87-92fd-8feb3dee5884 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:06.904044 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280a10b-f960-4d87-92fd-8feb3dee5884 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:06.909141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c334a-95fe-456c-8435-7d9fee98d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:06.910027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c334a-95fe-456c-8435-7d9fee98d936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:06.910364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c334a-95fe-456c-8435-7d9fee98d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:06.910671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c334a-95fe-456c-8435-7d9fee98d936 admin admin] PATH_INFO: `/v3/projects/093bc7babcde4ded8788b1630d4afab5/users/067953f57f7a48ffaa31623c1df40fde/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:06.913332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c334a-95fe-456c-8435-7d9fee98d936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=093bc7babcde4ded8788b1630d4afab5, user_id=067953f57f7a48ffaa31623c1df40fde, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:06.917614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c334a-95fe-456c-8435-7d9fee98d936 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:06.928360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1303/2600] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:06 2022] PUT /identity/v3/projects/093bc7babcde4ded8788b1630d4afab5/users/067953f57f7a48ffaa31623c1df40fde/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:06.939873 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6d268-3195-43b8-a67e-61e91cfb7873 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:06.940202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6d268-3195-43b8-a67e-61e91cfb7873 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:06.940447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6d268-3195-43b8-a67e-61e91cfb7873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:06.971799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-a1d6d268-3195-43b8-a67e-61e91cfb7873 None None] MFA Rules not processed for user `067953f57f7a48ffaa31623c1df40fde`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:06.973050 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a1d6d268-3195-43b8-a67e-61e91cfb7873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:07.057181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1298/2601] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:06 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:58:07.070290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c334a-95fe-456c-8435-7d9fee98d936 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:07.072612 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8c4c334a-95fe-456c-8435-7d9fee98d936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:07.105126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:07.141486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c334a-95fe-456c-8435-7d9fee98d936 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:07.146474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd9867-562d-4713-8450-62d9d12f3a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:07.147118 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd9867-562d-4713-8450-62d9d12f3a36 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:07.147349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd9867-562d-4713-8450-62d9d12f3a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:07.147618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd9867-562d-4713-8450-62d9d12f3a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:07.207887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd9867-562d-4713-8450-62d9d12f3a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:07.209886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd9867-562d-4713-8450-62d9d12f3a36 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:07.220913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1304/2602] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:12.604142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6d268-3195-43b8-a67e-61e91cfb7873 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:12.605701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a1d6d268-3195-43b8-a67e-61e91cfb7873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:12.619049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6d268-3195-43b8-a67e-61e91cfb7873 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:12.622948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6818e-dc56-48a9-9d34-713e7f4b504d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:12.623642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6818e-dc56-48a9-9d34-713e7f4b504d service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:12.623919 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6818e-dc56-48a9-9d34-713e7f4b504d service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:12.624193 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6818e-dc56-48a9-9d34-713e7f4b504d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:12.635145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6818e-dc56-48a9-9d34-713e7f4b504d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:12.636609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6818e-dc56-48a9-9d34-713e7f4b504d service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:12.647404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1299/2603] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:17.215290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=38 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:18.585445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd9867-562d-4713-8450-62d9d12f3a36 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:18.686238 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd9867-562d-4713-8450-62d9d12f3a36 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:18.696453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:18.697665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:18.697665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:18.697877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] PATH_INFO: `/v3/users/aadf174cf3d544fd808bd05620fc2e52` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:18.699630 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadf174cf3d544fd808bd05620fc2e52)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:18.701772 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:18.980456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadf174cf3d544fd808bd05620fc2e52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:18.987757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadf174cf3d544fd808bd05620fc2e52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:18.988668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadf174cf3d544fd808bd05620fc2e52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:19.091646 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadf174cf3d544fd808bd05620fc2e52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:19.092105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadf174cf3d544fd808bd05620fc2e52'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:19.113251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1305/2604] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:18 2022] DELETE /identity/v3/users/aadf174cf3d544fd808bd05620fc2e52 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:19.118785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29572a-f063-48bd-b673-1ed7338bc5ca None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:19.119527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29572a-f063-48bd-b673-1ed7338bc5ca None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:19.119527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29572a-f063-48bd-b673-1ed7338bc5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:19.143718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0f29572a-f063-48bd-b673-1ed7338bc5ca None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:19.144985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0f29572a-f063-48bd-b673-1ed7338bc5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:19.236344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1300/2605] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:19.246714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:19.248186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:19.333029 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4f1e3-3638-4c57-8cf0-1a78cc17dd2f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:19.336958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f73e-bcb9-4b2c-9b84-d6c084c21677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:19.337575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f73e-bcb9-4b2c-9b84-d6c084c21677 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:19.337861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f73e-bcb9-4b2c-9b84-d6c084c21677 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:19.338115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038f73e-bcb9-4b2c-9b84-d6c084c21677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:19.352963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f73e-bcb9-4b2c-9b84-d6c084c21677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:19.352963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038f73e-bcb9-4b2c-9b84-d6c084c21677 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:19.363168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1306/2606] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:19.961780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29572a-f063-48bd-b673-1ed7338bc5ca None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:19.963479 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0f29572a-f063-48bd-b673-1ed7338bc5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:19.982106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29572a-f063-48bd-b673-1ed7338bc5ca None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:19.989175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:19.989794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:19.990169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:19.990492 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] PATH_INFO: `/v3/projects/b25b14d6f14942bcac738145d1d06c6d` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:19.991562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25b14d6f14942bcac738145d1d06c6d)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:19.993547 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:20.022679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=100 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:20.144859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25b14d6f14942bcac738145d1d06c6d', 'request_id': 'req-4980c2d2-ec03-43f4-b389-9bf65229a1ef'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:20.153976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25b14d6f14942bcac738145d1d06c6d', 'request_id': 'req-4980c2d2-ec03-43f4-b389-9bf65229a1ef'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:20.227230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25b14d6f14942bcac738145d1d06c6d', 'request_id': 'req-4980c2d2-ec03-43f4-b389-9bf65229a1ef'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:20.238715 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] The token cache is being invalidate because project b25b14d6f14942bcac738145d1d06c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:20.239002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:20.239684 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:20.241213 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1301/2607] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:19 2022] DELETE /identity/v3/projects/b25b14d6f14942bcac738145d1d06c6d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:20.245508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f73e-bcb9-4b2c-9b84-d6c084c21677 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:20.256916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038f73e-bcb9-4b2c-9b84-d6c084c21677 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:20.276127 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:20.316707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:20.317356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:20.318141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:20.318381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] PATH_INFO: `/v3/users/067953f57f7a48ffaa31623c1df40fde` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:20.319552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=067953f57f7a48ffaa31623c1df40fde)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:20.321565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:20.535462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067953f57f7a48ffaa31623c1df40fde'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:20.544060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067953f57f7a48ffaa31623c1df40fde'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:20.545105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067953f57f7a48ffaa31623c1df40fde'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:20.656917 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067953f57f7a48ffaa31623c1df40fde'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:20.657972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8b199a44-6928-41b1-a84d-66ec761208f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067953f57f7a48ffaa31623c1df40fde'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:20.682080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1307/2608] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:20 2022] DELETE /identity/v3/users/067953f57f7a48ffaa31623c1df40fde => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:21.098049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:21.100275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:21.134024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980c2d2-ec03-43f4-b389-9bf65229a1ef admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:21.188805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:21.189480 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:21.189710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:21.189986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] PATH_INFO: `/v3/projects/093bc7babcde4ded8788b1630d4afab5` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:21.191122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] RBAC: Authorizing `identity:delete_project(project_id=093bc7babcde4ded8788b1630d4afab5)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:21.193219 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:21.326374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '093bc7babcde4ded8788b1630d4afab5', 'request_id': 'req-86193738-efde-4ddb-be25-9da64ad6749b'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:21.333208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '093bc7babcde4ded8788b1630d4afab5', 'request_id': 'req-86193738-efde-4ddb-be25-9da64ad6749b'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:21.439090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '093bc7babcde4ded8788b1630d4afab5', 'request_id': 'req-86193738-efde-4ddb-be25-9da64ad6749b'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:21.451157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] The token cache is being invalidate because project 093bc7babcde4ded8788b1630d4afab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:21.451445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:21.452128 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-86193738-efde-4ddb-be25-9da64ad6749b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:21.453680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1302/2609] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:21 2022] DELETE /identity/v3/projects/093bc7babcde4ded8788b1630d4afab5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:21.461575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b9685-3fc7-4cc4-9ad0-478b3a3fa6ed None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:21.462458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b9685-3fc7-4cc4-9ad0-478b3a3fa6ed None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:21.462560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b9685-3fc7-4cc4-9ad0-478b3a3fa6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:21.484467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ac8b9685-3fc7-4cc4-9ad0-478b3a3fa6ed None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:21.485733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ac8b9685-3fc7-4cc4-9ad0-478b3a3fa6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:21.549730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1308/2610] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:21.558328 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684db5f4-b61b-4d9f-ad36-beb56bc364dd None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:21.558612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684db5f4-b61b-4d9f-ad36-beb56bc364dd None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:21.558890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684db5f4-b61b-4d9f-ad36-beb56bc364dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:21.580307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-684db5f4-b61b-4d9f-ad36-beb56bc364dd None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:21.581565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-684db5f4-b61b-4d9f-ad36-beb56bc364dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:21.590571 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1303/2611] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:21.595095 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b9685-3fc7-4cc4-9ad0-478b3a3fa6ed None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:21.605494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b9685-3fc7-4cc4-9ad0-478b3a3fa6ed None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:21.610011 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058fe0-1872-4da4-be66-12b33009acbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:21.610634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058fe0-1872-4da4-be66-12b33009acbc admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:21.610947 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058fe0-1872-4da4-be66-12b33009acbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:21.611167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058fe0-1872-4da4-be66-12b33009acbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:21.611799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f058fe0-1872-4da4-be66-12b33009acbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:58:21.612095 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f058fe0-1872-4da4-be66-12b33009acbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:21.613737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f058fe0-1872-4da4-be66-12b33009acbc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:21.626392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1309/2612] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:58:21.631959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684db5f4-b61b-4d9f-ad36-beb56bc364dd None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:21.641749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684db5f4-b61b-4d9f-ad36-beb56bc364dd None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:21.646474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46affb-0e59-4a34-897b-149681262d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:21.647080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46affb-0e59-4a34-897b-149681262d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:21.647357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46affb-0e59-4a34-897b-149681262d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:21.647633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46affb-0e59-4a34-897b-149681262d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:21.648260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46affb-0e59-4a34-897b-149681262d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:21.650201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af46affb-0e59-4a34-897b-149681262d3e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:21.733714 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1304/2613] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:21 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:21.738175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058fe0-1872-4da4-be66-12b33009acbc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:21.750536 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058fe0-1872-4da4-be66-12b33009acbc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:21.780251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:21.818184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632868e7-328d-46bf-a0d5-6b4eee58f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:21.818922 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632868e7-328d-46bf-a0d5-6b4eee58f018 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:21.819298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632868e7-328d-46bf-a0d5-6b4eee58f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:21.819681 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632868e7-328d-46bf-a0d5-6b4eee58f018 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:21.820391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632868e7-328d-46bf-a0d5-6b4eee58f018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:21.823413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632868e7-328d-46bf-a0d5-6b4eee58f018 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:21.925315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1310/2614] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:21 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:21.930749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46affb-0e59-4a34-897b-149681262d3e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:21.941495 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af46affb-0e59-4a34-897b-149681262d3e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:21.946164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff385c23-7900-4fd6-94fb-6ab6817327c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:21.946856 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff385c23-7900-4fd6-94fb-6ab6817327c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:21.947137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff385c23-7900-4fd6-94fb-6ab6817327c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:21.947432 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff385c23-7900-4fd6-94fb-6ab6817327c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:21.948080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff385c23-7900-4fd6-94fb-6ab6817327c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:21.949709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff385c23-7900-4fd6-94fb-6ab6817327c6 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:21.952243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:21.961056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1305/2615] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:21.965284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632868e7-328d-46bf-a0d5-6b4eee58f018 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:21.976256 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632868e7-328d-46bf-a0d5-6b4eee58f018 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:21.981025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4b9fd-8c8b-4eea-bf6b-1d6f4324c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:21.981628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4b9fd-8c8b-4eea-bf6b-1d6f4324c898 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:21.981905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4b9fd-8c8b-4eea-bf6b-1d6f4324c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:21.982173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4b9fd-8c8b-4eea-bf6b-1d6f4324c898 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:21.982818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4b9fd-8c8b-4eea-bf6b-1d6f4324c898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:21.984402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4b9fd-8c8b-4eea-bf6b-1d6f4324c898 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:21.995934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1311/2616] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:22.000636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff385c23-7900-4fd6-94fb-6ab6817327c6 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:22.011178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff385c23-7900-4fd6-94fb-6ab6817327c6 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:22.017368 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d23c-56db-42ad-87c8-a478661241ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:22.018084 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d23c-56db-42ad-87c8-a478661241ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:22.020840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d23c-56db-42ad-87c8-a478661241ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:22.020840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d23c-56db-42ad-87c8-a478661241ac admin admin] PATH_INFO: `/v3/projects/e78579ccb59c49b7b8e792ad04e9fe5c/users/62ea3c1771cc41a8a7ab1e688fbad5ee/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:22.036850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71d23c-56db-42ad-87c8-a478661241ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78579ccb59c49b7b8e792ad04e9fe5c, user_id=62ea3c1771cc41a8a7ab1e688fbad5ee, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:22.039670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71d23c-56db-42ad-87c8-a478661241ac admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:22.193913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1306/2617] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:21 2022] PUT /identity/v3/projects/e78579ccb59c49b7b8e792ad04e9fe5c/users/62ea3c1771cc41a8a7ab1e688fbad5ee/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:22.206724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b40213-d227-45a0-9cb5-77f6efd96e43 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:22.206938 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b40213-d227-45a0-9cb5-77f6efd96e43 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:22.207381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b40213-d227-45a0-9cb5-77f6efd96e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:22.364506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-50b40213-d227-45a0-9cb5-77f6efd96e43 None None] MFA Rules not processed for user `62ea3c1771cc41a8a7ab1e688fbad5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:22.365839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-50b40213-d227-45a0-9cb5-77f6efd96e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:22.439583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1312/2618] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:22.451414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d23c-56db-42ad-87c8-a478661241ac admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:22.454441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0c71d23c-56db-42ad-87c8-a478661241ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:22.516951 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d23c-56db-42ad-87c8-a478661241ac admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:22.522357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb0fde1-0f45-4b1d-bad7-e50cea2805f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:22.523108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0fde1-0f45-4b1d-bad7-e50cea2805f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:22.523398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0fde1-0f45-4b1d-bad7-e50cea2805f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:22.523675 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb0fde1-0f45-4b1d-bad7-e50cea2805f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:22.535983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0fde1-0f45-4b1d-bad7-e50cea2805f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:22.537550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb0fde1-0f45-4b1d-bad7-e50cea2805f0 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:22.549864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1307/2619] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:22.579725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b40213-d227-45a0-9cb5-77f6efd96e43 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:22.650697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b40213-d227-45a0-9cb5-77f6efd96e43 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:22.655774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:22.656094 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:22.656379 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:22.656691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] PATH_INFO: `/v3/users/62ea3c1771cc41a8a7ab1e688fbad5ee` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:22.658321 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ea3c1771cc41a8a7ab1e688fbad5ee)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:22.660135 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:22.860897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:22.867142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ea3c1771cc41a8a7ab1e688fbad5ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:22.874348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ea3c1771cc41a8a7ab1e688fbad5ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:22.875085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ea3c1771cc41a8a7ab1e688fbad5ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:22.924963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ea3c1771cc41a8a7ab1e688fbad5ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:22.926004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ea3c1771cc41a8a7ab1e688fbad5ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:22.946048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1313/2620] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:22 2022] DELETE /identity/v3/users/62ea3c1771cc41a8a7ab1e688fbad5ee => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:22.951137 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63924f66-10ff-48bd-aea8-e9d181231811 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:22.951451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63924f66-10ff-48bd-aea8-e9d181231811 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:22.951767 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63924f66-10ff-48bd-aea8-e9d181231811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:22.972061 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-63924f66-10ff-48bd-aea8-e9d181231811 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:22.973317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-63924f66-10ff-48bd-aea8-e9d181231811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:23.035569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1308/2621] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:23.045408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:23.047195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:23.108473 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826720e-7a13-4729-9ca0-a73984922aa1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:23.112199 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5c2ac-1730-409c-8d6b-82df31726c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:23.112928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c2ac-1730-409c-8d6b-82df31726c5d service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:23.113191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c2ac-1730-409c-8d6b-82df31726c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:23.113752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5c2ac-1730-409c-8d6b-82df31726c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:23.123861 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5c2ac-1730-409c-8d6b-82df31726c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:23.126019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5c2ac-1730-409c-8d6b-82df31726c5d service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:23.139655 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1314/2622] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:23.182053 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63924f66-10ff-48bd-aea8-e9d181231811 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:23.184288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-63924f66-10ff-48bd-aea8-e9d181231811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:23.205864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63924f66-10ff-48bd-aea8-e9d181231811 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:23.211798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1b36a-5bce-4979-9a87-4bedd6e2cb4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:23.212966 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b36a-5bce-4979-9a87-4bedd6e2cb4f service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:23.213536 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b36a-5bce-4979-9a87-4bedd6e2cb4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:23.214095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b36a-5bce-4979-9a87-4bedd6e2cb4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:23.216723 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fad1b36a-5bce-4979-9a87-4bedd6e2cb4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:23.230056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1b36a-5bce-4979-9a87-4bedd6e2cb4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:23.231505 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1b36a-5bce-4979-9a87-4bedd6e2cb4f service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:23.243613 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1309/2623] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:23.675168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5c2ac-1730-409c-8d6b-82df31726c5d service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:23.675168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ecc5c2ac-1730-409c-8d6b-82df31726c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:23.693075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5c2ac-1730-409c-8d6b-82df31726c5d service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:23.698197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:23.698852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:23.699131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:23.699412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] PATH_INFO: `/v3/projects/e78579ccb59c49b7b8e792ad04e9fe5c` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:23.700829 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78579ccb59c49b7b8e792ad04e9fe5c)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:23.702774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:23.835573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78579ccb59c49b7b8e792ad04e9fe5c', 'request_id': 'req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:23.843924 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78579ccb59c49b7b8e792ad04e9fe5c', 'request_id': 'req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:23.902641 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78579ccb59c49b7b8e792ad04e9fe5c', 'request_id': 'req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:23.920526 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] The token cache is being invalidate because project e78579ccb59c49b7b8e792ad04e9fe5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:23.920736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:23.921410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-9619376b-f6b1-4ed4-80f2-c75c7c7a6d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:23.922945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1315/2624] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:23 2022] DELETE /identity/v3/projects/e78579ccb59c49b7b8e792ad04e9fe5c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:23.928912 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bcefe-8e32-4810-8904-a48b7a8add06 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:23.929192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bcefe-8e32-4810-8904-a48b7a8add06 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:23.929462 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bcefe-8e32-4810-8904-a48b7a8add06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:23.949820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-d30bcefe-8e32-4810-8904-a48b7a8add06 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:23.951045 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d30bcefe-8e32-4810-8904-a48b7a8add06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:24.023810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1310/2625] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:24.031537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f934f0-6f84-4eb2-8a19-07bf8dc0d17c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:24.031819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f934f0-6f84-4eb2-8a19-07bf8dc0d17c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:24.032091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f934f0-6f84-4eb2-8a19-07bf8dc0d17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:24.053114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-84f934f0-6f84-4eb2-8a19-07bf8dc0d17c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:24.054287 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-84f934f0-6f84-4eb2-8a19-07bf8dc0d17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:24.062324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1316/2626] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:24.066621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bcefe-8e32-4810-8904-a48b7a8add06 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:24.073475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:24.078306 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bcefe-8e32-4810-8904-a48b7a8add06 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:24.084040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876f31-ca1d-42e8-996e-4cec8735ce55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:24.089037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876f31-ca1d-42e8-996e-4cec8735ce55 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:24.089037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876f31-ca1d-42e8-996e-4cec8735ce55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:24.089037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876f31-ca1d-42e8-996e-4cec8735ce55 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:24.089037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf876f31-ca1d-42e8-996e-4cec8735ce55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:58:24.089037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf876f31-ca1d-42e8-996e-4cec8735ce55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:24.089037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf876f31-ca1d-42e8-996e-4cec8735ce55 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:24.102086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1311/2627] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:58:24.106523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f934f0-6f84-4eb2-8a19-07bf8dc0d17c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:24.116086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f934f0-6f84-4eb2-8a19-07bf8dc0d17c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:24.121424 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb2022-3223-4b23-8511-f27761755f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:24.122101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb2022-3223-4b23-8511-f27761755f81 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:24.122382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb2022-3223-4b23-8511-f27761755f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:24.122645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb2022-3223-4b23-8511-f27761755f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:24.123559 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb2022-3223-4b23-8511-f27761755f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:24.125577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bb2022-3223-4b23-8511-f27761755f81 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:24.218639 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1317/2628] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:24 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:58:24.223097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876f31-ca1d-42e8-996e-4cec8735ce55 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:24.235825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876f31-ca1d-42e8-996e-4cec8735ce55 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:24.304321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f8641-7587-489f-9de9-90154857d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:24.304999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8641-7587-489f-9de9-90154857d967 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:24.305275 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8641-7587-489f-9de9-90154857d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:24.305543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f8641-7587-489f-9de9-90154857d967 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:24.306189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f8641-7587-489f-9de9-90154857d967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:24.308087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f8641-7587-489f-9de9-90154857d967 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:24.431731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1312/2629] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:24 2022] POST /identity/v3/users => generated 281 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:24.434994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb2022-3223-4b23-8511-f27761755f81 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:24.447891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb2022-3223-4b23-8511-f27761755f81 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:24.452913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a678ac6-0518-40c1-a0d0-98d8bfd382f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:24.453541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a678ac6-0518-40c1-a0d0-98d8bfd382f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:24.453817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a678ac6-0518-40c1-a0d0-98d8bfd382f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:24.454090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a678ac6-0518-40c1-a0d0-98d8bfd382f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:24.454825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a678ac6-0518-40c1-a0d0-98d8bfd382f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:24.456539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a678ac6-0518-40c1-a0d0-98d8bfd382f4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:24.468935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1318/2630] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:24.475251 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f8641-7587-489f-9de9-90154857d967 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:24.495785 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f8641-7587-489f-9de9-90154857d967 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:24.499612 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d772e-5294-4ebf-9d7f-7c4fd323c3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:24.500280 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d772e-5294-4ebf-9d7f-7c4fd323c3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:24.500593 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d772e-5294-4ebf-9d7f-7c4fd323c3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:24.500874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d772e-5294-4ebf-9d7f-7c4fd323c3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:24.501550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d772e-5294-4ebf-9d7f-7c4fd323c3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:24.503394 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d772e-5294-4ebf-9d7f-7c4fd323c3b0 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:24.522233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1313/2631] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:24.523751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a678ac6-0518-40c1-a0d0-98d8bfd382f4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:24.529265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:24.535147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a678ac6-0518-40c1-a0d0-98d8bfd382f4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:24.541005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7e166-67b5-4e99-8b14-f2cd8d5f3517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:24.546952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7e166-67b5-4e99-8b14-f2cd8d5f3517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:24.546952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7e166-67b5-4e99-8b14-f2cd8d5f3517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:24.546952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7e166-67b5-4e99-8b14-f2cd8d5f3517 admin admin] PATH_INFO: `/v3/projects/3e29131d0fd745d79507a4bdfcae2475/users/3fb0fc5ac6344ba5b94b49ea4c28f786/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:24.570258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7e166-67b5-4e99-8b14-f2cd8d5f3517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e29131d0fd745d79507a4bdfcae2475, user_id=3fb0fc5ac6344ba5b94b49ea4c28f786, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:24.575923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7e166-67b5-4e99-8b14-f2cd8d5f3517 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:24.684847 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1319/2632] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:24 2022] PUT /identity/v3/projects/3e29131d0fd745d79507a4bdfcae2475/users/3fb0fc5ac6344ba5b94b49ea4c28f786/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:24.697167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89e824-b429-4252-9be8-c27d93d47b91 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:24.697695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89e824-b429-4252-9be8-c27d93d47b91 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:24.698182 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89e824-b429-4252-9be8-c27d93d47b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:24.755726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-ca89e824-b429-4252-9be8-c27d93d47b91 None None] MFA Rules not processed for user `3fb0fc5ac6344ba5b94b49ea4c28f786`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:24.758317 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ca89e824-b429-4252-9be8-c27d93d47b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:24.846996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1314/2633] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:24.890430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7e166-67b5-4e99-8b14-f2cd8d5f3517 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:24.892345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7fd7e166-67b5-4e99-8b14-f2cd8d5f3517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:24.954850 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7e166-67b5-4e99-8b14-f2cd8d5f3517 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:24.958450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36233cf-b599-4873-a466-a47c49e5bfc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:24.959063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36233cf-b599-4873-a466-a47c49e5bfc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:24.959340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36233cf-b599-4873-a466-a47c49e5bfc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:24.959616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36233cf-b599-4873-a466-a47c49e5bfc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:24.968744 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36233cf-b599-4873-a466-a47c49e5bfc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:24.970182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36233cf-b599-4873-a466-a47c49e5bfc8 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:24.980737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1320/2634] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:24.997758 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89e824-b429-4252-9be8-c27d93d47b91 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:25.088398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89e824-b429-4252-9be8-c27d93d47b91 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:25.095452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:25.096383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:25.096716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:25.097114 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] PATH_INFO: `/v3/users/3fb0fc5ac6344ba5b94b49ea4c28f786` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:25.098372 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb0fc5ac6344ba5b94b49ea4c28f786)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:25.101290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:25.103136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:25.453780 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb0fc5ac6344ba5b94b49ea4c28f786'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:25.465911 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb0fc5ac6344ba5b94b49ea4c28f786'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:25.468511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb0fc5ac6344ba5b94b49ea4c28f786'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:25.556408 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb0fc5ac6344ba5b94b49ea4c28f786'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:25.572804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb0fc5ac6344ba5b94b49ea4c28f786'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:25.584960 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1315/2635] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:24 2022] DELETE /identity/v3/users/3fb0fc5ac6344ba5b94b49ea4c28f786 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:25.587953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975f9c7-5395-40e7-84e2-b9acb97c1b7c None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:25.588451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975f9c7-5395-40e7-84e2-b9acb97c1b7c None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:25.588916 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975f9c7-5395-40e7-84e2-b9acb97c1b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:25.610587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-c975f9c7-5395-40e7-84e2-b9acb97c1b7c None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:25.612034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c975f9c7-5395-40e7-84e2-b9acb97c1b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:25.692216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1321/2636] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:25.703256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:25.704957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:25.775273 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312814-57bb-4c7d-afde-83c65f3bb995 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:25.779163 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eeec6-f223-4225-9e23-13578536b3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:25.779903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eeec6-f223-4225-9e23-13578536b3af service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:25.780238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eeec6-f223-4225-9e23-13578536b3af service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:25.780646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eeec6-f223-4225-9e23-13578536b3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:25.790681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eeec6-f223-4225-9e23-13578536b3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:25.792238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eeec6-f223-4225-9e23-13578536b3af service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:25.803142 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1316/2637] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:26.334697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975f9c7-5395-40e7-84e2-b9acb97c1b7c None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:26.336527 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-c975f9c7-5395-40e7-84e2-b9acb97c1b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:26.350993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975f9c7-5395-40e7-84e2-b9acb97c1b7c None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:26.369888 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:26.371458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:26.371709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:26.372108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] PATH_INFO: `/v3/projects/3e29131d0fd745d79507a4bdfcae2475` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:26.373692 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e29131d0fd745d79507a4bdfcae2475)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:26.375798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:26.511305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e29131d0fd745d79507a4bdfcae2475', 'request_id': 'req-c45cb8c2-3432-449b-8b0d-912faca2c1a9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:26.518714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e29131d0fd745d79507a4bdfcae2475', 'request_id': 'req-c45cb8c2-3432-449b-8b0d-912faca2c1a9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:26.600835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e29131d0fd745d79507a4bdfcae2475', 'request_id': 'req-c45cb8c2-3432-449b-8b0d-912faca2c1a9'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:26.616782 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] The token cache is being invalidate because project 3e29131d0fd745d79507a4bdfcae2475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:26.617091 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:26.618070 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-c45cb8c2-3432-449b-8b0d-912faca2c1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:26.619529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1322/2638] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:26 2022] DELETE /identity/v3/projects/3e29131d0fd745d79507a4bdfcae2475 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:26.628107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54bf06-9d24-434c-aaf9-e9d838557206 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:26.630081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54bf06-9d24-434c-aaf9-e9d838557206 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:26.630786 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54bf06-9d24-434c-aaf9-e9d838557206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:26.658358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-ff54bf06-9d24-434c-aaf9-e9d838557206 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:26.660124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ff54bf06-9d24-434c-aaf9-e9d838557206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:26.787409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1317/2639] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:26.864312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ce44c-f282-403a-9fba-9b95f84f441b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:26.865042 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ce44c-f282-403a-9fba-9b95f84f441b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:26.865042 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ce44c-f282-403a-9fba-9b95f84f441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:26.873493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:26.889146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-460ce44c-f282-403a-9fba-9b95f84f441b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:26.890827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-460ce44c-f282-403a-9fba-9b95f84f441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:26.901734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1323/2640] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:26.906560 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54bf06-9d24-434c-aaf9-e9d838557206 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:26.919209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54bf06-9d24-434c-aaf9-e9d838557206 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:26.925404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16011fa2-5f36-430b-aded-68ca5ea96481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:26.926066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16011fa2-5f36-430b-aded-68ca5ea96481 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:26.926349 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16011fa2-5f36-430b-aded-68ca5ea96481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:26.926633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16011fa2-5f36-430b-aded-68ca5ea96481 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:26.927321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16011fa2-5f36-430b-aded-68ca5ea96481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:58:26.927595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16011fa2-5f36-430b-aded-68ca5ea96481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:26.929367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16011fa2-5f36-430b-aded-68ca5ea96481 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:26.944074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1318/2641] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:58:26.948854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ce44c-f282-403a-9fba-9b95f84f441b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:26.958910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ce44c-f282-403a-9fba-9b95f84f441b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:26.964286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10086aad-fdad-4420-976b-3a1da7626d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:26.965234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10086aad-fdad-4420-976b-3a1da7626d3f admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:26.965657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10086aad-fdad-4420-976b-3a1da7626d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:26.966340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10086aad-fdad-4420-976b-3a1da7626d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:26.966919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10086aad-fdad-4420-976b-3a1da7626d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:26.969109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10086aad-fdad-4420-976b-3a1da7626d3f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:27.051535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1324/2642] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:26 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:27.053009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16011fa2-5f36-430b-aded-68ca5ea96481 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:27.064249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16011fa2-5f36-430b-aded-68ca5ea96481 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:27.070881 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:27.133235 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ca370-bfc6-4511-bd3a-6b83a09b0d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:27.142025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ca370-bfc6-4511-bd3a-6b83a09b0d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:27.142025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ca370-bfc6-4511-bd3a-6b83a09b0d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:27.142025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ca370-bfc6-4511-bd3a-6b83a09b0d5c admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:27.142025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ca370-bfc6-4511-bd3a-6b83a09b0d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:27.142025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ca370-bfc6-4511-bd3a-6b83a09b0d5c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:27.269108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1319/2643] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:27 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:27.274251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10086aad-fdad-4420-976b-3a1da7626d3f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:27.285628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10086aad-fdad-4420-976b-3a1da7626d3f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:27.291000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aea405-b3c5-4bbe-bb1a-eeb061c9625c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:27.291700 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aea405-b3c5-4bbe-bb1a-eeb061c9625c admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:27.292031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aea405-b3c5-4bbe-bb1a-eeb061c9625c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:27.292291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aea405-b3c5-4bbe-bb1a-eeb061c9625c admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:27.293243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aea405-b3c5-4bbe-bb1a-eeb061c9625c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:27.294909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aea405-b3c5-4bbe-bb1a-eeb061c9625c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:27.306284 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1325/2644] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:27.310220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ca370-bfc6-4511-bd3a-6b83a09b0d5c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:27.322352 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ca370-bfc6-4511-bd3a-6b83a09b0d5c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:27.327875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bb938-9c2c-49d6-a8b7-a49f53f00a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:27.328764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bb938-9c2c-49d6-a8b7-a49f53f00a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:27.329822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bb938-9c2c-49d6-a8b7-a49f53f00a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:27.329822 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bb938-9c2c-49d6-a8b7-a49f53f00a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:27.330736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bb938-9c2c-49d6-a8b7-a49f53f00a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:27.332879 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bb938-9c2c-49d6-a8b7-a49f53f00a76 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:27.346888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1320/2645] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:58:27.352080 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aea405-b3c5-4bbe-bb1a-eeb061c9625c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:27.363815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aea405-b3c5-4bbe-bb1a-eeb061c9625c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:27.369209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3122ae85-a7df-4169-94e1-1411432d20cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:27.369879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ae85-a7df-4169-94e1-1411432d20cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:27.370147 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ae85-a7df-4169-94e1-1411432d20cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:27.370426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3122ae85-a7df-4169-94e1-1411432d20cf admin admin] PATH_INFO: `/v3/projects/6b2f2da8652447e2bc8f49d746082fed/users/12c37bcc528a45dda7985a41c2e01e8f/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:27.389582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122ae85-a7df-4169-94e1-1411432d20cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b2f2da8652447e2bc8f49d746082fed, user_id=12c37bcc528a45dda7985a41c2e01e8f, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:27.392276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3122ae85-a7df-4169-94e1-1411432d20cf admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:27.537564 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bb938-9c2c-49d6-a8b7-a49f53f00a76 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:27.539434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-580bb938-9c2c-49d6-a8b7-a49f53f00a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:27.553776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bb938-9c2c-49d6-a8b7-a49f53f00a76 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:27.558799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:27.559464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:27.559743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:27.560043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] PATH_INFO: `/v3/users/fb465b4782514e7d8e75a7dc14c0a1e7` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:27.561199 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb465b4782514e7d8e75a7dc14c0a1e7)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:27.563158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:27.572872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1326/2646] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:27 2022] PUT /identity/v3/projects/6b2f2da8652447e2bc8f49d746082fed/users/12c37bcc528a45dda7985a41c2e01e8f/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:27.591350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ad19-2251-4f4a-b4d6-e50ae8b3d2de None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:27.591796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ad19-2251-4f4a-b4d6-e50ae8b3d2de None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:27.592209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7ad19-2251-4f4a-b4d6-e50ae8b3d2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:27.625088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-61c7ad19-2251-4f4a-b4d6-e50ae8b3d2de None None] MFA Rules not processed for user `12c37bcc528a45dda7985a41c2e01e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:27.626330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-61c7ad19-2251-4f4a-b4d6-e50ae8b3d2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:27.698665 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1327/2647] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:27.710012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ad19-2251-4f4a-b4d6-e50ae8b3d2de None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:27.711415 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-61c7ad19-2251-4f4a-b4d6-e50ae8b3d2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:27.768757 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7ad19-2251-4f4a-b4d6-e50ae8b3d2de None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:27.774065 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc50ee-68db-4ddb-8a06-a8dc3922df44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:27.775068 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc50ee-68db-4ddb-8a06-a8dc3922df44 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:27.775537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc50ee-68db-4ddb-8a06-a8dc3922df44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:27.776004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc50ee-68db-4ddb-8a06-a8dc3922df44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:27.785827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc50ee-68db-4ddb-8a06-a8dc3922df44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:27.787785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc50ee-68db-4ddb-8a06-a8dc3922df44 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:27.797044 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1328/2648] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:58:27.814972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb465b4782514e7d8e75a7dc14c0a1e7'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:27.823208 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb465b4782514e7d8e75a7dc14c0a1e7'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:27.824030 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb465b4782514e7d8e75a7dc14c0a1e7'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:27.878625 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb465b4782514e7d8e75a7dc14c0a1e7'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:27.892707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-46b95b7c-043e-40f5-b2bf-4cde22a24469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb465b4782514e7d8e75a7dc14c0a1e7'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:27.900181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1321/2649] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:27 2022] DELETE /identity/v3/users/fb465b4782514e7d8e75a7dc14c0a1e7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:28.155873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc50ee-68db-4ddb-8a06-a8dc3922df44 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:28.213063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:28.234821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc50ee-68db-4ddb-8a06-a8dc3922df44 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:28.296187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:28.296950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:28.297303 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:28.297875 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] PATH_INFO: `/v3/projects/754af1c2cd154e91ad9ecbee3ce04d0d` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:28.299262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=754af1c2cd154e91ad9ecbee3ce04d0d)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:28.302249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:28.479452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754af1c2cd154e91ad9ecbee3ce04d0d', 'request_id': 'req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:28.479841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754af1c2cd154e91ad9ecbee3ce04d0d', 'request_id': 'req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:28.564245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754af1c2cd154e91ad9ecbee3ce04d0d', 'request_id': 'req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:28.579404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] The token cache is being invalidate because project 754af1c2cd154e91ad9ecbee3ce04d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:28.579694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:28.580506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0bc4e4ac-2486-4dfb-bcad-e91737fa10c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:28.582451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1329/2650] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:28 2022] DELETE /identity/v3/projects/754af1c2cd154e91ad9ecbee3ce04d0d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:28.588334 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819261c6-ae41-400d-a570-0eadbd32f65f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:28.588663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819261c6-ae41-400d-a570-0eadbd32f65f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:28.588940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819261c6-ae41-400d-a570-0eadbd32f65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:28.609327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-819261c6-ae41-400d-a570-0eadbd32f65f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:28.610544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-819261c6-ae41-400d-a570-0eadbd32f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:28.666398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:28.684616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1322/2651] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:28.695869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4106e21-798f-49d9-8fb3-054796377fad None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:28.696293 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4106e21-798f-49d9-8fb3-054796377fad None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:28.696839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4106e21-798f-49d9-8fb3-054796377fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:28.721588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b4106e21-798f-49d9-8fb3-054796377fad None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:28.722887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b4106e21-798f-49d9-8fb3-054796377fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:28.736046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1330/2652] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:28.738107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819261c6-ae41-400d-a570-0eadbd32f65f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:28.749401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819261c6-ae41-400d-a570-0eadbd32f65f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:28.757817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824431d-d84a-4f6b-93ac-bb280a8a00c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:28.758248 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824431d-d84a-4f6b-93ac-bb280a8a00c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:28.758530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824431d-d84a-4f6b-93ac-bb280a8a00c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:28.758802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824431d-d84a-4f6b-93ac-bb280a8a00c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:28.759463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824431d-d84a-4f6b-93ac-bb280a8a00c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:58:28.759811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824431d-d84a-4f6b-93ac-bb280a8a00c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:28.761526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824431d-d84a-4f6b-93ac-bb280a8a00c3 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:28.774507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1323/2653] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:58:28.779439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4106e21-798f-49d9-8fb3-054796377fad None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:28.788465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4106e21-798f-49d9-8fb3-054796377fad None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:28.793217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e486fa4-3005-4bf5-902c-d9a56c19d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:28.793811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e486fa4-3005-4bf5-902c-d9a56c19d79c admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:28.794092 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e486fa4-3005-4bf5-902c-d9a56c19d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:28.794364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e486fa4-3005-4bf5-902c-d9a56c19d79c admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:28.795119 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e486fa4-3005-4bf5-902c-d9a56c19d79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:28.797257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e486fa4-3005-4bf5-902c-d9a56c19d79c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:28.909322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1331/2654] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:28 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:28.913667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824431d-d84a-4f6b-93ac-bb280a8a00c3 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:28.924440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824431d-d84a-4f6b-93ac-bb280a8a00c3 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:28.983249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e631e7-f13b-4f52-b835-1dbc700b6c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:28.983876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e631e7-f13b-4f52-b835-1dbc700b6c58 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:28.984138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e631e7-f13b-4f52-b835-1dbc700b6c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:28.984408 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e631e7-f13b-4f52-b835-1dbc700b6c58 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:28.985083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e631e7-f13b-4f52-b835-1dbc700b6c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:28.987049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e631e7-f13b-4f52-b835-1dbc700b6c58 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:29.096384 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1324/2655] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:28 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:29.101222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e486fa4-3005-4bf5-902c-d9a56c19d79c admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:29.111868 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e486fa4-3005-4bf5-902c-d9a56c19d79c admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:29.117392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dccf9-897a-43ab-a025-48e20fa6fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:29.119510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dccf9-897a-43ab-a025-48e20fa6fb50 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:29.119510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dccf9-897a-43ab-a025-48e20fa6fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:29.119510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dccf9-897a-43ab-a025-48e20fa6fb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:29.119510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dccf9-897a-43ab-a025-48e20fa6fb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:29.121024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dccf9-897a-43ab-a025-48e20fa6fb50 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:29.135590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1332/2656] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:29.137399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e631e7-f13b-4f52-b835-1dbc700b6c58 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:29.148982 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e631e7-f13b-4f52-b835-1dbc700b6c58 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:29.153990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eec181-44aa-4337-b969-ddd91c260886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:29.154606 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eec181-44aa-4337-b969-ddd91c260886 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:29.154885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eec181-44aa-4337-b969-ddd91c260886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:29.155177 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eec181-44aa-4337-b969-ddd91c260886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:29.155819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eec181-44aa-4337-b969-ddd91c260886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:29.157638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eec181-44aa-4337-b969-ddd91c260886 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:29.169521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1325/2657] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:29.174637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dccf9-897a-43ab-a025-48e20fa6fb50 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:29.186846 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dccf9-897a-43ab-a025-48e20fa6fb50 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:29.192028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a249073-6ca6-466f-ab6f-e3cf8b48f2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:29.193477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a249073-6ca6-466f-ab6f-e3cf8b48f2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:29.193756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a249073-6ca6-466f-ab6f-e3cf8b48f2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:29.194034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a249073-6ca6-466f-ab6f-e3cf8b48f2ed admin admin] PATH_INFO: `/v3/projects/58ed8c1236a24f00af4234a81e3f6469/users/3c2b6dc6cb1644ec9b7c6d77429bfa52/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:29.213048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a249073-6ca6-466f-ab6f-e3cf8b48f2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ed8c1236a24f00af4234a81e3f6469, user_id=3c2b6dc6cb1644ec9b7c6d77429bfa52, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:29.215866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a249073-6ca6-466f-ab6f-e3cf8b48f2ed admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:29.376731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1333/2658] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:29 2022] PUT /identity/v3/projects/58ed8c1236a24f00af4234a81e3f6469/users/3c2b6dc6cb1644ec9b7c6d77429bfa52/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:29.387667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9177d-30df-4f0b-9d37-1ab0fdba2f78 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:29.387941 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9177d-30df-4f0b-9d37-1ab0fdba2f78 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:29.388212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9177d-30df-4f0b-9d37-1ab0fdba2f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:29.425246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-d7a9177d-30df-4f0b-9d37-1ab0fdba2f78 None None] MFA Rules not processed for user `3c2b6dc6cb1644ec9b7c6d77429bfa52`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:29.428339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d7a9177d-30df-4f0b-9d37-1ab0fdba2f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:29.515872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1326/2659] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:29.520769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a249073-6ca6-466f-ab6f-e3cf8b48f2ed admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:29.530750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:29.603313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a249073-6ca6-466f-ab6f-e3cf8b48f2ed admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:29.608075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e88745-7132-42d2-9e02-a4aa3561fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:29.608877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e88745-7132-42d2-9e02-a4aa3561fb2a admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:29.609155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e88745-7132-42d2-9e02-a4aa3561fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:29.609425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e88745-7132-42d2-9e02-a4aa3561fb2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:29.610103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e88745-7132-42d2-9e02-a4aa3561fb2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:29.611999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e88745-7132-42d2-9e02-a4aa3561fb2a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:29.666878 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9177d-30df-4f0b-9d37-1ab0fdba2f78 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:29.668741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d7a9177d-30df-4f0b-9d37-1ab0fdba2f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:29.742253 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9177d-30df-4f0b-9d37-1ab0fdba2f78 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:29.746206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd11149-5fb6-44ca-9707-5de77d5354d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:29.746833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd11149-5fb6-44ca-9707-5de77d5354d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:29.747122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd11149-5fb6-44ca-9707-5de77d5354d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:29.747417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd11149-5fb6-44ca-9707-5de77d5354d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:29.749269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6bd11149-5fb6-44ca-9707-5de77d5354d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:29.759450 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:29.816378 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd11149-5fb6-44ca-9707-5de77d5354d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:29.817865 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd11149-5fb6-44ca-9707-5de77d5354d8 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:29.827158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1327/2660] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:58:29.905145 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1334/2661] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:29 2022] POST /identity/v3/projects => generated 381 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:29.910594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd11149-5fb6-44ca-9707-5de77d5354d8 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:29.922928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd11149-5fb6-44ca-9707-5de77d5354d8 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:29.998864 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3761-fab4-4284-8688-e9611112b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:29.999486 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3761-fab4-4284-8688-e9611112b1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:29.999763 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3761-fab4-4284-8688-e9611112b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:30.000031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e3761-fab4-4284-8688-e9611112b1aa admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:30.000701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e3761-fab4-4284-8688-e9611112b1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:30.002642 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393e3761-fab4-4284-8688-e9611112b1aa admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:30.154981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1328/2662] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:29 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:30.162463 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e88745-7132-42d2-9e02-a4aa3561fb2a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:30.174746 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e88745-7132-42d2-9e02-a4aa3561fb2a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:30.182105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee102333-38b8-4822-b336-4aa664e89d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:30.182832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee102333-38b8-4822-b336-4aa664e89d7b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:30.183183 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee102333-38b8-4822-b336-4aa664e89d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:30.183523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee102333-38b8-4822-b336-4aa664e89d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:30.184907 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee102333-38b8-4822-b336-4aa664e89d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:30.186936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee102333-38b8-4822-b336-4aa664e89d7b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:30.200616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1335/2663] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:30.204983 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3761-fab4-4284-8688-e9611112b1aa admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:30.218126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393e3761-fab4-4284-8688-e9611112b1aa admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:30.228460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8cea0-bed7-4499-bc1a-6587d7fc91b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:30.229751 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8cea0-bed7-4499-bc1a-6587d7fc91b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:30.230588 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8cea0-bed7-4499-bc1a-6587d7fc91b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:30.231327 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8cea0-bed7-4499-bc1a-6587d7fc91b7 admin admin] PATH_INFO: `/v3/projects/fec8afdc17424d93bf8f5828668253bb/users/a74766708f454512ac6e14bc4f371d19/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:30.265599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8cea0-bed7-4499-bc1a-6587d7fc91b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec8afdc17424d93bf8f5828668253bb, user_id=a74766708f454512ac6e14bc4f371d19, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:30.268753 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8cea0-bed7-4499-bc1a-6587d7fc91b7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:30.400323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1329/2664] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:30 2022] PUT /identity/v3/projects/fec8afdc17424d93bf8f5828668253bb/users/a74766708f454512ac6e14bc4f371d19/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:30.405120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee102333-38b8-4822-b336-4aa664e89d7b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:30.417285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee102333-38b8-4822-b336-4aa664e89d7b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:30.569378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3481d4-1f62-473a-a976-305dd309df0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:30.570010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3481d4-1f62-473a-a976-305dd309df0f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:30.570286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3481d4-1f62-473a-a976-305dd309df0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:30.570563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3481d4-1f62-473a-a976-305dd309df0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:30.571533 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3481d4-1f62-473a-a976-305dd309df0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:30.573333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3481d4-1f62-473a-a976-305dd309df0f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:30.587519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1336/2665] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:30.592060 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8cea0-bed7-4499-bc1a-6587d7fc91b7 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:30.605233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8cea0-bed7-4499-bc1a-6587d7fc91b7 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:30.610641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1552dd-72ba-4f3a-aa99-73ea8761e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:30.611403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1552dd-72ba-4f3a-aa99-73ea8761e7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:30.611726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1552dd-72ba-4f3a-aa99-73ea8761e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:30.612044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1552dd-72ba-4f3a-aa99-73ea8761e7a9 admin admin] PATH_INFO: `/v3/projects/fec8afdc17424d93bf8f5828668253bb/users/a74766708f454512ac6e14bc4f371d19/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:30.614386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1552dd-72ba-4f3a-aa99-73ea8761e7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec8afdc17424d93bf8f5828668253bb, user_id=a74766708f454512ac6e14bc4f371d19, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:30.617422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1552dd-72ba-4f3a-aa99-73ea8761e7a9 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:30.629389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1330/2666] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:30 2022] PUT /identity/v3/projects/fec8afdc17424d93bf8f5828668253bb/users/a74766708f454512ac6e14bc4f371d19/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:30.648620 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113e611-029c-4649-bbd1-b52dce4c576f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:30.648932 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113e611-029c-4649-bbd1-b52dce4c576f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:30.649173 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113e611-029c-4649-bbd1-b52dce4c576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:30.687737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b113e611-029c-4649-bbd1-b52dce4c576f None None] MFA Rules not processed for user `a74766708f454512ac6e14bc4f371d19`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:30.689288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b113e611-029c-4649-bbd1-b52dce4c576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:30.779787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1337/2667] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:58:30.792431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1552dd-72ba-4f3a-aa99-73ea8761e7a9 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:30.795535 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fb1552dd-72ba-4f3a-aa99-73ea8761e7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:30.860739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1552dd-72ba-4f3a-aa99-73ea8761e7a9 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:30.865268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6824b3-97bb-4cea-85d8-68e996b56625 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:30.866103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6824b3-97bb-4cea-85d8-68e996b56625 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:30.866679 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6824b3-97bb-4cea-85d8-68e996b56625 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:30.867075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6824b3-97bb-4cea-85d8-68e996b56625 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:30.877268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6824b3-97bb-4cea-85d8-68e996b56625 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:30.878778 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6824b3-97bb-4cea-85d8-68e996b56625 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:30.889632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1331/2668] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:31.170715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113e611-029c-4649-bbd1-b52dce4c576f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:31.175507 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:31.187428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113e611-029c-4649-bbd1-b52dce4c576f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:31.187428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cc6a1-cfeb-49d0-b3a4-e46620215e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:31.187428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc6a1-cfeb-49d0-b3a4-e46620215e43 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:31.187428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc6a1-cfeb-49d0-b3a4-e46620215e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:31.187909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2cc6a1-cfeb-49d0-b3a4-e46620215e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:31.256597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cc6a1-cfeb-49d0-b3a4-e46620215e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:31.258096 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2cc6a1-cfeb-49d0-b3a4-e46620215e43 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:31.268731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1338/2669] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:35.140690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6824b3-97bb-4cea-85d8-68e996b56625 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:35.142133 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fd6824b3-97bb-4cea-85d8-68e996b56625 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:35.147026 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:35.237869 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6824b3-97bb-4cea-85d8-68e996b56625 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:35.243936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fce2e9-701e-4a37-9f9c-1f92e767e335 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca09f6fe11f4b878dd11c4cb69ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:35.244583 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fce2e9-701e-4a37-9f9c-1f92e767e335 service placement] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:35.244870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fce2e9-701e-4a37-9f9c-1f92e767e335 service placement] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:35.245171 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fce2e9-701e-4a37-9f9c-1f92e767e335 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:35.246979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f2fce2e9-701e-4a37-9f9c-1f92e767e335 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:35.259939 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fce2e9-701e-4a37-9f9c-1f92e767e335 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:35.261659 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fce2e9-701e-4a37-9f9c-1f92e767e335 service placement] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:35.272091 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1332/2670] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:36.969818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cc6a1-cfeb-49d0-b3a4-e46620215e43 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:37.050699 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2cc6a1-cfeb-49d0-b3a4-e46620215e43 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:37.057342 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb66985-0aac-4d91-bab5-7207d35b8691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:37.058064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66985-0aac-4d91-bab5-7207d35b8691 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:37.058347 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66985-0aac-4d91-bab5-7207d35b8691 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:37.058619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb66985-0aac-4d91-bab5-7207d35b8691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:37.061691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bbb66985-0aac-4d91-bab5-7207d35b8691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:37.190604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb66985-0aac-4d91-bab5-7207d35b8691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:37.193927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb66985-0aac-4d91-bab5-7207d35b8691 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:37.216613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1339/2671] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:39.771249 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b8ae-0dd4-425b-b795-ff395a34f1b5 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:39.772151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b8ae-0dd4-425b-b795-ff395a34f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:39.772151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b8ae-0dd4-425b-b795-ff395a34f1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:39.796805 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-91e8b8ae-0dd4-425b-b795-ff395a34f1b5 None None] MFA Rules not processed for user `3a878450743f4843a5e8cc04ca94184d`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:39.798433 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-91e8b8ae-0dd4-425b-b795-ff395a34f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:39.867266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1333/2672] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:40.919970 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb66985-0aac-4d91-bab5-7207d35b8691 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:40.920432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bbb66985-0aac-4d91-bab5-7207d35b8691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:40.933299 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb66985-0aac-4d91-bab5-7207d35b8691 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:40.939040 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:40.939624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:40.939905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:40.940272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] PATH_INFO: `/v3/users/12c37bcc528a45dda7985a41c2e01e8f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:40.941495 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c37bcc528a45dda7985a41c2e01e8f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:40.943982 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:41.010569 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b8ae-0dd4-425b-b795-ff395a34f1b5 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:41.057033 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b8ae-0dd4-425b-b795-ff395a34f1b5 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:41.063290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:41.064841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:41.065318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:41.066037 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] PATH_INFO: `/v3/users/3c2b6dc6cb1644ec9b7c6d77429bfa52` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:41.069243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c2b6dc6cb1644ec9b7c6d77429bfa52)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:41.073866 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:41.214696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c37bcc528a45dda7985a41c2e01e8f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:41.214696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:41.217234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c37bcc528a45dda7985a41c2e01e8f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:41.218436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c37bcc528a45dda7985a41c2e01e8f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:41.303103 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c37bcc528a45dda7985a41c2e01e8f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:41.303807 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-3c45cb04-c496-4a42-8677-90b616858bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c37bcc528a45dda7985a41c2e01e8f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:41.330462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1340/2673] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:40 2022] DELETE /identity/v3/users/12c37bcc528a45dda7985a41c2e01e8f => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:41.333682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c2b6dc6cb1644ec9b7c6d77429bfa52'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:41.336019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dfbf0-5c40-4587-a292-101e44ce4ad5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:41.336518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dfbf0-5c40-4587-a292-101e44ce4ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:41.336943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dfbf0-5c40-4587-a292-101e44ce4ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:41.344322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c2b6dc6cb1644ec9b7c6d77429bfa52'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:41.345621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c2b6dc6cb1644ec9b7c6d77429bfa52'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:41.369518 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-b62dfbf0-5c40-4587-a292-101e44ce4ad5 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:41.370752 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b62dfbf0-5c40-4587-a292-101e44ce4ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:41.439312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c2b6dc6cb1644ec9b7c6d77429bfa52'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:41.441691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1341/2674] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:41.449029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:41.455062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b3f97f3d-6c24-4196-b91d-06ea99bae109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c2b6dc6cb1644ec9b7c6d77429bfa52'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:41.460003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dfbf0-5c40-4587-a292-101e44ce4ad5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:41.461580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-b62dfbf0-5c40-4587-a292-101e44ce4ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:41.463533 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1334/2675] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:41 2022] DELETE /identity/v3/users/3c2b6dc6cb1644ec9b7c6d77429bfa52 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:41.473010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496e523-2678-4971-9715-6f62c7d99b0a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:41.473010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496e523-2678-4971-9715-6f62c7d99b0a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:41.473010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496e523-2678-4971-9715-6f62c7d99b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:41.494097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9496e523-2678-4971-9715-6f62c7d99b0a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:41.495587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9496e523-2678-4971-9715-6f62c7d99b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:41.525510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62dfbf0-5c40-4587-a292-101e44ce4ad5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:41.558430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1335/2676] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:41.569980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496e523-2678-4971-9715-6f62c7d99b0a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:41.571487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9496e523-2678-4971-9715-6f62c7d99b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:41.581013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c8476-1580-4fcf-9121-a5c56c160f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:41.581621 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8476-1580-4fcf-9121-a5c56c160f5c service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:41.582953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8476-1580-4fcf-9121-a5c56c160f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:41.582953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c8476-1580-4fcf-9121-a5c56c160f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:41.584160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dd0c8476-1580-4fcf-9121-a5c56c160f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:41.596651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c8476-1580-4fcf-9121-a5c56c160f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:41.598948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c8476-1580-4fcf-9121-a5c56c160f5c service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:41.611890 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1342/2677] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:58:41.649840 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496e523-2678-4971-9715-6f62c7d99b0a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:41.654309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15cf00-c0cf-483b-9558-ec7aba30dd30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:41.655791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15cf00-c0cf-483b-9558-ec7aba30dd30 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:41.656126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15cf00-c0cf-483b-9558-ec7aba30dd30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:41.656460 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15cf00-c0cf-483b-9558-ec7aba30dd30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:41.668175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15cf00-c0cf-483b-9558-ec7aba30dd30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:41.669891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15cf00-c0cf-483b-9558-ec7aba30dd30 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:41.685638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1336/2678] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:58:42.244721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c8476-1580-4fcf-9121-a5c56c160f5c service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:42.250191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dd0c8476-1580-4fcf-9121-a5c56c160f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:42.261388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c8476-1580-4fcf-9121-a5c56c160f5c service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:42.268084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:42.270000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:42.270000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:42.270000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] PATH_INFO: `/v3/projects/6b2f2da8652447e2bc8f49d746082fed` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:42.271531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b2f2da8652447e2bc8f49d746082fed)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:42.273763 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:42.299486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:42.379905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b2f2da8652447e2bc8f49d746082fed', 'request_id': 'req-e7a0ecaa-837b-4662-bc36-a78639926653'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:42.388189 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b2f2da8652447e2bc8f49d746082fed', 'request_id': 'req-e7a0ecaa-837b-4662-bc36-a78639926653'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:42.449156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15cf00-c0cf-483b-9558-ec7aba30dd30 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:42.450883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-ed15cf00-c0cf-483b-9558-ec7aba30dd30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:42.465598 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15cf00-c0cf-483b-9558-ec7aba30dd30 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:42.539530 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:42.540310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:42.540623 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:42.540902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] PATH_INFO: `/v3/projects/58ed8c1236a24f00af4234a81e3f6469` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:42.542100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ed8c1236a24f00af4234a81e3f6469)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:42.544146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:42.570316 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b2f2da8652447e2bc8f49d746082fed', 'request_id': 'req-e7a0ecaa-837b-4662-bc36-a78639926653'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:42.591321 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] The token cache is being invalidate because project 6b2f2da8652447e2bc8f49d746082fed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:42.592060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:42.593070 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:42.595237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1343/2679] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:42 2022] DELETE /identity/v3/projects/6b2f2da8652447e2bc8f49d746082fed => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:42.668136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:42.688190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ed8c1236a24f00af4234a81e3f6469', 'request_id': 'req-261d4030-df07-4886-85e7-8ab440455840'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:42.700510 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ed8c1236a24f00af4234a81e3f6469', 'request_id': 'req-261d4030-df07-4886-85e7-8ab440455840'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:42.822409 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ed8c1236a24f00af4234a81e3f6469', 'request_id': 'req-261d4030-df07-4886-85e7-8ab440455840'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:42.836049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] The token cache is being invalidate because project 58ed8c1236a24f00af4234a81e3f6469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:42.836350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:42.837066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:42.838725 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1337/2680] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:42 2022] DELETE /identity/v3/projects/58ed8c1236a24f00af4234a81e3f6469 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:42.842836 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:42.845434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:42.865182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0ecaa-837b-4662-bc36-a78639926653 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:42.960475 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:42.961307 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:42.961616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:42.963448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] PATH_INFO: `/v3/users/a74766708f454512ac6e14bc4f371d19` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:42.963448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a74766708f454512ac6e14bc4f371d19)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:42.967044 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:43.281918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a74766708f454512ac6e14bc4f371d19'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:43.292387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a74766708f454512ac6e14bc4f371d19'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:43.296593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a74766708f454512ac6e14bc4f371d19'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:43.397329 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a74766708f454512ac6e14bc4f371d19'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:43.398975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-b3b59001-b5ce-4d82-ba31-f8f6ecb5e265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a74766708f454512ac6e14bc4f371d19'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:43.439122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1344/2681] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:42 2022] DELETE /identity/v3/users/a74766708f454512ac6e14bc4f371d19 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:44.073277 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:44.076999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:44.100324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4030-df07-4886-85e7-8ab440455840 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:44.203584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:44.204830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:44.205351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:44.205718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] PATH_INFO: `/v3/projects/fec8afdc17424d93bf8f5828668253bb` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:44.208786 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec8afdc17424d93bf8f5828668253bb)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:44.212908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:44.407485 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec8afdc17424d93bf8f5828668253bb', 'request_id': 'req-5989713d-a887-40f0-a184-7ea504dab610'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:44.417415 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec8afdc17424d93bf8f5828668253bb', 'request_id': 'req-5989713d-a887-40f0-a184-7ea504dab610'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:44.533187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec8afdc17424d93bf8f5828668253bb', 'request_id': 'req-5989713d-a887-40f0-a184-7ea504dab610'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:44.543611 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] The token cache is being invalidate because project fec8afdc17424d93bf8f5828668253bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:44.543917 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:44.545307 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5989713d-a887-40f0-a184-7ea504dab610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:44.550288 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1338/2682] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:44 2022] DELETE /identity/v3/projects/fec8afdc17424d93bf8f5828668253bb => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:44.555659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d60aa-970f-401f-8bf8-f5a42e47ec42 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:44.556217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d60aa-970f-401f-8bf8-f5a42e47ec42 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:44.556426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d60aa-970f-401f-8bf8-f5a42e47ec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:44.578486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-219d60aa-970f-401f-8bf8-f5a42e47ec42 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:44.580003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-219d60aa-970f-401f-8bf8-f5a42e47ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:44.605119 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:44.689352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1345/2683] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:44.700024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b0b2f-bc6b-40af-b226-a35f2dc8b366 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:44.700544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b0b2f-bc6b-40af-b226-a35f2dc8b366 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:44.700818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b0b2f-bc6b-40af-b226-a35f2dc8b366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:44.739650 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7d1b0b2f-bc6b-40af-b226-a35f2dc8b366 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:44.742442 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7d1b0b2f-bc6b-40af-b226-a35f2dc8b366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:44.758132 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1339/2684] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:44.762523 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d60aa-970f-401f-8bf8-f5a42e47ec42 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:44.774997 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d60aa-970f-401f-8bf8-f5a42e47ec42 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:44.787114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549fc72-8ce7-4c0e-8141-a4f300cef966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:44.787114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549fc72-8ce7-4c0e-8141-a4f300cef966 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:44.787114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549fc72-8ce7-4c0e-8141-a4f300cef966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:44.787114 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549fc72-8ce7-4c0e-8141-a4f300cef966 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:44.787711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549fc72-8ce7-4c0e-8141-a4f300cef966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:58:44.787711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549fc72-8ce7-4c0e-8141-a4f300cef966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:44.787711 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549fc72-8ce7-4c0e-8141-a4f300cef966 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:44.805139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1346/2685] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:58:44.805877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b0b2f-bc6b-40af-b226-a35f2dc8b366 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:44.823068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b0b2f-bc6b-40af-b226-a35f2dc8b366 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:44.830389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af686a39-4fbd-411e-af20-435843fb141a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:44.831350 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af686a39-4fbd-411e-af20-435843fb141a admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:44.831756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af686a39-4fbd-411e-af20-435843fb141a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:44.832178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af686a39-4fbd-411e-af20-435843fb141a admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:44.833291 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af686a39-4fbd-411e-af20-435843fb141a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:44.836401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af686a39-4fbd-411e-af20-435843fb141a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:44.948206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1340/2686] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:44 2022] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:58:44.949784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549fc72-8ce7-4c0e-8141-a4f300cef966 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:44.962563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549fc72-8ce7-4c0e-8141-a4f300cef966 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:45.083999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4f6a-1b95-4073-a546-c1269f25092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:45.092998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4f6a-1b95-4073-a546-c1269f25092a admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:45.092998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4f6a-1b95-4073-a546-c1269f25092a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:45.092998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4f6a-1b95-4073-a546-c1269f25092a admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:45.092998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d4f6a-1b95-4073-a546-c1269f25092a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:45.092998 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d4f6a-1b95-4073-a546-c1269f25092a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:45.246117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1347/2687] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:44 2022] POST /identity/v3/users => generated 283 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:45.250324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af686a39-4fbd-411e-af20-435843fb141a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:45.261418 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af686a39-4fbd-411e-af20-435843fb141a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:45.276035 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8c5da-c0c9-42aa-a263-dcb0c8623027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:45.276707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8c5da-c0c9-42aa-a263-dcb0c8623027 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:45.277017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8c5da-c0c9-42aa-a263-dcb0c8623027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:45.277294 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8c5da-c0c9-42aa-a263-dcb0c8623027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:45.277957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8c5da-c0c9-42aa-a263-dcb0c8623027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:45.279731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8c5da-c0c9-42aa-a263-dcb0c8623027 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:45.295643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1341/2688] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:45.299855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4f6a-1b95-4073-a546-c1269f25092a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:45.313018 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4f6a-1b95-4073-a546-c1269f25092a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:45.332777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0bc84-f687-400b-bffb-7f6165b7413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:45.332777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0bc84-f687-400b-bffb-7f6165b7413b admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:45.332777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0bc84-f687-400b-bffb-7f6165b7413b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:45.332777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0bc84-f687-400b-bffb-7f6165b7413b admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:45.333195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0bc84-f687-400b-bffb-7f6165b7413b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:45.333195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0bc84-f687-400b-bffb-7f6165b7413b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:45.366565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1348/2689] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:45.368709 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8c5da-c0c9-42aa-a263-dcb0c8623027 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:45.407664 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8c5da-c0c9-42aa-a263-dcb0c8623027 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:45.422534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fcfd0-f418-47a5-a347-b1375d38e26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:45.423872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fcfd0-f418-47a5-a347-b1375d38e26e admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:45.423872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fcfd0-f418-47a5-a347-b1375d38e26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:45.423872 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53fcfd0-f418-47a5-a347-b1375d38e26e admin admin] PATH_INFO: `/v3/projects/32da9ec5d7d44f95a57df7130e0705ff/users/e94df84e5de14c1480ba0718e7bcdebd/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:45.452998 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:45.462164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fcfd0-f418-47a5-a347-b1375d38e26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32da9ec5d7d44f95a57df7130e0705ff, user_id=e94df84e5de14c1480ba0718e7bcdebd, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:45.474560 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53fcfd0-f418-47a5-a347-b1375d38e26e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:45.588629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1342/2690] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:45 2022] PUT /identity/v3/projects/32da9ec5d7d44f95a57df7130e0705ff/users/e94df84e5de14c1480ba0718e7bcdebd/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:45.606005 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a0acc-a710-4409-96ae-4d4c9cfd2982 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:45.607486 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a0acc-a710-4409-96ae-4d4c9cfd2982 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:45.608450 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a0acc-a710-4409-96ae-4d4c9cfd2982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:45.650399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-e55a0acc-a710-4409-96ae-4d4c9cfd2982 None None] MFA Rules not processed for user `e94df84e5de14c1480ba0718e7bcdebd`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:45.652177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e55a0acc-a710-4409-96ae-4d4c9cfd2982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:45.743122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1349/2691] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:45.747928 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fcfd0-f418-47a5-a347-b1375d38e26e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:45.835637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53fcfd0-f418-47a5-a347-b1375d38e26e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:45.867153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88763-3317-4fd4-93cf-997daa86427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:45.867814 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88763-3317-4fd4-93cf-997daa86427e admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:45.868092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88763-3317-4fd4-93cf-997daa86427e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:45.868364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88763-3317-4fd4-93cf-997daa86427e admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:45.869696 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a88763-3317-4fd4-93cf-997daa86427e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:45.882341 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a88763-3317-4fd4-93cf-997daa86427e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:45.986184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1343/2692] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:45 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:45.990978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a0acc-a710-4409-96ae-4d4c9cfd2982 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:46.005710 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a0acc-a710-4409-96ae-4d4c9cfd2982 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:46.034560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:46.094788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835fc4b-fcf2-43b8-b33f-0ac85834c5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:46.095842 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835fc4b-fcf2-43b8-b33f-0ac85834c5dd admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:46.096371 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835fc4b-fcf2-43b8-b33f-0ac85834c5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:46.096951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835fc4b-fcf2-43b8-b33f-0ac85834c5dd admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:46.098089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835fc4b-fcf2-43b8-b33f-0ac85834c5dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:46.102078 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835fc4b-fcf2-43b8-b33f-0ac85834c5dd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:46.252444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88763-3317-4fd4-93cf-997daa86427e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:46.255138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d0a88763-3317-4fd4-93cf-997daa86427e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:46.264569 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1350/2693] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:45 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:46.275156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835fc4b-fcf2-43b8-b33f-0ac85834c5dd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:46.281914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88763-3317-4fd4-93cf-997daa86427e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:46.285992 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835fc4b-fcf2-43b8-b33f-0ac85834c5dd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:46.287698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:46.290305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:46.290305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:46.290305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] PATH_INFO: `/v3/users/297a016ff2944b33a06d5ce81735fb8d` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:46.290305 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=297a016ff2944b33a06d5ce81735fb8d)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:46.291338 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413e881-a7ec-4159-b232-cbb5bece11d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:46.291972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:46.292168 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413e881-a7ec-4159-b232-cbb5bece11d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:46.292451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413e881-a7ec-4159-b232-cbb5bece11d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:46.292780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413e881-a7ec-4159-b232-cbb5bece11d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:46.293396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413e881-a7ec-4159-b232-cbb5bece11d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:46.295139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413e881-a7ec-4159-b232-cbb5bece11d3 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:46.306587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1351/2694] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:58:46.311158 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413e881-a7ec-4159-b232-cbb5bece11d3 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:46.322705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413e881-a7ec-4159-b232-cbb5bece11d3 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:46.327809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7ddaa-0d69-447a-bdca-aa6991043fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:46.328688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7ddaa-0d69-447a-bdca-aa6991043fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:46.328688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7ddaa-0d69-447a-bdca-aa6991043fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:46.329142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7ddaa-0d69-447a-bdca-aa6991043fa0 admin admin] PATH_INFO: `/v3/projects/53faba99598842ef8467880a1e190873/users/b7ec0f1b388c482789a6d3ecafe46c49/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:46.345332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7ddaa-0d69-447a-bdca-aa6991043fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53faba99598842ef8467880a1e190873, user_id=b7ec0f1b388c482789a6d3ecafe46c49, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:46.347968 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7ddaa-0d69-447a-bdca-aa6991043fa0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:46.456695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1352/2695] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:46 2022] PUT /identity/v3/projects/53faba99598842ef8467880a1e190873/users/b7ec0f1b388c482789a6d3ecafe46c49/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:46.462089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7ddaa-0d69-447a-bdca-aa6991043fa0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:46.511629 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297a016ff2944b33a06d5ce81735fb8d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:46.521252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297a016ff2944b33a06d5ce81735fb8d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:46.522055 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297a016ff2944b33a06d5ce81735fb8d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:46.535165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7ddaa-0d69-447a-bdca-aa6991043fa0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:46.539926 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4bec6-3e5a-4f4b-b801-23a29d3b9f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:46.540658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4bec6-3e5a-4f4b-b801-23a29d3b9f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:46.540936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4bec6-3e5a-4f4b-b801-23a29d3b9f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:46.541206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4bec6-3e5a-4f4b-b801-23a29d3b9f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:46.541845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4bec6-3e5a-4f4b-b801-23a29d3b9f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:46.543439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4bec6-3e5a-4f4b-b801-23a29d3b9f93 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:46.558378 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1353/2696] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:58:46.559501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4bec6-3e5a-4f4b-b801-23a29d3b9f93 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:46.570067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4bec6-3e5a-4f4b-b801-23a29d3b9f93 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:46.575477 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85907259-b72b-4542-a7d0-d837dfcbcf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:46.576131 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85907259-b72b-4542-a7d0-d837dfcbcf92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:46.576410 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85907259-b72b-4542-a7d0-d837dfcbcf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:46.576709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85907259-b72b-4542-a7d0-d837dfcbcf92 admin admin] PATH_INFO: `/v3/projects/53faba99598842ef8467880a1e190873/users/b7ec0f1b388c482789a6d3ecafe46c49/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:46.578762 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85907259-b72b-4542-a7d0-d837dfcbcf92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53faba99598842ef8467880a1e190873, user_id=b7ec0f1b388c482789a6d3ecafe46c49, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:46.581727 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85907259-b72b-4542-a7d0-d837dfcbcf92 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:46.593530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1354/2697] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:46 2022] PUT /identity/v3/projects/53faba99598842ef8467880a1e190873/users/b7ec0f1b388c482789a6d3ecafe46c49/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:46.603579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50228252-dfe7-4452-ad1b-5c4224e32c9e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:46.603867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50228252-dfe7-4452-ad1b-5c4224e32c9e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:46.604245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50228252-dfe7-4452-ad1b-5c4224e32c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:46.633575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-50228252-dfe7-4452-ad1b-5c4224e32c9e None None] MFA Rules not processed for user `b7ec0f1b388c482789a6d3ecafe46c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:46.634801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-50228252-dfe7-4452-ad1b-5c4224e32c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:46.679074 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297a016ff2944b33a06d5ce81735fb8d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:46.703534 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297a016ff2944b33a06d5ce81735fb8d'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:46.714400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1344/2698] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:46 2022] DELETE /identity/v3/users/297a016ff2944b33a06d5ce81735fb8d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:46.741445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1355/2699] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:58:46.752304 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:46.754242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:46.862068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a55945-e3aa-4948-99cd-b9263c8861d2 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:46.867739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65439f8-845e-4260-8ea7-ca1467ea83bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:46.868379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65439f8-845e-4260-8ea7-ca1467ea83bc service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:46.868691 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65439f8-845e-4260-8ea7-ca1467ea83bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:46.869336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65439f8-845e-4260-8ea7-ca1467ea83bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:46.948980 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:46.951777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65439f8-845e-4260-8ea7-ca1467ea83bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:46.953296 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65439f8-845e-4260-8ea7-ca1467ea83bc service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:46.964538 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1345/2700] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:47.066305 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50228252-dfe7-4452-ad1b-5c4224e32c9e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:47.068345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-50228252-dfe7-4452-ad1b-5c4224e32c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:47.135109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:47.159882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50228252-dfe7-4452-ad1b-5c4224e32c9e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:47.230333 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:47.231067 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:47.231260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:47.231530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] PATH_INFO: `/v3/projects/2b08d1c1dcf64187b53e4e3a76b6e346` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:47.232790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b08d1c1dcf64187b53e4e3a76b6e346)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:47.234751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:47.412440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b08d1c1dcf64187b53e4e3a76b6e346', 'request_id': 'req-5833137d-fb81-49da-9c4e-edbd29f45e41'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:47.420921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b08d1c1dcf64187b53e4e3a76b6e346', 'request_id': 'req-5833137d-fb81-49da-9c4e-edbd29f45e41'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:47.554391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b08d1c1dcf64187b53e4e3a76b6e346', 'request_id': 'req-5833137d-fb81-49da-9c4e-edbd29f45e41'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:47.567853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] The token cache is being invalidate because project 2b08d1c1dcf64187b53e4e3a76b6e346 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:47.568254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:47.569433 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:47.570974 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1356/2701] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:47 2022] DELETE /identity/v3/projects/2b08d1c1dcf64187b53e4e3a76b6e346 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:47.575391 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65439f8-845e-4260-8ea7-ca1467ea83bc service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:47.588955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65439f8-845e-4260-8ea7-ca1467ea83bc service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:47.654868 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:47.655536 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:47.655808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:47.656079 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] PATH_INFO: `/v3/users/102d4c23a15b4f08aa33d12d5d7639ba` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:47.657351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=102d4c23a15b4f08aa33d12d5d7639ba)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:47.659320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:47.893105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102d4c23a15b4f08aa33d12d5d7639ba'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:47.902290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102d4c23a15b4f08aa33d12d5d7639ba'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:47.903187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102d4c23a15b4f08aa33d12d5d7639ba'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:47.987420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102d4c23a15b4f08aa33d12d5d7639ba'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.003974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102d4c23a15b4f08aa33d12d5d7639ba'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.019262 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1346/2702] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:47 2022] DELETE /identity/v3/users/102d4c23a15b4f08aa33d12d5d7639ba => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:48.022478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:48.025263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:48.038010 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833137d-fb81-49da-9c4e-edbd29f45e41 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:48.107062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:48.107707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:48.107980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:48.108252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] PATH_INFO: `/v3/users/e94df84e5de14c1480ba0718e7bcdebd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:48.109565 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94df84e5de14c1480ba0718e7bcdebd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:48.111566 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:48.115408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:48.298351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94df84e5de14c1480ba0718e7bcdebd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.305706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94df84e5de14c1480ba0718e7bcdebd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.306373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94df84e5de14c1480ba0718e7bcdebd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.324732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:48.324732 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:48.341540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d05f2-23ed-4403-a115-97ffe88a1ab3 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:48.346916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:48.347702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:48.353309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:48.353309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] PATH_INFO: `/v3/projects/1e2a4c47764e425f8d054a49468caaa4` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:48.353309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2a4c47764e425f8d054a49468caaa4)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:48.353309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:48.365614 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:48.370375 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94df84e5de14c1480ba0718e7bcdebd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.371298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-aedcb117-27af-495d-a5a9-f5fc52d2ea97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94df84e5de14c1480ba0718e7bcdebd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.391618 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1357/2703] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:48 2022] DELETE /identity/v3/users/e94df84e5de14c1480ba0718e7bcdebd => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:48.396975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6a1e-0c8c-4ebf-8f3c-da6e4a9e40db None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:48.397384 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6a1e-0c8c-4ebf-8f3c-da6e4a9e40db None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:48.397735 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf6a1e-0c8c-4ebf-8f3c-da6e4a9e40db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:48.417491 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-fecf6a1e-0c8c-4ebf-8f3c-da6e4a9e40db None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:48.418707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fecf6a1e-0c8c-4ebf-8f3c-da6e4a9e40db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:48.479383 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1358/2704] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:58:48.490061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf6a1e-0c8c-4ebf-8f3c-da6e4a9e40db None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:48.491547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-fecf6a1e-0c8c-4ebf-8f3c-da6e4a9e40db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:48.501229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2a4c47764e425f8d054a49468caaa4', 'request_id': 'req-da29bdc8-a2cf-402c-8227-c5748a763a50'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.510756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2a4c47764e425f8d054a49468caaa4', 'request_id': 'req-da29bdc8-a2cf-402c-8227-c5748a763a50'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.553435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf6a1e-0c8c-4ebf-8f3c-da6e4a9e40db None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:48.608994 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4544a15-1328-4103-b64c-e350739b69f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:48.609602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4544a15-1328-4103-b64c-e350739b69f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:48.609875 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4544a15-1328-4103-b64c-e350739b69f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:48.610146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4544a15-1328-4103-b64c-e350739b69f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:48.679160 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4544a15-1328-4103-b64c-e350739b69f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:48.684130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4544a15-1328-4103-b64c-e350739b69f9 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:48.691202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1359/2705] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:58:48.793042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2a4c47764e425f8d054a49468caaa4', 'request_id': 'req-da29bdc8-a2cf-402c-8227-c5748a763a50'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.805382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] The token cache is being invalidate because project 1e2a4c47764e425f8d054a49468caaa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:48.805670 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.806303 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:48.807774 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1347/2706] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:48 2022] DELETE /identity/v3/projects/1e2a4c47764e425f8d054a49468caaa4 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:58:49.240855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4544a15-1328-4103-b64c-e350739b69f9 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:49.242383 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e4544a15-1328-4103-b64c-e350739b69f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:49.257613 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4544a15-1328-4103-b64c-e350739b69f9 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:49.263774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:49.268266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:49.268266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:49.268266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] PATH_INFO: `/v3/projects/32da9ec5d7d44f95a57df7130e0705ff` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:49.268266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32da9ec5d7d44f95a57df7130e0705ff)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:49.269521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:49.313313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:49.405724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32da9ec5d7d44f95a57df7130e0705ff', 'request_id': 'req-743f980d-258c-4327-a936-8be9efd10b04'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:49.412595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32da9ec5d7d44f95a57df7130e0705ff', 'request_id': 'req-743f980d-258c-4327-a936-8be9efd10b04'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:49.490775 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32da9ec5d7d44f95a57df7130e0705ff', 'request_id': 'req-743f980d-258c-4327-a936-8be9efd10b04'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:49.503451 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] The token cache is being invalidate because project 32da9ec5d7d44f95a57df7130e0705ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:49.504344 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:49.504506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:49.506532 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1360/2707] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:49 2022] DELETE /identity/v3/projects/32da9ec5d7d44f95a57df7130e0705ff => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:49.510702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:49.512293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:49.526012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29bdc8-a2cf-402c-8227-c5748a763a50 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:49.587931 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:49.588597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:49.588882 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:49.589156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] PATH_INFO: `/v3/users/b7ec0f1b388c482789a6d3ecafe46c49` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:49.590318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ec0f1b388c482789a6d3ecafe46c49)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:49.592204 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:49.797940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ec0f1b388c482789a6d3ecafe46c49'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:49.813844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ec0f1b388c482789a6d3ecafe46c49'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:49.814845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ec0f1b388c482789a6d3ecafe46c49'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:49.890810 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ec0f1b388c482789a6d3ecafe46c49'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:49.905695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-7555c1b7-a352-4668-aa5f-9fda41372a17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ec0f1b388c482789a6d3ecafe46c49'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:49.912261 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1348/2708] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:49 2022] DELETE /identity/v3/users/b7ec0f1b388c482789a6d3ecafe46c49 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:50.373041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:50.374582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:50.399262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f980d-258c-4327-a936-8be9efd10b04 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:50.429439 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:50.465077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:50.465739 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:50.466007 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:50.466417 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] PATH_INFO: `/v3/projects/53faba99598842ef8467880a1e190873` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:50.467556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53faba99598842ef8467880a1e190873)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:50.469538 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:50.621959 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53faba99598842ef8467880a1e190873', 'request_id': 'req-f0df409a-bac9-4275-b04b-a60f89bbd65c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:50.629346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53faba99598842ef8467880a1e190873', 'request_id': 'req-f0df409a-bac9-4275-b04b-a60f89bbd65c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:50.695983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53faba99598842ef8467880a1e190873', 'request_id': 'req-f0df409a-bac9-4275-b04b-a60f89bbd65c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:50.709248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] The token cache is being invalidate because project 53faba99598842ef8467880a1e190873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:50.709627 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:50.710236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f0df409a-bac9-4275-b04b-a60f89bbd65c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:50.712004 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1361/2709] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:50 2022] DELETE /identity/v3/projects/53faba99598842ef8467880a1e190873 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:50.717638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e899663-fb49-41d0-afcf-1e4640d01c7e None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:50.718150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e899663-fb49-41d0-afcf-1e4640d01c7e None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:50.718619 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e899663-fb49-41d0-afcf-1e4640d01c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:50.746575 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-2e899663-fb49-41d0-afcf-1e4640d01c7e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:50.747803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2e899663-fb49-41d0-afcf-1e4640d01c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:50.762284 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:50.810080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1349/2710] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:50.817838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fc9fa-3382-4c26-baed-9e9149d8c7c2 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:50.818230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fc9fa-3382-4c26-baed-9e9149d8c7c2 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:50.818459 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0fc9fa-3382-4c26-baed-9e9149d8c7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:50.842056 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-dc0fc9fa-3382-4c26-baed-9e9149d8c7c2 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:50.843277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-dc0fc9fa-3382-4c26-baed-9e9149d8c7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:50.851856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1362/2711] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:50.856340 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e899663-fb49-41d0-afcf-1e4640d01c7e None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:50.866835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e899663-fb49-41d0-afcf-1e4640d01c7e None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:50.875825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234614-e26e-4bcf-8f71-15e7b359a28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:50.875825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234614-e26e-4bcf-8f71-15e7b359a28a admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:50.875825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234614-e26e-4bcf-8f71-15e7b359a28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:50.875825 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234614-e26e-4bcf-8f71-15e7b359a28a admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:50.876449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234614-e26e-4bcf-8f71-15e7b359a28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:58:50.876449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234614-e26e-4bcf-8f71-15e7b359a28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:50.877147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234614-e26e-4bcf-8f71-15e7b359a28a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:50.891815 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1350/2712] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:58:50.896748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fc9fa-3382-4c26-baed-9e9149d8c7c2 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:50.909919 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0fc9fa-3382-4c26-baed-9e9149d8c7c2 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:50.916225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b7677-d52b-4fd1-94b5-3a96c599de6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:50.917487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b7677-d52b-4fd1-94b5-3a96c599de6d admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:50.917487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b7677-d52b-4fd1-94b5-3a96c599de6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:50.917487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b7677-d52b-4fd1-94b5-3a96c599de6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:50.918331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b7677-d52b-4fd1-94b5-3a96c599de6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:50.921373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b7677-d52b-4fd1-94b5-3a96c599de6d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:51.044643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1363/2713] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:50 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:51.046453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234614-e26e-4bcf-8f71-15e7b359a28a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:51.060875 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234614-e26e-4bcf-8f71-15e7b359a28a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:51.123264 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d65f-80fc-4b43-8fba-63e5a60b541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:51.129490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d65f-80fc-4b43-8fba-63e5a60b541b admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:51.129490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d65f-80fc-4b43-8fba-63e5a60b541b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:51.129490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32d65f-80fc-4b43-8fba-63e5a60b541b admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:51.129490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32d65f-80fc-4b43-8fba-63e5a60b541b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:51.129490 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32d65f-80fc-4b43-8fba-63e5a60b541b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:51.216502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1351/2714] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:51 2022] POST /identity/v3/users => generated 282 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:58:51.218360 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b7677-d52b-4fd1-94b5-3a96c599de6d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:51.230089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b7677-d52b-4fd1-94b5-3a96c599de6d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:51.243055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db7e28-2264-4220-857c-7e1cb7a062dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:51.244225 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7e28-2264-4220-857c-7e1cb7a062dd admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:51.244683 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7e28-2264-4220-857c-7e1cb7a062dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:51.245073 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db7e28-2264-4220-857c-7e1cb7a062dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:51.245841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db7e28-2264-4220-857c-7e1cb7a062dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:51.247575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db7e28-2264-4220-857c-7e1cb7a062dd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:51.259487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1364/2715] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:51.263449 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d65f-80fc-4b43-8fba-63e5a60b541b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:51.276207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32d65f-80fc-4b43-8fba-63e5a60b541b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:51.283532 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea92aa-90e6-4ecc-9ce0-c14d638a3972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:51.284398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea92aa-90e6-4ecc-9ce0-c14d638a3972 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:51.284826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea92aa-90e6-4ecc-9ce0-c14d638a3972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:51.285210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea92aa-90e6-4ecc-9ce0-c14d638a3972 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:51.286163 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea92aa-90e6-4ecc-9ce0-c14d638a3972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:51.288617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea92aa-90e6-4ecc-9ce0-c14d638a3972 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:51.306671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1352/2716] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:51.311107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db7e28-2264-4220-857c-7e1cb7a062dd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:51.322652 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db7e28-2264-4220-857c-7e1cb7a062dd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:51.329467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33dc1f-e2b9-4682-807a-1df0934532fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:51.330456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33dc1f-e2b9-4682-807a-1df0934532fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:51.330864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33dc1f-e2b9-4682-807a-1df0934532fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:51.331263 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33dc1f-e2b9-4682-807a-1df0934532fe admin admin] PATH_INFO: `/v3/projects/9285f362aaf14756949b48ea86f3fa6f/users/5be13a20a6084c9a82adb6a2d135ac05/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:51.352963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33dc1f-e2b9-4682-807a-1df0934532fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9285f362aaf14756949b48ea86f3fa6f, user_id=5be13a20a6084c9a82adb6a2d135ac05, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:51.357187 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33dc1f-e2b9-4682-807a-1df0934532fe admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:51.480060 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1365/2717] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:51 2022] PUT /identity/v3/projects/9285f362aaf14756949b48ea86f3fa6f/users/5be13a20a6084c9a82adb6a2d135ac05/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:51.491964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010f41d-2eba-413d-b9e0-1a050c1d2999 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:51.492282 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010f41d-2eba-413d-b9e0-1a050c1d2999 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:51.492595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010f41d-2eba-413d-b9e0-1a050c1d2999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:51.523341 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-7010f41d-2eba-413d-b9e0-1a050c1d2999 None None] MFA Rules not processed for user `5be13a20a6084c9a82adb6a2d135ac05`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:51.524595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-7010f41d-2eba-413d-b9e0-1a050c1d2999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:51.596798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1353/2718] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:51.601558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33dc1f-e2b9-4682-807a-1df0934532fe admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:51.667331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:51.672872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33dc1f-e2b9-4682-807a-1df0934532fe admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:51.678292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6bad0-b189-46c9-bd0a-fe68e7a813f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:51.678897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6bad0-b189-46c9-bd0a-fe68e7a813f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:51.684090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6bad0-b189-46c9-bd0a-fe68e7a813f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:51.684090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6bad0-b189-46c9-bd0a-fe68e7a813f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:51.684090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6bad0-b189-46c9-bd0a-fe68e7a813f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:51.684090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6bad0-b189-46c9-bd0a-fe68e7a813f1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:51.761980 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1366/2719] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:51 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:51.766809 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010f41d-2eba-413d-b9e0-1a050c1d2999 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:51.777578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010f41d-2eba-413d-b9e0-1a050c1d2999 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:51.789698 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:51.837769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb7811-335b-41c9-b289-a313c32bac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:51.838511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7811-335b-41c9-b289-a313c32bac1f admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:51.838674 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7811-335b-41c9-b289-a313c32bac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:51.838903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb7811-335b-41c9-b289-a313c32bac1f admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:51.839550 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb7811-335b-41c9-b289-a313c32bac1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:51.841507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb7811-335b-41c9-b289-a313c32bac1f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:51.948824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1354/2720] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:51 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:51.954579 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6bad0-b189-46c9-bd0a-fe68e7a813f1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:51.965672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6bad0-b189-46c9-bd0a-fe68e7a813f1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:51.970434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71300cfe-cf95-4e8c-817c-ec4442e7b0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:51.971076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300cfe-cf95-4e8c-817c-ec4442e7b0ce admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:51.971320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300cfe-cf95-4e8c-817c-ec4442e7b0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:51.971596 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300cfe-cf95-4e8c-817c-ec4442e7b0ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:51.972240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71300cfe-cf95-4e8c-817c-ec4442e7b0ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:51.974386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71300cfe-cf95-4e8c-817c-ec4442e7b0ce admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:51.984848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1367/2721] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:58:51.989518 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb7811-335b-41c9-b289-a313c32bac1f admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:52.000637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb7811-335b-41c9-b289-a313c32bac1f admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:52.005561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5962097-1383-4e00-9b21-632c60f6628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:52.006222 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5962097-1383-4e00-9b21-632c60f6628e admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:52.006496 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5962097-1383-4e00-9b21-632c60f6628e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:52.006764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5962097-1383-4e00-9b21-632c60f6628e admin admin] PATH_INFO: `/v3/projects/d3434e34219540f288903ee530a2bef7/users/9042403831744275a0bdfc98861dd775/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:52.022736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5962097-1383-4e00-9b21-632c60f6628e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3434e34219540f288903ee530a2bef7, user_id=9042403831744275a0bdfc98861dd775, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:52.025299 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5962097-1383-4e00-9b21-632c60f6628e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:52.091393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1355/2722] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:51 2022] PUT /identity/v3/projects/d3434e34219540f288903ee530a2bef7/users/9042403831744275a0bdfc98861dd775/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:52.095599 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71300cfe-cf95-4e8c-817c-ec4442e7b0ce admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:52.106588 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71300cfe-cf95-4e8c-817c-ec4442e7b0ce admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:52.179517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ea70e-20bb-4211-88e6-cc6a81d0d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:52.180149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ea70e-20bb-4211-88e6-cc6a81d0d191 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:52.180429 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ea70e-20bb-4211-88e6-cc6a81d0d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:52.180730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ea70e-20bb-4211-88e6-cc6a81d0d191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:52.181582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ea70e-20bb-4211-88e6-cc6a81d0d191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:52.183299 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ea70e-20bb-4211-88e6-cc6a81d0d191 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:52.197584 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1368/2723] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:58:52.203565 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5962097-1383-4e00-9b21-632c60f6628e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:52.217915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5962097-1383-4e00-9b21-632c60f6628e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:52.223231 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aae389-2bfb-4db4-b2b1-be1ea0238c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:52.226426 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae389-2bfb-4db4-b2b1-be1ea0238c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:52.226426 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae389-2bfb-4db4-b2b1-be1ea0238c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:52.226426 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aae389-2bfb-4db4-b2b1-be1ea0238c62 admin admin] PATH_INFO: `/v3/projects/d3434e34219540f288903ee530a2bef7/users/9042403831744275a0bdfc98861dd775/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:52.227445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aae389-2bfb-4db4-b2b1-be1ea0238c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3434e34219540f288903ee530a2bef7, user_id=9042403831744275a0bdfc98861dd775, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:52.230216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aae389-2bfb-4db4-b2b1-be1ea0238c62 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:52.242789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1356/2724] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:52 2022] PUT /identity/v3/projects/d3434e34219540f288903ee530a2bef7/users/9042403831744275a0bdfc98861dd775/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:52.253134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b752a1-8779-4952-ac4f-ae134e781229 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:52.253418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b752a1-8779-4952-ac4f-ae134e781229 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:52.253705 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b752a1-8779-4952-ac4f-ae134e781229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:52.284595 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f3b752a1-8779-4952-ac4f-ae134e781229 None None] MFA Rules not processed for user `9042403831744275a0bdfc98861dd775`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:52.285743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f3b752a1-8779-4952-ac4f-ae134e781229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:52.358803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1369/2725] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:52.370186 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aae389-2bfb-4db4-b2b1-be1ea0238c62 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:52.371903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-c4aae389-2bfb-4db4-b2b1-be1ea0238c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:52.432738 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aae389-2bfb-4db4-b2b1-be1ea0238c62 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:52.436437 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce428df-e996-4a52-83a9-cd50081cfdf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:52.437094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce428df-e996-4a52-83a9-cd50081cfdf3 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:52.437374 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce428df-e996-4a52-83a9-cd50081cfdf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:52.437736 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce428df-e996-4a52-83a9-cd50081cfdf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:52.447836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce428df-e996-4a52-83a9-cd50081cfdf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:52.449341 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce428df-e996-4a52-83a9-cd50081cfdf3 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:52.460509 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1357/2726] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:52.700509 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b752a1-8779-4952-ac4f-ae134e781229 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:52.710993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b752a1-8779-4952-ac4f-ae134e781229 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:52.714601 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848f3bc-c7a7-4585-8ae3-1565a0d08382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:52.715197 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848f3bc-c7a7-4585-8ae3-1565a0d08382 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:52.715467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848f3bc-c7a7-4585-8ae3-1565a0d08382 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:52.715733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848f3bc-c7a7-4585-8ae3-1565a0d08382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:52.766758 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:52.777585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848f3bc-c7a7-4585-8ae3-1565a0d08382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:52.779120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848f3bc-c7a7-4585-8ae3-1565a0d08382 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:52.788243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1370/2727] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:56.424094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce428df-e996-4a52-83a9-cd50081cfdf3 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:56.507721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce428df-e996-4a52-83a9-cd50081cfdf3 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:56.513192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:56.514400 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:56.514845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:56.515562 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] PATH_INFO: `/v3/users/5be13a20a6084c9a82adb6a2d135ac05` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:56.517143 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5be13a20a6084c9a82adb6a2d135ac05)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:56.519392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:56.540207 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:56.729521 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5be13a20a6084c9a82adb6a2d135ac05'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:56.738082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5be13a20a6084c9a82adb6a2d135ac05'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:56.738835 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5be13a20a6084c9a82adb6a2d135ac05'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:56.816671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5be13a20a6084c9a82adb6a2d135ac05'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:56.831859 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5be13a20a6084c9a82adb6a2d135ac05'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:56.838905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1358/2728] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:56 2022] DELETE /identity/v3/users/5be13a20a6084c9a82adb6a2d135ac05 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:56.844381 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f28b-c02e-45fe-9984-d93c81fd7731 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:56.845003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f28b-c02e-45fe-9984-d93c81fd7731 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:56.845139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2f28b-c02e-45fe-9984-d93c81fd7731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:56.869632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-3fd2f28b-c02e-45fe-9984-d93c81fd7731 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:56.870845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3fd2f28b-c02e-45fe-9984-d93c81fd7731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:56.939322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1371/2729] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:56.953410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:56.955025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:57.024049 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644166c-081f-499a-a3fa-8a4fa4d92216 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:57.027883 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128210a-c68d-4a87-ad59-67a8b46d0fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:57.028567 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128210a-c68d-4a87-ad59-67a8b46d0fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:57.028830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128210a-c68d-4a87-ad59-67a8b46d0fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:57.029098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128210a-c68d-4a87-ad59-67a8b46d0fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:57.040355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128210a-c68d-4a87-ad59-67a8b46d0fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:57.042200 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128210a-c68d-4a87-ad59-67a8b46d0fd2 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:57.057153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1359/2730] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:58:57.537800 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f28b-c02e-45fe-9984-d93c81fd7731 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:57.539324 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-3fd2f28b-c02e-45fe-9984-d93c81fd7731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:57.553499 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2f28b-c02e-45fe-9984-d93c81fd7731 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:57.558813 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:57.559537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:57.559879 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:57.560157 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] PATH_INFO: `/v3/projects/9285f362aaf14756949b48ea86f3fa6f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:57.561878 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9285f362aaf14756949b48ea86f3fa6f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:57.564082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:57.699177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9285f362aaf14756949b48ea86f3fa6f', 'request_id': 'req-8a982dea-f69c-4d73-85cf-3eb2a915a80b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:57.705845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9285f362aaf14756949b48ea86f3fa6f', 'request_id': 'req-8a982dea-f69c-4d73-85cf-3eb2a915a80b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:57.781859 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9285f362aaf14756949b48ea86f3fa6f', 'request_id': 'req-8a982dea-f69c-4d73-85cf-3eb2a915a80b'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:57.795288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] The token cache is being invalidate because project 9285f362aaf14756949b48ea86f3fa6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:57.795288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:57.795288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:57.797466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1372/2731] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:57 2022] DELETE /identity/v3/projects/9285f362aaf14756949b48ea86f3fa6f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:57.801843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128210a-c68d-4a87-ad59-67a8b46d0fd2 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:57.811609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128210a-c68d-4a87-ad59-67a8b46d0fd2 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:57.869525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:57.870153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:57.870431 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:57.870702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] PATH_INFO: `/v3/users/9042403831744275a0bdfc98861dd775` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:57.871828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9042403831744275a0bdfc98861dd775)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:57.873894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:58.068096 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:58.077695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9042403831744275a0bdfc98861dd775'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:58.085330 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9042403831744275a0bdfc98861dd775'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:58.086141 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9042403831744275a0bdfc98861dd775'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:58.125109 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9042403831744275a0bdfc98861dd775'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:58.141591 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2ddbdea3-cb28-431d-b9ba-93a92e5a3451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9042403831744275a0bdfc98861dd775'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:58.150646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1360/2732] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:58:57 2022] DELETE /identity/v3/users/9042403831744275a0bdfc98861dd775 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:58.567814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:58.569956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:58.586658 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a982dea-f69c-4d73-85cf-3eb2a915a80b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:58.656514 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:58.657292 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:58.657564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:58.657831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] PATH_INFO: `/v3/projects/d3434e34219540f288903ee530a2bef7` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:58.658981 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3434e34219540f288903ee530a2bef7)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:58.660984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:58.679466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:58.772697 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3434e34219540f288903ee530a2bef7', 'request_id': 'req-4729fa44-b231-4ff4-80bc-47f161db11ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:58.778243 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3434e34219540f288903ee530a2bef7', 'request_id': 'req-4729fa44-b231-4ff4-80bc-47f161db11ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:58.861660 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3434e34219540f288903ee530a2bef7', 'request_id': 'req-4729fa44-b231-4ff4-80bc-47f161db11ee'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:58.878542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] The token cache is being invalidate because project d3434e34219540f288903ee530a2bef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:58:58.878874 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:58.879502 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-4729fa44-b231-4ff4-80bc-47f161db11ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:58:58.881597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1373/2733] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:58:58 2022] DELETE /identity/v3/projects/d3434e34219540f288903ee530a2bef7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:58.886568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697bd33-1fd5-4df6-8716-456c29f92380 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:58.887107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697bd33-1fd5-4df6-8716-456c29f92380 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:58.887107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697bd33-1fd5-4df6-8716-456c29f92380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:58.907839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-8697bd33-1fd5-4df6-8716-456c29f92380 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:58.909126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8697bd33-1fd5-4df6-8716-456c29f92380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:58.973513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1361/2734] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:58.981521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53da39-5c47-4b8b-9360-ff412e40ef9b None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:58.981810 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53da39-5c47-4b8b-9360-ff412e40ef9b None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:58.982089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53da39-5c47-4b8b-9360-ff412e40ef9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:59.004188 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-ef53da39-5c47-4b8b-9360-ff412e40ef9b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:59.005896 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ef53da39-5c47-4b8b-9360-ff412e40ef9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:59.013821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1374/2735] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:59.018221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697bd33-1fd5-4df6-8716-456c29f92380 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:59.028156 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697bd33-1fd5-4df6-8716-456c29f92380 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:59.032811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16bce3-bc5f-401f-b385-79eda3f41676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:59.033420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16bce3-bc5f-401f-b385-79eda3f41676 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:59.033701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16bce3-bc5f-401f-b385-79eda3f41676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:59.033973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16bce3-bc5f-401f-b385-79eda3f41676 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:59.034637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16bce3-bc5f-401f-b385-79eda3f41676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:58:59.034938 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16bce3-bc5f-401f-b385-79eda3f41676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:59.036561 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16bce3-bc5f-401f-b385-79eda3f41676 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:59.048742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1362/2736] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:58:59.053694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53da39-5c47-4b8b-9360-ff412e40ef9b None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:59.062967 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53da39-5c47-4b8b-9360-ff412e40ef9b None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:59.068148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241200-35be-49f9-a537-5643bb05ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:59.068873 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241200-35be-49f9-a537-5643bb05ff8f admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:59.069122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241200-35be-49f9-a537-5643bb05ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:59.069396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241200-35be-49f9-a537-5643bb05ff8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:59.070034 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6241200-35be-49f9-a537-5643bb05ff8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:59.071921 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6241200-35be-49f9-a537-5643bb05ff8f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:59.189805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1375/2737] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:59 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:58:59.194677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16bce3-bc5f-401f-b385-79eda3f41676 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:59.205075 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16bce3-bc5f-401f-b385-79eda3f41676 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:59.264744 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17591-c50c-4d93-a32b-b77d363d454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:59.265351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17591-c50c-4d93-a32b-b77d363d454e admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:59.265632 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17591-c50c-4d93-a32b-b77d363d454e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:59.265940 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17591-c50c-4d93-a32b-b77d363d454e admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:59.266578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb17591-c50c-4d93-a32b-b77d363d454e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:59.268526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb17591-c50c-4d93-a32b-b77d363d454e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:59.372463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1363/2738] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:59 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:58:59.378370 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241200-35be-49f9-a537-5643bb05ff8f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:59.390494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241200-35be-49f9-a537-5643bb05ff8f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:59.395935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70034-7e85-49f2-b2f5-114a14f3c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:59.396586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70034-7e85-49f2-b2f5-114a14f3c0df admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:59.396872 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70034-7e85-49f2-b2f5-114a14f3c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:59.397149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a70034-7e85-49f2-b2f5-114a14f3c0df admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:59.397899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a70034-7e85-49f2-b2f5-114a14f3c0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:59.399508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a70034-7e85-49f2-b2f5-114a14f3c0df admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:59.411377 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1376/2739] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:59.415731 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17591-c50c-4d93-a32b-b77d363d454e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:59.426082 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17591-c50c-4d93-a32b-b77d363d454e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:59.431887 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8108-108c-4217-8a6d-fb60589b5e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:59.432511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8108-108c-4217-8a6d-fb60589b5e8f admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:59.432826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8108-108c-4217-8a6d-fb60589b5e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:59.433099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8108-108c-4217-8a6d-fb60589b5e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:59.433749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb8108-108c-4217-8a6d-fb60589b5e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:59.435386 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb8108-108c-4217-8a6d-fb60589b5e8f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:59.447466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1364/2740] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:58:59.453257 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70034-7e85-49f2-b2f5-114a14f3c0df admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:59.463799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a70034-7e85-49f2-b2f5-114a14f3c0df admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:59.468684 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0171a66-f45a-4606-b1a0-7b6464716cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:59.469351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0171a66-f45a-4606-b1a0-7b6464716cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:59.469632 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0171a66-f45a-4606-b1a0-7b6464716cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:59.469904 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0171a66-f45a-4606-b1a0-7b6464716cca admin admin] PATH_INFO: `/v3/projects/c13e7e789f8b4ce2a196281eb8686161/users/adfcfa07c7b94a249f575d00200e1890/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:59.486572 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0171a66-f45a-4606-b1a0-7b6464716cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c13e7e789f8b4ce2a196281eb8686161, user_id=adfcfa07c7b94a249f575d00200e1890, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:59.489960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0171a66-f45a-4606-b1a0-7b6464716cca admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:59.560172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1377/2741] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:58:59 2022] PUT /identity/v3/projects/c13e7e789f8b4ce2a196281eb8686161/users/adfcfa07c7b94a249f575d00200e1890/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:58:59.570580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e47559-27c8-44c9-9d38-f628394b5a1f None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:59.570862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e47559-27c8-44c9-9d38-f628394b5a1f None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:59.571138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e47559-27c8-44c9-9d38-f628394b5a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:59.600427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-34e47559-27c8-44c9-9d38-f628394b5a1f None None] MFA Rules not processed for user `adfcfa07c7b94a249f575d00200e1890`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:58:59.601687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-34e47559-27c8-44c9-9d38-f628394b5a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:58:59.606870 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:58:59.669466 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1365/2742] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:58:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:58:59.674440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0171a66-f45a-4606-b1a0-7b6464716cca admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:59.738578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0171a66-f45a-4606-b1a0-7b6464716cca admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:59.749624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504e66b-103b-4741-9fed-4aa8c6b8e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:59.750255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504e66b-103b-4741-9fed-4aa8c6b8e89f admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:59.750531 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504e66b-103b-4741-9fed-4aa8c6b8e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:59.750808 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504e66b-103b-4741-9fed-4aa8c6b8e89f admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:59.751452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504e66b-103b-4741-9fed-4aa8c6b8e89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:59.753404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504e66b-103b-4741-9fed-4aa8c6b8e89f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:58:59.835616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1378/2743] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:58:59 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:58:59.840078 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e47559-27c8-44c9-9d38-f628394b5a1f None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:58:59.852189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e47559-27c8-44c9-9d38-f628394b5a1f None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:58:59.911046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c799c-2703-4b35-90f3-9e3573046d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:58:59.912266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c799c-2703-4b35-90f3-9e3573046d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:58:59.912414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c799c-2703-4b35-90f3-9e3573046d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:58:59.912704 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c799c-2703-4b35-90f3-9e3573046d7c admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:58:59.913390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c799c-2703-4b35-90f3-9e3573046d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:58:59.915332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c799c-2703-4b35-90f3-9e3573046d7c admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:00.011862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1366/2744] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:58:59 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:59:00.016128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504e66b-103b-4741-9fed-4aa8c6b8e89f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:00.027120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504e66b-103b-4741-9fed-4aa8c6b8e89f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:00.031737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6bba6-a429-4f48-99fe-2da3cb83ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:00.032331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6bba6-a429-4f48-99fe-2da3cb83ddfc admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:00.032636 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6bba6-a429-4f48-99fe-2da3cb83ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:00.032906 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6bba6-a429-4f48-99fe-2da3cb83ddfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:00.033566 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6bba6-a429-4f48-99fe-2da3cb83ddfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:00.035149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6bba6-a429-4f48-99fe-2da3cb83ddfc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:00.047501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1379/2745] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:59:00.052106 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c799c-2703-4b35-90f3-9e3573046d7c admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:00.062489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c799c-2703-4b35-90f3-9e3573046d7c admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:00.071877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3c81a-c20b-454b-a1db-731bc0a270f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:00.071877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3c81a-c20b-454b-a1db-731bc0a270f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:00.071877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3c81a-c20b-454b-a1db-731bc0a270f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:00.071877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3c81a-c20b-454b-a1db-731bc0a270f7 admin admin] PATH_INFO: `/v3/projects/b5d21065e0f24b52bff045fdf1fc4aff/users/e05c2f96a7034d84a3234dd21a1a84c8/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:00.085076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3c81a-c20b-454b-a1db-731bc0a270f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d21065e0f24b52bff045fdf1fc4aff, user_id=e05c2f96a7034d84a3234dd21a1a84c8, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:00.087719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3c81a-c20b-454b-a1db-731bc0a270f7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:00.170558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1367/2746] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:59:00 2022] PUT /identity/v3/projects/b5d21065e0f24b52bff045fdf1fc4aff/users/e05c2f96a7034d84a3234dd21a1a84c8/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:00.174876 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6bba6-a429-4f48-99fe-2da3cb83ddfc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:00.185923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6bba6-a429-4f48-99fe-2da3cb83ddfc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:00.196942 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:00.246827 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dbda44-641c-4b73-aaa5-74a6d0f54ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:00.247436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbda44-641c-4b73-aaa5-74a6d0f54ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:00.247716 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbda44-641c-4b73-aaa5-74a6d0f54ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:00.247988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dbda44-641c-4b73-aaa5-74a6d0f54ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:00.248679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbda44-641c-4b73-aaa5-74a6d0f54ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:00.250277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dbda44-641c-4b73-aaa5-74a6d0f54ccc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:00.261088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1380/2747] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:59:00.265377 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3c81a-c20b-454b-a1db-731bc0a270f7 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:00.276756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3c81a-c20b-454b-a1db-731bc0a270f7 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:00.281645 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e830f-cd54-4ec6-951d-bdcc424ffdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:00.282333 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e830f-cd54-4ec6-951d-bdcc424ffdb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:00.282637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e830f-cd54-4ec6-951d-bdcc424ffdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:00.285161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e830f-cd54-4ec6-951d-bdcc424ffdb6 admin admin] PATH_INFO: `/v3/projects/b5d21065e0f24b52bff045fdf1fc4aff/users/e05c2f96a7034d84a3234dd21a1a84c8/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:00.285161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e830f-cd54-4ec6-951d-bdcc424ffdb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d21065e0f24b52bff045fdf1fc4aff, user_id=e05c2f96a7034d84a3234dd21a1a84c8, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:00.287522 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e830f-cd54-4ec6-951d-bdcc424ffdb6 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:00.298832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1368/2748] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:59:00 2022] PUT /identity/v3/projects/b5d21065e0f24b52bff045fdf1fc4aff/users/e05c2f96a7034d84a3234dd21a1a84c8/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:00.309734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a879f-f6a2-49de-a6d4-32716855a9b9 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:00.310024 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a879f-f6a2-49de-a6d4-32716855a9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:00.310300 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a879f-f6a2-49de-a6d4-32716855a9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:00.340606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-d74a879f-f6a2-49de-a6d4-32716855a9b9 None None] MFA Rules not processed for user `e05c2f96a7034d84a3234dd21a1a84c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:00.341858 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d74a879f-f6a2-49de-a6d4-32716855a9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:00.412272 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1381/2749] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:59:00.423332 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e830f-cd54-4ec6-951d-bdcc424ffdb6 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:00.425081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-186e830f-cd54-4ec6-951d-bdcc424ffdb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:00.485392 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e830f-cd54-4ec6-951d-bdcc424ffdb6 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:00.489601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ef126-f887-4704-80b3-ddbdc9ef37ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:00.490246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ef126-f887-4704-80b3-ddbdc9ef37ea service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:00.490523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ef126-f887-4704-80b3-ddbdc9ef37ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:00.490858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ef126-f887-4704-80b3-ddbdc9ef37ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:00.503553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ef126-f887-4704-80b3-ddbdc9ef37ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:00.505710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ef126-f887-4704-80b3-ddbdc9ef37ea service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:00.516221 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1369/2750] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:59:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:59:00.548674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a879f-f6a2-49de-a6d4-32716855a9b9 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:00.617667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a879f-f6a2-49de-a6d4-32716855a9b9 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:00.622871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:00.623543 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:00.623815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:00.624090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] PATH_INFO: `/v3/users/adfcfa07c7b94a249f575d00200e1890` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:00.628313 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfcfa07c7b94a249f575d00200e1890)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:00.631436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:00.954236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:00.963404 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfcfa07c7b94a249f575d00200e1890'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:00.971563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfcfa07c7b94a249f575d00200e1890'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:00.972325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfcfa07c7b94a249f575d00200e1890'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:01.061855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfcfa07c7b94a249f575d00200e1890'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:01.062506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfcfa07c7b94a249f575d00200e1890'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:01.081726 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1382/2751] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:59:00 2022] DELETE /identity/v3/users/adfcfa07c7b94a249f575d00200e1890 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:01.087107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fab72-1f9b-4b85-b2bb-2a7245509320 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:01.087693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fab72-1f9b-4b85-b2bb-2a7245509320 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:01.087808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fab72-1f9b-4b85-b2bb-2a7245509320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:01.099417 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:01.114663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-5f5fab72-1f9b-4b85-b2bb-2a7245509320 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:01.115894 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5f5fab72-1f9b-4b85-b2bb-2a7245509320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:01.185318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1370/2752] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:01.195693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:01.199098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:01.257269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f025a-fbd5-4034-9f2d-96b395f03efc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:01.260896 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f36e8-7072-4272-85f2-3767eefee4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:01.261499 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f36e8-7072-4272-85f2-3767eefee4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:01.261774 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f36e8-7072-4272-85f2-3767eefee4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:01.262046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f36e8-7072-4272-85f2-3767eefee4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:01.271996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f36e8-7072-4272-85f2-3767eefee4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:01.273465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f36e8-7072-4272-85f2-3767eefee4c9 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:01.283540 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1383/2753] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:59:01.817555 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fab72-1f9b-4b85-b2bb-2a7245509320 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:01.824255 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5f5fab72-1f9b-4b85-b2bb-2a7245509320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:01.831595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fab72-1f9b-4b85-b2bb-2a7245509320 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:01.839235 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:01.839985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:01.840269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:01.840617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] PATH_INFO: `/v3/projects/c13e7e789f8b4ce2a196281eb8686161` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:01.841811 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c13e7e789f8b4ce2a196281eb8686161)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:01.843800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:01.953888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13e7e789f8b4ce2a196281eb8686161', 'request_id': 'req-e175557e-49f6-456f-b90e-ad9339646f81'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:01.960243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13e7e789f8b4ce2a196281eb8686161', 'request_id': 'req-e175557e-49f6-456f-b90e-ad9339646f81'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:02.142155 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13e7e789f8b4ce2a196281eb8686161', 'request_id': 'req-e175557e-49f6-456f-b90e-ad9339646f81'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:02.153187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] The token cache is being invalidate because project c13e7e789f8b4ce2a196281eb8686161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:59:02.153511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:02.154118 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:02.155608 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1371/2754] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:59:01 2022] DELETE /identity/v3/projects/c13e7e789f8b4ce2a196281eb8686161 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:02.159953 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f36e8-7072-4272-85f2-3767eefee4c9 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:02.170050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f36e8-7072-4272-85f2-3767eefee4c9 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:02.225715 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:02.226322 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:02.226643 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:02.226923 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] PATH_INFO: `/v3/users/e05c2f96a7034d84a3234dd21a1a84c8` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:02.228045 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05c2f96a7034d84a3234dd21a1a84c8)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:02.229981 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:02.454195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05c2f96a7034d84a3234dd21a1a84c8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:02.461057 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05c2f96a7034d84a3234dd21a1a84c8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:02.461739 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05c2f96a7034d84a3234dd21a1a84c8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:02.464245 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:02.651162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05c2f96a7034d84a3234dd21a1a84c8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:02.651843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-d8fac852-72f3-4945-9184-39d584264fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05c2f96a7034d84a3234dd21a1a84c8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:02.670777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1384/2755] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:59:02 2022] DELETE /identity/v3/users/e05c2f96a7034d84a3234dd21a1a84c8 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:03.100839 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:03.102783 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:03.116949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175557e-49f6-456f-b90e-ad9339646f81 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:03.185046 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:03.185745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:03.185993 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:03.186266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] PATH_INFO: `/v3/projects/b5d21065e0f24b52bff045fdf1fc4aff` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:03.187430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d21065e0f24b52bff045fdf1fc4aff)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:03.189637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:03.282239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:03.299076 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d21065e0f24b52bff045fdf1fc4aff', 'request_id': 'req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:03.306841 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d21065e0f24b52bff045fdf1fc4aff', 'request_id': 'req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:03.370537 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d21065e0f24b52bff045fdf1fc4aff', 'request_id': 'req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:03.382384 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] The token cache is being invalidate because project b5d21065e0f24b52bff045fdf1fc4aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:59:03.382681 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:03.383319 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5b63f3f7-cb1b-46b7-be98-3c05a5d192e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:03.384844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1372/2756] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:59:03 2022] DELETE /identity/v3/projects/b5d21065e0f24b52bff045fdf1fc4aff => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:03.389837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429902c8-7d0b-4f33-8a95-7a2be53e98b3 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:03.390328 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429902c8-7d0b-4f33-8a95-7a2be53e98b3 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:03.390447 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429902c8-7d0b-4f33-8a95-7a2be53e98b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:03.410840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-429902c8-7d0b-4f33-8a95-7a2be53e98b3 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:03.414563 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-429902c8-7d0b-4f33-8a95-7a2be53e98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:03.476909 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1385/2757] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:59:03.486402 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c9eb-8341-43d4-9c5a-7869e1a533fc None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:03.486580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c9eb-8341-43d4-9c5a-7869e1a533fc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:03.486849 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5c9eb-8341-43d4-9c5a-7869e1a533fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:03.510580 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e0e5c9eb-8341-43d4-9c5a-7869e1a533fc None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:03.511918 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e0e5c9eb-8341-43d4-9c5a-7869e1a533fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:03.521017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1373/2758] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:03.525337 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429902c8-7d0b-4f33-8a95-7a2be53e98b3 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:03.537049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429902c8-7d0b-4f33-8a95-7a2be53e98b3 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:03.542014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efc9bb-25d7-4e65-9188-694233e54a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:03.542634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efc9bb-25d7-4e65-9188-694233e54a10 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:03.542912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efc9bb-25d7-4e65-9188-694233e54a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:03.543202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efc9bb-25d7-4e65-9188-694233e54a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:03.543839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efc9bb-25d7-4e65-9188-694233e54a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:59:03.544140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efc9bb-25d7-4e65-9188-694233e54a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:03.545804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efc9bb-25d7-4e65-9188-694233e54a10 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:03.558777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1386/2759] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:59:03.563363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c9eb-8341-43d4-9c5a-7869e1a533fc None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:03.573930 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5c9eb-8341-43d4-9c5a-7869e1a533fc None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:03.578823 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a045e-f817-4ef1-91b9-222435fcf3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:03.579441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a045e-f817-4ef1-91b9-222435fcf3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:03.579718 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a045e-f817-4ef1-91b9-222435fcf3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:03.579988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a045e-f817-4ef1-91b9-222435fcf3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:03.580729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a045e-f817-4ef1-91b9-222435fcf3e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:03.583148 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a045e-f817-4ef1-91b9-222435fcf3e3 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:03.719690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1374/2760] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:59:03 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:59:03.725598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efc9bb-25d7-4e65-9188-694233e54a10 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:03.737832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efc9bb-25d7-4e65-9188-694233e54a10 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:03.803784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3252-56af-427a-9ddc-0883d9a19f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:03.804291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3252-56af-427a-9ddc-0883d9a19f75 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:03.804607 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3252-56af-427a-9ddc-0883d9a19f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:03.804883 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f3252-56af-427a-9ddc-0883d9a19f75 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:03.805528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f3252-56af-427a-9ddc-0883d9a19f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:03.807456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05f3252-56af-427a-9ddc-0883d9a19f75 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:03.919440 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1387/2761] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:59:03 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:59:03.923708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a045e-f817-4ef1-91b9-222435fcf3e3 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:03.934551 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a045e-f817-4ef1-91b9-222435fcf3e3 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:03.939306 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297d144-5202-4224-8dc7-7fdbcaaa48ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:03.939860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297d144-5202-4224-8dc7-7fdbcaaa48ea admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:03.940138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297d144-5202-4224-8dc7-7fdbcaaa48ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:03.940454 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297d144-5202-4224-8dc7-7fdbcaaa48ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:03.941124 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297d144-5202-4224-8dc7-7fdbcaaa48ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:03.943198 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297d144-5202-4224-8dc7-7fdbcaaa48ea admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:03.953748 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1375/2762] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:59:03.958466 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3252-56af-427a-9ddc-0883d9a19f75 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:03.968893 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f3252-56af-427a-9ddc-0883d9a19f75 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:03.973583 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508dad1-1018-4863-9fe5-fd27e56e0c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:03.974248 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508dad1-1018-4863-9fe5-fd27e56e0c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:03.974544 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508dad1-1018-4863-9fe5-fd27e56e0c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:03.974751 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508dad1-1018-4863-9fe5-fd27e56e0c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:03.975383 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508dad1-1018-4863-9fe5-fd27e56e0c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:03.977009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508dad1-1018-4863-9fe5-fd27e56e0c43 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:03.989271 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1388/2763] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:59:03.993412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297d144-5202-4224-8dc7-7fdbcaaa48ea admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:04.004027 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297d144-5202-4224-8dc7-7fdbcaaa48ea admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:04.009677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650eeb64-9007-4dbb-910a-7a1f18f6b937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:04.010342 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eeb64-9007-4dbb-910a-7a1f18f6b937 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:04.010616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eeb64-9007-4dbb-910a-7a1f18f6b937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:04.010882 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650eeb64-9007-4dbb-910a-7a1f18f6b937 admin admin] PATH_INFO: `/v3/projects/d566cd5de5194a9fb0792be0d2309268/users/c62b459c67a04bf3942c7b3c517d2507/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:04.027324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650eeb64-9007-4dbb-910a-7a1f18f6b937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d566cd5de5194a9fb0792be0d2309268, user_id=c62b459c67a04bf3942c7b3c517d2507, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:04.030206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650eeb64-9007-4dbb-910a-7a1f18f6b937 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:04.113602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1376/2764] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:59:03 2022] PUT /identity/v3/projects/d566cd5de5194a9fb0792be0d2309268/users/c62b459c67a04bf3942c7b3c517d2507/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:04.124462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f120b5-5948-4f8d-acac-9a73ac0ff036 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:04.127650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f120b5-5948-4f8d-acac-9a73ac0ff036 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:04.127650 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f120b5-5948-4f8d-acac-9a73ac0ff036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:04.154903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-57f120b5-5948-4f8d-acac-9a73ac0ff036 None None] MFA Rules not processed for user `c62b459c67a04bf3942c7b3c517d2507`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:04.156166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-57f120b5-5948-4f8d-acac-9a73ac0ff036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:04.188038 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:04.226000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1389/2765] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:04.231210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650eeb64-9007-4dbb-910a-7a1f18f6b937 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:04.295419 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650eeb64-9007-4dbb-910a-7a1f18f6b937 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:04.300359 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2da5fb-25ee-4add-898a-17b5f4ef95b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:04.300991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da5fb-25ee-4add-898a-17b5f4ef95b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:04.301268 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da5fb-25ee-4add-898a-17b5f4ef95b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:04.301536 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da5fb-25ee-4add-898a-17b5f4ef95b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:04.302434 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2da5fb-25ee-4add-898a-17b5f4ef95b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:04.304371 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2da5fb-25ee-4add-898a-17b5f4ef95b9 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:04.386178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1377/2766] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:59:04 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:59:04.390412 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f120b5-5948-4f8d-acac-9a73ac0ff036 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:04.402430 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f120b5-5948-4f8d-acac-9a73ac0ff036 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:04.462983 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9863914-f257-4573-976b-c5ee1a732137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:04.463598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9863914-f257-4573-976b-c5ee1a732137 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:04.463875 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9863914-f257-4573-976b-c5ee1a732137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:04.464145 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9863914-f257-4573-976b-c5ee1a732137 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:04.464891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9863914-f257-4573-976b-c5ee1a732137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:04.466792 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9863914-f257-4573-976b-c5ee1a732137 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:04.548897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1390/2767] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:59:04 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:59:04.553406 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2da5fb-25ee-4add-898a-17b5f4ef95b9 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:04.564601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2da5fb-25ee-4add-898a-17b5f4ef95b9 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:04.570192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36830c8b-7e0b-4604-adbf-de14188093ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:04.570749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36830c8b-7e0b-4604-adbf-de14188093ff admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:04.571025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36830c8b-7e0b-4604-adbf-de14188093ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:04.571321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36830c8b-7e0b-4604-adbf-de14188093ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:04.572031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36830c8b-7e0b-4604-adbf-de14188093ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:04.573703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36830c8b-7e0b-4604-adbf-de14188093ff admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:04.586300 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1378/2768] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:59:04.591911 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9863914-f257-4573-976b-c5ee1a732137 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:04.603589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9863914-f257-4573-976b-c5ee1a732137 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:04.608796 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8badb79-8280-478d-9d57-587f7e6e9f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:04.609478 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8badb79-8280-478d-9d57-587f7e6e9f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:04.609759 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8badb79-8280-478d-9d57-587f7e6e9f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:04.610035 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8badb79-8280-478d-9d57-587f7e6e9f11 admin admin] PATH_INFO: `/v3/projects/0b1e719c26b64293b8b821fd84269ef2/users/b804d75567a4483c8ea442c2c3810a27/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:04.626811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8badb79-8280-478d-9d57-587f7e6e9f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1e719c26b64293b8b821fd84269ef2, user_id=b804d75567a4483c8ea442c2c3810a27, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:04.630061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8badb79-8280-478d-9d57-587f7e6e9f11 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:04.708877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1391/2769] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:59:04 2022] PUT /identity/v3/projects/0b1e719c26b64293b8b821fd84269ef2/users/b804d75567a4483c8ea442c2c3810a27/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:04.713065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36830c8b-7e0b-4604-adbf-de14188093ff admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:04.724832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36830c8b-7e0b-4604-adbf-de14188093ff admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:04.749094 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:04.783585 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be77cc9-8f60-4aec-bf17-b8062f7d5693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:04.784188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be77cc9-8f60-4aec-bf17-b8062f7d5693 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:04.784463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be77cc9-8f60-4aec-bf17-b8062f7d5693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:04.784777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be77cc9-8f60-4aec-bf17-b8062f7d5693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:04.785414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be77cc9-8f60-4aec-bf17-b8062f7d5693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:04.787011 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be77cc9-8f60-4aec-bf17-b8062f7d5693 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:04.797279 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1379/2770] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:59:04.802104 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8badb79-8280-478d-9d57-587f7e6e9f11 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:04.814788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8badb79-8280-478d-9d57-587f7e6e9f11 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:04.819943 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f86a1d-9a15-4c7c-ba30-15e3c051b51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:04.820659 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f86a1d-9a15-4c7c-ba30-15e3c051b51d admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:04.820962 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f86a1d-9a15-4c7c-ba30-15e3c051b51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:04.821235 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f86a1d-9a15-4c7c-ba30-15e3c051b51d admin admin] PATH_INFO: `/v3/projects/0b1e719c26b64293b8b821fd84269ef2/users/b804d75567a4483c8ea442c2c3810a27/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:04.823162 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f86a1d-9a15-4c7c-ba30-15e3c051b51d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1e719c26b64293b8b821fd84269ef2, user_id=b804d75567a4483c8ea442c2c3810a27, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:04.825843 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f86a1d-9a15-4c7c-ba30-15e3c051b51d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:04.838331 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1392/2771] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:59:04 2022] PUT /identity/v3/projects/0b1e719c26b64293b8b821fd84269ef2/users/b804d75567a4483c8ea442c2c3810a27/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 21:59:04.849121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0025b-3536-4ee7-980c-5c25d1559091 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:04.849968 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0025b-3536-4ee7-980c-5c25d1559091 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:04.850540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0025b-3536-4ee7-980c-5c25d1559091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:04.893996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-99a0025b-3536-4ee7-980c-5c25d1559091 None None] MFA Rules not processed for user `b804d75567a4483c8ea442c2c3810a27`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:04.895347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-99a0025b-3536-4ee7-980c-5c25d1559091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:04.973447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1380/2772] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 21:59:04.986050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f86a1d-9a15-4c7c-ba30-15e3c051b51d admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:04.988096 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-d8f86a1d-9a15-4c7c-ba30-15e3c051b51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:05.049788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f86a1d-9a15-4c7c-ba30-15e3c051b51d admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:05.054016 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39850384-8f61-4461-a9f8-199b1bee1978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:05.054623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39850384-8f61-4461-a9f8-199b1bee1978 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:05.054899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39850384-8f61-4461-a9f8-199b1bee1978 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:05.055165 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39850384-8f61-4461-a9f8-199b1bee1978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:05.096728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:05.117866 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39850384-8f61-4461-a9f8-199b1bee1978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:05.119312 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39850384-8f61-4461-a9f8-199b1bee1978 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:05.128288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1393/2773] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:59:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:59:06.917807 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0025b-3536-4ee7-980c-5c25d1559091 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:06.919347 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-99a0025b-3536-4ee7-980c-5c25d1559091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:06.933410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0025b-3536-4ee7-980c-5c25d1559091 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:06.937230 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27111f66-fd80-44c4-8df5-5a612dc0bd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:06.937877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27111f66-fd80-44c4-8df5-5a612dc0bd6f service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:06.938145 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27111f66-fd80-44c4-8df5-5a612dc0bd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:06.938412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27111f66-fd80-44c4-8df5-5a612dc0bd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:06.948178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27111f66-fd80-44c4-8df5-5a612dc0bd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:06.949654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27111f66-fd80-44c4-8df5-5a612dc0bd6f service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:06.960985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1381/2774] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:59:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:59:11.376001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39850384-8f61-4461-a9f8-199b1bee1978 service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:11.443354 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39850384-8f61-4461-a9f8-199b1bee1978 service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:11.448021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:11.448696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:11.453899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:11.453899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] PATH_INFO: `/v3/users/c62b459c67a04bf3942c7b3c517d2507` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:11.453899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62b459c67a04bf3942c7b3c517d2507)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:11.453899 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:11.694885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62b459c67a04bf3942c7b3c517d2507'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:11.706133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62b459c67a04bf3942c7b3c517d2507'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:11.706912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62b459c67a04bf3942c7b3c517d2507'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:11.753442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62b459c67a04bf3942c7b3c517d2507'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:11.754064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62b459c67a04bf3942c7b3c517d2507'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:11.773136 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1394/2775] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:59:11 2022] DELETE /identity/v3/users/c62b459c67a04bf3942c7b3c517d2507 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:11.778316 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734f9f-41fc-4eac-8d33-76c75a83f1aa None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:11.778893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734f9f-41fc-4eac-8d33-76c75a83f1aa None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:11.778893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd734f9f-41fc-4eac-8d33-76c75a83f1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:11.799365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-fd734f9f-41fc-4eac-8d33-76c75a83f1aa None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:11.800614 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fd734f9f-41fc-4eac-8d33-76c75a83f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:11.864773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1382/2776] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:11.875714 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:11.877480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:11.935132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ec1dc-6613-4b5b-b773-066542efad68 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:11.938961 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85203e26-e2c5-488a-b625-fbd593dba7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:11.939586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85203e26-e2c5-488a-b625-fbd593dba7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:11.939867 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85203e26-e2c5-488a-b625-fbd593dba7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:11.940200 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85203e26-e2c5-488a-b625-fbd593dba7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:11.950231 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85203e26-e2c5-488a-b625-fbd593dba7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:11.951589 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85203e26-e2c5-488a-b625-fbd593dba7c8 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:11.956713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:11.961975 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1395/2777] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:59:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:59:12.436019 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd734f9f-41fc-4eac-8d33-76c75a83f1aa None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:12.438155 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-fd734f9f-41fc-4eac-8d33-76c75a83f1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:12.455972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd734f9f-41fc-4eac-8d33-76c75a83f1aa None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:12.462041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:12.462702 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:12.462985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:12.463260 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] PATH_INFO: `/v3/projects/d566cd5de5194a9fb0792be0d2309268` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:12.464444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d566cd5de5194a9fb0792be0d2309268)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:12.472757 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:12.564633 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:12.577229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd566cd5de5194a9fb0792be0d2309268', 'request_id': 'req-40daf043-470a-49d8-8a0e-2bc616cb81d7'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:12.584379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd566cd5de5194a9fb0792be0d2309268', 'request_id': 'req-40daf043-470a-49d8-8a0e-2bc616cb81d7'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:12.712857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd566cd5de5194a9fb0792be0d2309268', 'request_id': 'req-40daf043-470a-49d8-8a0e-2bc616cb81d7'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:12.728554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] The token cache is being invalidate because project d566cd5de5194a9fb0792be0d2309268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:59:12.728554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:12.728554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:12.728554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1383/2778] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:59:12 2022] DELETE /identity/v3/projects/d566cd5de5194a9fb0792be0d2309268 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:12.730886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85203e26-e2c5-488a-b625-fbd593dba7c8 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:12.741334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85203e26-e2c5-488a-b625-fbd593dba7c8 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:12.802624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:12.803276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:12.803553 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:12.803820 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] PATH_INFO: `/v3/users/b804d75567a4483c8ea442c2c3810a27` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:12.805022 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b804d75567a4483c8ea442c2c3810a27)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:12.806971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:13.162467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b804d75567a4483c8ea442c2c3810a27'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:13.170121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b804d75567a4483c8ea442c2c3810a27'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:13.170845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b804d75567a4483c8ea442c2c3810a27'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:13.393854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b804d75567a4483c8ea442c2c3810a27'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:13.394390 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-acb9c7d2-e483-4295-8a2d-2ca3e68e9948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b804d75567a4483c8ea442c2c3810a27'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:13.412849 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1396/2779] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:59:12 2022] DELETE /identity/v3/users/b804d75567a4483c8ea442c2c3810a27 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:13.818803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:13.820324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:13.833355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daf043-470a-49d8-8a0e-2bc616cb81d7 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:13.910100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:13.910737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:13.911616 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:13.911913 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] PATH_INFO: `/v3/projects/0b1e719c26b64293b8b821fd84269ef2` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:13.913080 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1e719c26b64293b8b821fd84269ef2)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:13.914975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:14.058331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1e719c26b64293b8b821fd84269ef2', 'request_id': 'req-3a812566-a4f8-42a9-be15-1a49b0911715'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:14.064988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1e719c26b64293b8b821fd84269ef2', 'request_id': 'req-3a812566-a4f8-42a9-be15-1a49b0911715'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:14.124760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1e719c26b64293b8b821fd84269ef2', 'request_id': 'req-3a812566-a4f8-42a9-be15-1a49b0911715'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:14.137119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] The token cache is being invalidate because project 0b1e719c26b64293b8b821fd84269ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:59:14.141366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:14.141366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3a812566-a4f8-42a9-be15-1a49b0911715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:14.141366 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1384/2780] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:59:13 2022] DELETE /identity/v3/projects/0b1e719c26b64293b8b821fd84269ef2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:14.146167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee93466-510b-49b8-ba1f-57dcebbf1524 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:14.147083 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee93466-510b-49b8-ba1f-57dcebbf1524 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:14.147252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee93466-510b-49b8-ba1f-57dcebbf1524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:14.168817 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-4ee93466-510b-49b8-ba1f-57dcebbf1524 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:14.171832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-4ee93466-510b-49b8-ba1f-57dcebbf1524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:14.232754 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1397/2781] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:14.300915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fbc03-0f6f-4bc6-9bbc-e82538533a12 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:14.301121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fbc03-0f6f-4bc6-9bbc-e82538533a12 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:14.301369 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fbc03-0f6f-4bc6-9bbc-e82538533a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:14.323464 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-838fbc03-0f6f-4bc6-9bbc-e82538533a12 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:14.324802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-838fbc03-0f6f-4bc6-9bbc-e82538533a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:14.333604 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1385/2782] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:14.338064 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee93466-510b-49b8-ba1f-57dcebbf1524 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:14.348193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee93466-510b-49b8-ba1f-57dcebbf1524 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:14.353061 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516999eb-d0d4-4aeb-9d56-0d35aab7e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:14.353663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516999eb-d0d4-4aeb-9d56-0d35aab7e38f admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:14.353940 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516999eb-d0d4-4aeb-9d56-0d35aab7e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:14.354214 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516999eb-d0d4-4aeb-9d56-0d35aab7e38f admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:14.354860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516999eb-d0d4-4aeb-9d56-0d35aab7e38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:59:14.355161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516999eb-d0d4-4aeb-9d56-0d35aab7e38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:14.356786 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516999eb-d0d4-4aeb-9d56-0d35aab7e38f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:14.368821 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1398/2783] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 21:59:14.374513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fbc03-0f6f-4bc6-9bbc-e82538533a12 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:14.384752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fbc03-0f6f-4bc6-9bbc-e82538533a12 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:14.389568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffa474-6787-47b8-9123-41c50712a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:14.390170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffa474-6787-47b8-9123-41c50712a9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:14.390447 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffa474-6787-47b8-9123-41c50712a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:14.390720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffa474-6787-47b8-9123-41c50712a9a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:14.391351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffa474-6787-47b8-9123-41c50712a9a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:14.393519 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffa474-6787-47b8-9123-41c50712a9a5 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:14.532206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1386/2784] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:59:14 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:59:14.536586 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516999eb-d0d4-4aeb-9d56-0d35aab7e38f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:14.554863 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516999eb-d0d4-4aeb-9d56-0d35aab7e38f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:14.558768 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:14.612510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769791f-3e79-435f-8188-20908812a36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:14.613233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769791f-3e79-435f-8188-20908812a36b admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:14.613519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769791f-3e79-435f-8188-20908812a36b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:14.613785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769791f-3e79-435f-8188-20908812a36b admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:14.614934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769791f-3e79-435f-8188-20908812a36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:14.616928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769791f-3e79-435f-8188-20908812a36b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:14.725494 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1399/2785] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:59:14 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:59:14.735320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffa474-6787-47b8-9123-41c50712a9a5 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:14.746440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffa474-6787-47b8-9123-41c50712a9a5 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:14.751083 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de9d5b-96f4-4b8d-8303-a1d472ff00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:14.751759 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9d5b-96f4-4b8d-8303-a1d472ff00f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:14.751979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9d5b-96f4-4b8d-8303-a1d472ff00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:14.752273 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9d5b-96f4-4b8d-8303-a1d472ff00f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:14.752963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de9d5b-96f4-4b8d-8303-a1d472ff00f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:14.755149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de9d5b-96f4-4b8d-8303-a1d472ff00f0 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:14.765553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1387/2786] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:59:14.769688 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769791f-3e79-435f-8188-20908812a36b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:14.779750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769791f-3e79-435f-8188-20908812a36b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:14.784290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accae152-8456-4ff8-871a-9f3e3e0640ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:14.784914 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accae152-8456-4ff8-871a-9f3e3e0640ef admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:14.785196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accae152-8456-4ff8-871a-9f3e3e0640ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:14.785462 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accae152-8456-4ff8-871a-9f3e3e0640ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:14.786095 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accae152-8456-4ff8-871a-9f3e3e0640ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:14.787672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accae152-8456-4ff8-871a-9f3e3e0640ef admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:14.798397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1400/2787] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:59:14.803719 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de9d5b-96f4-4b8d-8303-a1d472ff00f0 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:14.813905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de9d5b-96f4-4b8d-8303-a1d472ff00f0 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:14.819058 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2a39b-6811-40f2-a3e8-cf45a1e11933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:14.819712 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2a39b-6811-40f2-a3e8-cf45a1e11933 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:14.820149 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2a39b-6811-40f2-a3e8-cf45a1e11933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:14.820430 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2a39b-6811-40f2-a3e8-cf45a1e11933 admin admin] PATH_INFO: `/v3/projects/d3cb18e34f0046b7bbc2f2122709f406/users/25f2d80e13c54a608c9d247e5ffb066e/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:14.823655 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:14.839066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2a39b-6811-40f2-a3e8-cf45a1e11933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cb18e34f0046b7bbc2f2122709f406, user_id=25f2d80e13c54a608c9d247e5ffb066e, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:14.841799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2a39b-6811-40f2-a3e8-cf45a1e11933 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:14.949750 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1388/2788] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:59:14 2022] PUT /identity/v3/projects/d3cb18e34f0046b7bbc2f2122709f406/users/25f2d80e13c54a608c9d247e5ffb066e/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:14.960190 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90282a2a-5e57-4c02-aef3-bd067d2f9d89 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:14.960470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90282a2a-5e57-4c02-aef3-bd067d2f9d89 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:14.960769 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90282a2a-5e57-4c02-aef3-bd067d2f9d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:14.989892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-90282a2a-5e57-4c02-aef3-bd067d2f9d89 None None] MFA Rules not processed for user `25f2d80e13c54a608c9d247e5ffb066e`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:14.991164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-90282a2a-5e57-4c02-aef3-bd067d2f9d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:15.059367 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1401/2789] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:15.064181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2a39b-6811-40f2-a3e8-cf45a1e11933 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:15.128960 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2a39b-6811-40f2-a3e8-cf45a1e11933 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:15.134298 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b1935-5222-4afe-bd7a-319fa2ff5e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:15.134926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b1935-5222-4afe-bd7a-319fa2ff5e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:15.135210 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b1935-5222-4afe-bd7a-319fa2ff5e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:15.135487 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b1935-5222-4afe-bd7a-319fa2ff5e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:15.136150 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b1935-5222-4afe-bd7a-319fa2ff5e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:15.138122 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b1935-5222-4afe-bd7a-319fa2ff5e9f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:15.296971 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1389/2790] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:59:15 2022] POST /identity/v3/projects => generated 387 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:59:15.302781 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90282a2a-5e57-4c02-aef3-bd067d2f9d89 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:15.314460 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90282a2a-5e57-4c02-aef3-bd067d2f9d89 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:15.376090 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd1d65-bafc-46a1-965d-38f927045b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:15.376797 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd1d65-bafc-46a1-965d-38f927045b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:15.377071 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd1d65-bafc-46a1-965d-38f927045b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:15.377338 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd1d65-bafc-46a1-965d-38f927045b32 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:15.377976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd1d65-bafc-46a1-965d-38f927045b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:15.379927 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd1d65-bafc-46a1-965d-38f927045b32 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:15.445493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1402/2791] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:59:15 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 21:59:15.449596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b1935-5222-4afe-bd7a-319fa2ff5e9f admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:15.461044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b1935-5222-4afe-bd7a-319fa2ff5e9f admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:15.474179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a26992-23ea-4bb2-8431-2a7974d60d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:15.474179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a26992-23ea-4bb2-8431-2a7974d60d9e admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:15.474179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a26992-23ea-4bb2-8431-2a7974d60d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:15.474179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a26992-23ea-4bb2-8431-2a7974d60d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:15.474637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a26992-23ea-4bb2-8431-2a7974d60d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:15.474637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a26992-23ea-4bb2-8431-2a7974d60d9e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:15.481475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1390/2792] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:59:15.485826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd1d65-bafc-46a1-965d-38f927045b32 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:15.492254 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:15.500234 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd1d65-bafc-46a1-965d-38f927045b32 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:15.507416 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48450dd6-3293-41dd-b9e4-6c27480d5b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:15.509622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48450dd6-3293-41dd-b9e4-6c27480d5b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:15.509622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48450dd6-3293-41dd-b9e4-6c27480d5b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:15.509622 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48450dd6-3293-41dd-b9e4-6c27480d5b99 admin admin] PATH_INFO: `/v3/projects/b0877d8f3da143c69da0673a080dda90/users/3f0a84ac836242dea417a4c50a62944c/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:15.525616 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48450dd6-3293-41dd-b9e4-6c27480d5b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0877d8f3da143c69da0673a080dda90, user_id=3f0a84ac836242dea417a4c50a62944c, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:15.528300 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48450dd6-3293-41dd-b9e4-6c27480d5b99 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:15.646089 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1403/2793] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:59:15 2022] PUT /identity/v3/projects/b0877d8f3da143c69da0673a080dda90/users/3f0a84ac836242dea417a4c50a62944c/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:15.650010 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a26992-23ea-4bb2-8431-2a7974d60d9e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:15.660289 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a26992-23ea-4bb2-8431-2a7974d60d9e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:15.724297 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04862e-0707-4dff-9c7f-60baaedf2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:15.724937 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04862e-0707-4dff-9c7f-60baaedf2dad admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:15.725218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04862e-0707-4dff-9c7f-60baaedf2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:15.725491 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04862e-0707-4dff-9c7f-60baaedf2dad admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:15.726138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04862e-0707-4dff-9c7f-60baaedf2dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:15.727746 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04862e-0707-4dff-9c7f-60baaedf2dad admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:15.737934 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1391/2794] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:59:15.742436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48450dd6-3293-41dd-b9e4-6c27480d5b99 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:15.753077 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48450dd6-3293-41dd-b9e4-6c27480d5b99 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:15.758345 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1e0bc-0017-483b-8bc6-c0b1464bf16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:15.759014 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e0bc-0017-483b-8bc6-c0b1464bf16e admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:15.759294 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e0bc-0017-483b-8bc6-c0b1464bf16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:15.759568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e1e0bc-0017-483b-8bc6-c0b1464bf16e admin admin] PATH_INFO: `/v3/projects/b0877d8f3da143c69da0673a080dda90/users/3f0a84ac836242dea417a4c50a62944c/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:15.761535 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1e0bc-0017-483b-8bc6-c0b1464bf16e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0877d8f3da143c69da0673a080dda90, user_id=3f0a84ac836242dea417a4c50a62944c, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:15.764172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e1e0bc-0017-483b-8bc6-c0b1464bf16e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:15.775713 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1404/2795] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:59:15 2022] PUT /identity/v3/projects/b0877d8f3da143c69da0673a080dda90/users/3f0a84ac836242dea417a4c50a62944c/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:15.787656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f384105-7f17-4c92-9e08-9ab91e7d1a0b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:15.787949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f384105-7f17-4c92-9e08-9ab91e7d1a0b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:15.788232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f384105-7f17-4c92-9e08-9ab91e7d1a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:15.822726 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9f384105-7f17-4c92-9e08-9ab91e7d1a0b None None] MFA Rules not processed for user `3f0a84ac836242dea417a4c50a62944c`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:15.823956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9f384105-7f17-4c92-9e08-9ab91e7d1a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:15.868932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:15.895893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1392/2796] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:15.906709 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1e0bc-0017-483b-8bc6-c0b1464bf16e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:15.908555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-58e1e0bc-0017-483b-8bc6-c0b1464bf16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:15.969028 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e1e0bc-0017-483b-8bc6-c0b1464bf16e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:15.972987 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d0e2f-3427-4766-98b6-58751c5af8e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:15.973608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d0e2f-3427-4766-98b6-58751c5af8e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:15.973888 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d0e2f-3427-4766-98b6-58751c5af8e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:15.974161 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d0e2f-3427-4766-98b6-58751c5af8e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:15.984006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d0e2f-3427-4766-98b6-58751c5af8e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:15.985474 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d0e2f-3427-4766-98b6-58751c5af8e7 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:15.996476 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1405/2797] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:59:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:59:16.148378 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f384105-7f17-4c92-9e08-9ab91e7d1a0b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:16.216527 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f384105-7f17-4c92-9e08-9ab91e7d1a0b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:16.221051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:16.221697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:16.221976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:16.222254 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] PATH_INFO: `/v3/users/25f2d80e13c54a608c9d247e5ffb066e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:16.223390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f2d80e13c54a608c9d247e5ffb066e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:16.225345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:16.430638 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f2d80e13c54a608c9d247e5ffb066e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:16.437947 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f2d80e13c54a608c9d247e5ffb066e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:16.438646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f2d80e13c54a608c9d247e5ffb066e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:16.518922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f2d80e13c54a608c9d247e5ffb066e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:16.532178 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f2d80e13c54a608c9d247e5ffb066e'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:16.538842 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1393/2798] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:59:16 2022] DELETE /identity/v3/users/25f2d80e13c54a608c9d247e5ffb066e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:16.543738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bf209-0b44-48a2-9f1f-f3b3f01cc9cc None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:16.544240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bf209-0b44-48a2-9f1f-f3b3f01cc9cc None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:16.544240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bf209-0b44-48a2-9f1f-f3b3f01cc9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:16.564504 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-cd0bf209-0b44-48a2-9f1f-f3b3f01cc9cc None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:16.565725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cd0bf209-0b44-48a2-9f1f-f3b3f01cc9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:16.626058 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1406/2799] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:16.637191 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:16.638652 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:16.698724 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf35d6a-4217-4311-bf82-ac61058a6c3a admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:16.702387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef974-16b7-4d9b-ba6e-2a372f2bc7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:16.703523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef974-16b7-4d9b-ba6e-2a372f2bc7dc service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:16.703523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef974-16b7-4d9b-ba6e-2a372f2bc7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:16.703523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef974-16b7-4d9b-ba6e-2a372f2bc7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:16.713643 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ef974-16b7-4d9b-ba6e-2a372f2bc7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:16.715087 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ef974-16b7-4d9b-ba6e-2a372f2bc7dc service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:16.725777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1394/2800] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 21:59:17.155490 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bf209-0b44-48a2-9f1f-f3b3f01cc9cc None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:17.157184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-cd0bf209-0b44-48a2-9f1f-f3b3f01cc9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:17.172179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bf209-0b44-48a2-9f1f-f3b3f01cc9cc None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:17.178576 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:17.179449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:17.179731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:17.180003 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] PATH_INFO: `/v3/projects/d3cb18e34f0046b7bbc2f2122709f406` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:17.181265 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3cb18e34f0046b7bbc2f2122709f406)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:17.183328 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:17.291848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3cb18e34f0046b7bbc2f2122709f406', 'request_id': 'req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:17.297673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3cb18e34f0046b7bbc2f2122709f406', 'request_id': 'req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:17.388129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3cb18e34f0046b7bbc2f2122709f406', 'request_id': 'req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:17.389603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:17.401141 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] The token cache is being invalidate because project d3cb18e34f0046b7bbc2f2122709f406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:59:17.401355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:17.402026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:17.403629 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1407/2801] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:59:17 2022] DELETE /identity/v3/projects/d3cb18e34f0046b7bbc2f2122709f406 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:17.407776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef974-16b7-4d9b-ba6e-2a372f2bc7dc service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:17.412915 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:17.418554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef974-16b7-4d9b-ba6e-2a372f2bc7dc service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:17.477455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:17.478119 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:17.478381 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:17.478655 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] PATH_INFO: `/v3/users/3f0a84ac836242dea417a4c50a62944c` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:17.480475 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0a84ac836242dea417a4c50a62944c)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:17.482784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:17.659187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0a84ac836242dea417a4c50a62944c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:17.666396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0a84ac836242dea417a4c50a62944c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:17.667110 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0a84ac836242dea417a4c50a62944c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:17.736412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0a84ac836242dea417a4c50a62944c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:17.750353 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fd573bd1-8675-4170-86eb-23ab6f112c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0a84ac836242dea417a4c50a62944c'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:17.757044 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1395/2802] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:59:17 2022] DELETE /identity/v3/users/3f0a84ac836242dea417a4c50a62944c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:18.195040 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:18.197819 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:18.211841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459fc01-b29e-4c5a-bcb4-a8e5f3302fa0 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:18.271149 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:18.274193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:18.274193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:18.274193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] PATH_INFO: `/v3/projects/b0877d8f3da143c69da0673a080dda90` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:18.274193 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0877d8f3da143c69da0673a080dda90)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:18.275560 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:18.360343 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0877d8f3da143c69da0673a080dda90', 'request_id': 'req-fd83cc29-2a53-4a70-921e-d879dc3d2474'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:18.366438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0877d8f3da143c69da0673a080dda90', 'request_id': 'req-fd83cc29-2a53-4a70-921e-d879dc3d2474'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:18.428352 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0877d8f3da143c69da0673a080dda90', 'request_id': 'req-fd83cc29-2a53-4a70-921e-d879dc3d2474'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:18.440422 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] The token cache is being invalidate because project b0877d8f3da143c69da0673a080dda90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:59:18.440797 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:18.441428 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-fd83cc29-2a53-4a70-921e-d879dc3d2474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:18.443604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1408/2803] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:59:18 2022] DELETE /identity/v3/projects/b0877d8f3da143c69da0673a080dda90 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:18.448573 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e9ee2-2258-47d7-9dd3-615de664d6b2 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:18.449081 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e9ee2-2258-47d7-9dd3-615de664d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:18.449240 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e9ee2-2258-47d7-9dd3-615de664d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:18.469140 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-081e9ee2-2258-47d7-9dd3-615de664d6b2 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:18.470318 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-081e9ee2-2258-47d7-9dd3-615de664d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:18.530995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1396/2804] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:18.538676 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2c3cf-85c3-4a76-ac0c-eeb39fbb60af None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:18.538958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2c3cf-85c3-4a76-ac0c-eeb39fbb60af None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:18.539230 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c2c3cf-85c3-4a76-ac0c-eeb39fbb60af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:18.560574 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f9c2c3cf-85c3-4a76-ac0c-eeb39fbb60af None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:18.561789 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f9c2c3cf-85c3-4a76-ac0c-eeb39fbb60af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:18.570558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1409/2805] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:18.575201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e9ee2-2258-47d7-9dd3-615de664d6b2 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:18.585382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e9ee2-2258-47d7-9dd3-615de664d6b2 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:18.590004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea862-fac0-40b9-a504-1a37957de20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:18.590617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea862-fac0-40b9-a504-1a37957de20e admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:18.590896 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea862-fac0-40b9-a504-1a37957de20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:18.591170 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ea862-fac0-40b9-a504-1a37957de20e admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:18.591860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea862-fac0-40b9-a504-1a37957de20e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 21:59:18.592164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea862-fac0-40b9-a504-1a37957de20e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:18.593808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ea862-fac0-40b9-a504-1a37957de20e admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:18.605979 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1397/2806] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 21:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 21:59:18.610585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2c3cf-85c3-4a76-ac0c-eeb39fbb60af None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:18.620885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c2c3cf-85c3-4a76-ac0c-eeb39fbb60af None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:18.625639 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883570e8-0b02-4af5-ab09-296873df67d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:18.626251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883570e8-0b02-4af5-ab09-296873df67d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:18.626585 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883570e8-0b02-4af5-ab09-296873df67d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:18.626851 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883570e8-0b02-4af5-ab09-296873df67d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:18.627489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883570e8-0b02-4af5-ab09-296873df67d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:18.630076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883570e8-0b02-4af5-ab09-296873df67d8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:18.727132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1410/2807] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 21:59:18 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:59:18.731387 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea862-fac0-40b9-a504-1a37957de20e admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:18.742422 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ea862-fac0-40b9-a504-1a37957de20e admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:18.747690 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:18.800190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ee7c1-4f0e-49fd-9d9f-f3ebd34801ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:18.800830 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ee7c1-4f0e-49fd-9d9f-f3ebd34801ae admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:18.801107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ee7c1-4f0e-49fd-9d9f-f3ebd34801ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:18.802273 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ee7c1-4f0e-49fd-9d9f-f3ebd34801ae admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:18.802905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ee7c1-4f0e-49fd-9d9f-f3ebd34801ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:18.804885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ee7c1-4f0e-49fd-9d9f-f3ebd34801ae admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:18.873951 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1398/2808] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 21:59:18 2022] POST /identity/v3/users => generated 299 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 21:59:18.878744 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883570e8-0b02-4af5-ab09-296873df67d8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:18.889805 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883570e8-0b02-4af5-ab09-296873df67d8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:18.894743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606b4d0-04f4-43d3-9be9-8af57d41b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:18.895374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606b4d0-04f4-43d3-9be9-8af57d41b4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:18.895644 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606b4d0-04f4-43d3-9be9-8af57d41b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:18.895915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606b4d0-04f4-43d3-9be9-8af57d41b4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:18.896679 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606b4d0-04f4-43d3-9be9-8af57d41b4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:18.898281 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606b4d0-04f4-43d3-9be9-8af57d41b4f4 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:18.908853 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1411/2809] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 21:59:18.913737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ee7c1-4f0e-49fd-9d9f-f3ebd34801ae admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:18.923761 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ee7c1-4f0e-49fd-9d9f-f3ebd34801ae admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:18.929384 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2228d-366e-4c47-b421-9e7eda01b61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:18.929981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2228d-366e-4c47-b421-9e7eda01b61b admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:18.930256 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2228d-366e-4c47-b421-9e7eda01b61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:18.930525 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2228d-366e-4c47-b421-9e7eda01b61b admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:18.931158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2228d-366e-4c47-b421-9e7eda01b61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:18.932782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2228d-366e-4c47-b421-9e7eda01b61b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:18.943821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1399/2810] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 21:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 21:59:18.948116 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606b4d0-04f4-43d3-9be9-8af57d41b4f4 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:18.958452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606b4d0-04f4-43d3-9be9-8af57d41b4f4 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:18.963129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbdc32-3006-4515-b2b7-e10684c08a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:18.963777 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbdc32-3006-4515-b2b7-e10684c08a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:18.964048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbdc32-3006-4515-b2b7-e10684c08a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:18.964314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbdc32-3006-4515-b2b7-e10684c08a91 admin admin] PATH_INFO: `/v3/projects/c0887fda249a4e60add4da398a68edef/users/41c25ddc8709410198cf0422db216c45/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:18.979880 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbdc32-3006-4515-b2b7-e10684c08a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0887fda249a4e60add4da398a68edef, user_id=41c25ddc8709410198cf0422db216c45, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:18.982519 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbdc32-3006-4515-b2b7-e10684c08a91 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:19.055738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1412/2811] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 21:59:18 2022] PUT /identity/v3/projects/c0887fda249a4e60add4da398a68edef/users/41c25ddc8709410198cf0422db216c45/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:19.075644 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2990-0c4b-4f5b-9f6d-72fcfa35ce43 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:19.075933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2990-0c4b-4f5b-9f6d-72fcfa35ce43 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:19.076213 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb2990-0c4b-4f5b-9f6d-72fcfa35ce43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:19.105661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-12fb2990-0c4b-4f5b-9f6d-72fcfa35ce43 None None] MFA Rules not processed for user `41c25ddc8709410198cf0422db216c45`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:19.106963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-12fb2990-0c4b-4f5b-9f6d-72fcfa35ce43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:19.173741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1400/2812] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:19.186122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbdc32-3006-4515-b2b7-e10684c08a91 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:19.187946 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2ebbdc32-3006-4515-b2b7-e10684c08a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:19.210517 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:19.246240 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbdc32-3006-4515-b2b7-e10684c08a91 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:19.249898 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fd959-4e54-4e42-abaf-db42f7f61241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:19.250496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fd959-4e54-4e42-abaf-db42f7f61241 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:19.250770 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fd959-4e54-4e42-abaf-db42f7f61241 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:19.251036 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fd959-4e54-4e42-abaf-db42f7f61241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:19.259363 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fd959-4e54-4e42-abaf-db42f7f61241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:19.260811 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fd959-4e54-4e42-abaf-db42f7f61241 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:19.270628 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1413/2813] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:59:19 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:59:25.240314 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb2990-0c4b-4f5b-9f6d-72fcfa35ce43 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:25.309116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb2990-0c4b-4f5b-9f6d-72fcfa35ce43 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:25.309876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:25.310511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:25.310791 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:25.311062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] PATH_INFO: `/v3/users/41c25ddc8709410198cf0422db216c45` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:25.312202 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c25ddc8709410198cf0422db216c45)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:25.314165 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:25.336008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:25.521185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c25ddc8709410198cf0422db216c45'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:25.527969 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c25ddc8709410198cf0422db216c45'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:25.528676 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c25ddc8709410198cf0422db216c45'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:25.622263 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c25ddc8709410198cf0422db216c45'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:25.635745 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c25ddc8709410198cf0422db216c45'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:25.642945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1401/2814] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 21:59:25 2022] DELETE /identity/v3/users/41c25ddc8709410198cf0422db216c45 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:25.647694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e474-c6e9-4bf7-81e7-4541fd9b0d86 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:25.648948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e474-c6e9-4bf7-81e7-4541fd9b0d86 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:25.648948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5e474-c6e9-4bf7-81e7-4541fd9b0d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:25.667815 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-bab5e474-c6e9-4bf7-81e7-4541fd9b0d86 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:25.669055 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bab5e474-c6e9-4bf7-81e7-4541fd9b0d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:25.729133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1414/2815] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:25.739754 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:25.741197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:25.798597 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d4768-5e4d-4717-8fbf-6fdae4ea1a12 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:25.803134 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe0399-b08b-4102-a869-a235043bd7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:25.803699 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0399-b08b-4102-a869-a235043bd7bd service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:25.803987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0399-b08b-4102-a869-a235043bd7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:25.804244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe0399-b08b-4102-a869-a235043bd7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:25.813991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe0399-b08b-4102-a869-a235043bd7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:25.815444 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe0399-b08b-4102-a869-a235043bd7bd service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:25.825989 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1402/2816] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:59:26.258719 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e474-c6e9-4bf7-81e7-4541fd9b0d86 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:26.260342 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-bab5e474-c6e9-4bf7-81e7-4541fd9b0d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:26.274837 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5e474-c6e9-4bf7-81e7-4541fd9b0d86 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:26.279645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:26.280431 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:26.280745 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:26.281027 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] PATH_INFO: `/v3/projects/c0887fda249a4e60add4da398a68edef` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:26.283208 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0887fda249a4e60add4da398a68edef)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:26.285172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:26.412780 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0887fda249a4e60add4da398a68edef', 'request_id': 'req-30d40a62-0133-4746-8444-ab0f57b89549'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:26.418545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0887fda249a4e60add4da398a68edef', 'request_id': 'req-30d40a62-0133-4746-8444-ab0f57b89549'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:26.479552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0887fda249a4e60add4da398a68edef', 'request_id': 'req-30d40a62-0133-4746-8444-ab0f57b89549'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:26.492115 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] The token cache is being invalidate because project c0887fda249a4e60add4da398a68edef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 21:59:26.492402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:26.493096 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 21:59:26.494671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1415/2817] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 21:59:26 2022] DELETE /identity/v3/projects/c0887fda249a4e60add4da398a68edef => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 21:59:35.821339 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:DELETE=8,keystone:SELECT=46,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:36.488553 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:48.718689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7553e75-edd2-463f-8e4e-549ca82d1b9b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:48.718689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7553e75-edd2-463f-8e4e-549ca82d1b9b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:48.718689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7553e75-edd2-463f-8e4e-549ca82d1b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:48.737344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-e7553e75-edd2-463f-8e4e-549ca82d1b9b None None] MFA Rules not processed for user `3a878450743f4843a5e8cc04ca94184d`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 21:59:48.738568 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e7553e75-edd2-463f-8e4e-549ca82d1b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:48.798201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1403/2818] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 21:59:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 21:59:49.127582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 21:59:49.129249 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:49.195218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d40a62-0133-4746-8444-ab0f57b89549 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 21:59:49.199258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ceae-e4aa-4f4e-a7f6-f77544bfdbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 21:59:49.199901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ceae-e4aa-4f4e-a7f6-f77544bfdbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 21:59:49.200179 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ceae-e4aa-4f4e-a7f6-f77544bfdbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 21:59:49.200453 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9ceae-e4aa-4f4e-a7f6-f77544bfdbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 21:59:49.202387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-23d9ceae-e4aa-4f4e-a7f6-f77544bfdbe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 21:59:49.215088 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9ceae-e4aa-4f4e-a7f6-f77544bfdbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 21:59:49.216693 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9ceae-e4aa-4f4e-a7f6-f77544bfdbe6 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 21:59:49.227672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1416/2819] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 21:59:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 21:59:58.791478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=25 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 21:59:59.222121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=26 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:44.378798 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7553e75-edd2-463f-8e4e-549ca82d1b9b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:00:44.383310 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-e7553e75-edd2-463f-8e4e-549ca82d1b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:00:44.462103 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7553e75-edd2-463f-8e4e-549ca82d1b9b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:00:44.471042 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7730e7-e664-4fe9-8779-0743f3ac0d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:00:44.472116 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730e7-e664-4fe9-8779-0743f3ac0d27 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:00:44.472890 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730e7-e664-4fe9-8779-0743f3ac0d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:00:44.473380 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7730e7-e664-4fe9-8779-0743f3ac0d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:00:44.476688 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0c7730e7-e664-4fe9-8779-0743f3ac0d27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:00:44.588309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7730e7-e664-4fe9-8779-0743f3ac0d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:00:44.589797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7730e7-e664-4fe9-8779-0743f3ac0d27 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:00:44.611455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1404/2820] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:00:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:00:47.660642 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ceae-e4aa-4f4e-a7f6-f77544bfdbe6 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:00:47.662046 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-23d9ceae-e4aa-4f4e-a7f6-f77544bfdbe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:00:47.673877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9ceae-e4aa-4f4e-a7f6-f77544bfdbe6 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:00:47.678667 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711680-000c-437a-844f-7677f9d63fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:00:47.679286 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711680-000c-437a-844f-7677f9d63fab service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:00:47.679809 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711680-000c-437a-844f-7677f9d63fab service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:00:47.680657 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02711680-000c-437a-844f-7677f9d63fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:00:47.682497 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-02711680-000c-437a-844f-7677f9d63fab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:00:47.697399 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02711680-000c-437a-844f-7677f9d63fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:00:47.698750 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02711680-000c-437a-844f-7677f9d63fab service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:00:47.710121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1417/2821] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:00:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:00:54.608796 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=66 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:00:57.536146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63022f-e2fd-4c77-a081-9401707ac7e4 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:00:57.536853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63022f-e2fd-4c77-a081-9401707ac7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:00:57.536853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63022f-e2fd-4c77-a081-9401707ac7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:00:57.558095 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-3d63022f-e2fd-4c77-a081-9401707ac7e4 None None] MFA Rules not processed for user `3a878450743f4843a5e8cc04ca94184d`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:00:57.559302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3d63022f-e2fd-4c77-a081-9401707ac7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:00:57.566272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1405/2822] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:00:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:00:57.704945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:01:07.551320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:01:29.076402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711680-000c-437a-844f-7677f9d63fab service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:01:29.086038 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02711680-000c-437a-844f-7677f9d63fab service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:01:29.090258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeae2b-d5e2-4ea1-b269-502d53b59a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:01:29.090855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeae2b-d5e2-4ea1-b269-502d53b59a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:01:29.091130 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeae2b-d5e2-4ea1-b269-502d53b59a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:01:29.091402 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeae2b-d5e2-4ea1-b269-502d53b59a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:01:29.093143 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5faeae2b-d5e2-4ea1-b269-502d53b59a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:01:29.104175 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faeae2b-d5e2-4ea1-b269-502d53b59a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:01:29.105649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faeae2b-d5e2-4ea1-b269-502d53b59a04 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:01:29.114418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1418/2823] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:01:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:01:39.110634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:01:57.205183 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63022f-e2fd-4c77-a081-9401707ac7e4 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:01:57.206795 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3d63022f-e2fd-4c77-a081-9401707ac7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:01:57.226054 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d63022f-e2fd-4c77-a081-9401707ac7e4 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:01:57.232554 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159fa85-d2a8-4a33-bfe9-353bd4faa3d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:01:57.233190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159fa85-d2a8-4a33-bfe9-353bd4faa3d5 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:01:57.233467 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159fa85-d2a8-4a33-bfe9-353bd4faa3d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:01:57.233739 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159fa85-d2a8-4a33-bfe9-353bd4faa3d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:01:57.235939 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-5159fa85-d2a8-4a33-bfe9-353bd4faa3d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:01:57.249707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159fa85-d2a8-4a33-bfe9-353bd4faa3d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:01:57.251669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5159fa85-d2a8-4a33-bfe9-353bd4faa3d5 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:01:57.265363 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1406/2824] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:01:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:02:07.259410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=6 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:08.127030 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeae2b-d5e2-4ea1-b269-502d53b59a04 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:08.128608 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-5faeae2b-d5e2-4ea1-b269-502d53b59a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:08.197148 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeae2b-d5e2-4ea1-b269-502d53b59a04 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:08.201887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:08.202456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:08.202737 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:08.203012 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] PATH_INFO: `/v3/users/3a878450743f4843a5e8cc04ca94184d` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:08.204233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a878450743f4843a5e8cc04ca94184d)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:08.206216 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:08.418640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a878450743f4843a5e8cc04ca94184d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:08.426164 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a878450743f4843a5e8cc04ca94184d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:08.428449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a878450743f4843a5e8cc04ca94184d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:08.499871 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a878450743f4843a5e8cc04ca94184d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:08.500521 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-ba2a5f03-4b26-4b27-93fd-14ad4b8855e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a878450743f4843a5e8cc04ca94184d'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:08.519052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1419/2825] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:08 2022] DELETE /identity/v3/users/3a878450743f4843a5e8cc04ca94184d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:02:08.773604 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159fa85-d2a8-4a33-bfe9-353bd4faa3d5 service nova] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:08.785813 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159fa85-d2a8-4a33-bfe9-353bd4faa3d5 service nova] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:08.856151 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:08.856975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:08.857365 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:08.857742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] PATH_INFO: `/v3/projects/926837c28a3743deab8a4849571ecd19` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:08.858985 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=926837c28a3743deab8a4849571ecd19)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:08.861001 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:08.997144 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926837c28a3743deab8a4849571ecd19', 'request_id': 'req-5a14b921-e92a-4f2f-999c-4e38e03cf670'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:09.004135 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926837c28a3743deab8a4849571ecd19', 'request_id': 'req-5a14b921-e92a-4f2f-999c-4e38e03cf670'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:09.075104 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926837c28a3743deab8a4849571ecd19', 'request_id': 'req-5a14b921-e92a-4f2f-999c-4e38e03cf670'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:09.086348 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] The token cache is being invalidate because project 926837c28a3743deab8a4849571ecd19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:09.086640 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:09.087367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-5a14b921-e92a-4f2f-999c-4e38e03cf670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:09.089006 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1407/2826] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:08 2022] DELETE /identity/v3/projects/926837c28a3743deab8a4849571ecd19 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:09.094109 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf3a93-3c9b-4526-9bb4-f5f0969c3b7e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:09.094408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf3a93-3c9b-4526-9bb4-f5f0969c3b7e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:09.094689 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf3a93-3c9b-4526-9bb4-f5f0969c3b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:09.115177 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-6cdf3a93-3c9b-4526-9bb4-f5f0969c3b7e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:09.116411 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6cdf3a93-3c9b-4526-9bb4-f5f0969c3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:09.176945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1420/2827] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:09.185753 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54e52-7a21-4e8d-bf03-c6e9061b5655 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:09.186067 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54e52-7a21-4e8d-bf03-c6e9061b5655 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:09.186345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54e52-7a21-4e8d-bf03-c6e9061b5655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:09.206828 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-9be54e52-7a21-4e8d-bf03-c6e9061b5655 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:09.208032 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-9be54e52-7a21-4e8d-bf03-c6e9061b5655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:09.216168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1408/2828] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:09.220471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf3a93-3c9b-4526-9bb4-f5f0969c3b7e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:09.230537 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf3a93-3c9b-4526-9bb4-f5f0969c3b7e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:09.235206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7d53e-8c6b-4848-b0e8-315f4a1697bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:09.235832 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7d53e-8c6b-4848-b0e8-315f4a1697bb admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:09.236129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7d53e-8c6b-4848-b0e8-315f4a1697bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:09.236396 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7d53e-8c6b-4848-b0e8-315f4a1697bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:09.237084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7d53e-8c6b-4848-b0e8-315f4a1697bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:02:09.237382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7d53e-8c6b-4848-b0e8-315f4a1697bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:09.238996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7d53e-8c6b-4848-b0e8-315f4a1697bb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:09.251326 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1421/2829] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 22:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:02:09.255766 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be54e52-7a21-4e8d-bf03-c6e9061b5655 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:09.265072 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be54e52-7a21-4e8d-bf03-c6e9061b5655 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:09.269693 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef41d56-8a27-4844-a7b8-b87056e854cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:09.270279 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef41d56-8a27-4844-a7b8-b87056e854cb admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:09.270552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef41d56-8a27-4844-a7b8-b87056e854cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:09.270820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef41d56-8a27-4844-a7b8-b87056e854cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:09.271452 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef41d56-8a27-4844-a7b8-b87056e854cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:09.273383 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef41d56-8a27-4844-a7b8-b87056e854cb admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:09.378897 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1409/2830] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 22:02:09 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:09.383510 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7d53e-8c6b-4848-b0e8-315f4a1697bb admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:09.393695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7d53e-8c6b-4848-b0e8-315f4a1697bb admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:09.397728 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:09.451590 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d09e3-e797-4071-ad4b-d26eef2429d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:09.452203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d09e3-e797-4071-ad4b-d26eef2429d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:09.452516 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d09e3-e797-4071-ad4b-d26eef2429d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:09.452818 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d09e3-e797-4071-ad4b-d26eef2429d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:09.453432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d09e3-e797-4071-ad4b-d26eef2429d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:09.455695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d09e3-e797-4071-ad4b-d26eef2429d9 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:09.566960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1422/2831] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 22:02:09 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:09.571309 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef41d56-8a27-4844-a7b8-b87056e854cb admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:09.583412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef41d56-8a27-4844-a7b8-b87056e854cb admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:09.588867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35247f-948a-4a02-ad6d-c14675079971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:09.590474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35247f-948a-4a02-ad6d-c14675079971 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:09.590474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35247f-948a-4a02-ad6d-c14675079971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:09.590474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35247f-948a-4a02-ad6d-c14675079971 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:09.590776 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35247f-948a-4a02-ad6d-c14675079971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:09.592358 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35247f-948a-4a02-ad6d-c14675079971 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:09.603820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1410/2832] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:09.609063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d09e3-e797-4071-ad4b-d26eef2429d9 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:09.619470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d09e3-e797-4071-ad4b-d26eef2429d9 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:09.624941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8c425-2a43-4222-a64c-b16456a04afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:09.625555 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c425-2a43-4222-a64c-b16456a04afa admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:09.625833 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c425-2a43-4222-a64c-b16456a04afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:09.626204 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8c425-2a43-4222-a64c-b16456a04afa admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:09.626743 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c425-2a43-4222-a64c-b16456a04afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:09.628409 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8c425-2a43-4222-a64c-b16456a04afa admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:09.640387 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1423/2833] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:09.644114 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35247f-948a-4a02-ad6d-c14675079971 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:09.654936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35247f-948a-4a02-ad6d-c14675079971 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:09.659618 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c80d3c-8f48-4193-aee1-1936b19bd0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:09.660274 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c80d3c-8f48-4193-aee1-1936b19bd0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:09.660595 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c80d3c-8f48-4193-aee1-1936b19bd0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:09.660877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c80d3c-8f48-4193-aee1-1936b19bd0b8 admin admin] PATH_INFO: `/v3/projects/fd2aa669094b46b98206493668c99895/users/0d3eb13e12cc466cac39ab025fe760b3/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:09.677802 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c80d3c-8f48-4193-aee1-1936b19bd0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2aa669094b46b98206493668c99895, user_id=0d3eb13e12cc466cac39ab025fe760b3, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:09.680445 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c80d3c-8f48-4193-aee1-1936b19bd0b8 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:09.784073 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1411/2834] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:09 2022] PUT /identity/v3/projects/fd2aa669094b46b98206493668c99895/users/0d3eb13e12cc466cac39ab025fe760b3/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:09.795338 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1469e-825f-4c32-aa8d-b0e4c7f340fb None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:09.796255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1469e-825f-4c32-aa8d-b0e4c7f340fb None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:09.796255 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1469e-825f-4c32-aa8d-b0e4c7f340fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:09.825721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-43a1469e-825f-4c32-aa8d-b0e4c7f340fb None None] MFA Rules not processed for user `0d3eb13e12cc466cac39ab025fe760b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:09.826937 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-43a1469e-825f-4c32-aa8d-b0e4c7f340fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:09.896017 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1424/2835] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:09.908390 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c80d3c-8f48-4193-aee1-1936b19bd0b8 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:09.910164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-d7c80d3c-8f48-4193-aee1-1936b19bd0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:09.941341 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:09.985470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c80d3c-8f48-4193-aee1-1936b19bd0b8 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:09.991713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff518ce-e8dc-4413-b821-4a84bb700e06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8434659c6b164b97b5ac27fb7e4d6a26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:09.992321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff518ce-e8dc-4413-b821-4a84bb700e06 service nova] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:09.992636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff518ce-e8dc-4413-b821-4a84bb700e06 service nova] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:09.992914 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff518ce-e8dc-4413-b821-4a84bb700e06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:10.000790 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff518ce-e8dc-4413-b821-4a84bb700e06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:10.002410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff518ce-e8dc-4413-b821-4a84bb700e06 service nova] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:10.012760 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1412/2836] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:02:10.253957 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1469e-825f-4c32-aa8d-b0e4c7f340fb None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:10.320427 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1469e-825f-4c32-aa8d-b0e4c7f340fb None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:10.325676 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:10.326382 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:10.326663 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:10.326934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] PATH_INFO: `/v3/users/0d3eb13e12cc466cac39ab025fe760b3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:10.328084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d3eb13e12cc466cac39ab025fe760b3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:10.330031 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:10.346298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:10.571963 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d3eb13e12cc466cac39ab025fe760b3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:10.579167 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d3eb13e12cc466cac39ab025fe760b3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:10.580386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d3eb13e12cc466cac39ab025fe760b3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:10.660374 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d3eb13e12cc466cac39ab025fe760b3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:10.661033 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d3eb13e12cc466cac39ab025fe760b3'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:10.681541 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1425/2837] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:10 2022] DELETE /identity/v3/users/0d3eb13e12cc466cac39ab025fe760b3 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:10.686782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0475-02ea-439e-8a88-4475ce44954b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:10.687041 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0475-02ea-439e-8a88-4475ce44954b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:10.690014 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0475-02ea-439e-8a88-4475ce44954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:10.709121 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-6efb0475-02ea-439e-8a88-4475ce44954b None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:10.710401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6efb0475-02ea-439e-8a88-4475ce44954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:10.773463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1413/2838] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:02:10.783760 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:10.785891 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:10.847289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578991d-6793-450f-938b-29c08b08e81a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:10.850864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0469f5-53d9-4549-856c-ce025f04b488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:10.851469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0469f5-53d9-4549-856c-ce025f04b488 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:10.851742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0469f5-53d9-4549-856c-ce025f04b488 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:10.852013 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0469f5-53d9-4549-856c-ce025f04b488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:10.861892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0469f5-53d9-4549-856c-ce025f04b488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:10.863315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0469f5-53d9-4549-856c-ce025f04b488 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:10.873580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1426/2839] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:02:11.317174 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb0475-02ea-439e-8a88-4475ce44954b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:11.318821 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-6efb0475-02ea-439e-8a88-4475ce44954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:11.332397 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb0475-02ea-439e-8a88-4475ce44954b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:11.337854 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:11.338507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:11.338905 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:11.339189 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] PATH_INFO: `/v3/projects/fd2aa669094b46b98206493668c99895` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:11.341146 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2aa669094b46b98206493668c99895)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:11.343478 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:11.471990 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2aa669094b46b98206493668c99895', 'request_id': 'req-a47f873b-8935-49d0-a03e-45766ffd09a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:11.478707 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2aa669094b46b98206493668c99895', 'request_id': 'req-a47f873b-8935-49d0-a03e-45766ffd09a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:11.591476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2aa669094b46b98206493668c99895', 'request_id': 'req-a47f873b-8935-49d0-a03e-45766ffd09a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:11.604733 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] The token cache is being invalidate because project fd2aa669094b46b98206493668c99895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:11.604956 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:11.605617 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a47f873b-8935-49d0-a03e-45766ffd09a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:11.607123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1414/2840] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:11 2022] DELETE /identity/v3/projects/fd2aa669094b46b98206493668c99895 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:11.612501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718f7b-81d7-4da6-9d8c-627659906771 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:11.613021 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718f7b-81d7-4da6-9d8c-627659906771 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:11.613133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9718f7b-81d7-4da6-9d8c-627659906771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:11.638604 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f9718f7b-81d7-4da6-9d8c-627659906771 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:11.639822 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f9718f7b-81d7-4da6-9d8c-627659906771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:11.704260 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1427/2841] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:11.712621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02895588-878d-4b4e-88ca-99fe35766cbc None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:11.712903 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02895588-878d-4b4e-88ca-99fe35766cbc None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:11.713173 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02895588-878d-4b4e-88ca-99fe35766cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:11.733639 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-02895588-878d-4b4e-88ca-99fe35766cbc None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:11.734860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-02895588-878d-4b4e-88ca-99fe35766cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:11.743025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1415/2842] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:11.748631 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718f7b-81d7-4da6-9d8c-627659906771 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:11.765239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9718f7b-81d7-4da6-9d8c-627659906771 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:11.771259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a39325-3ba6-46a1-914e-a4aeb20edffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:11.771885 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a39325-3ba6-46a1-914e-a4aeb20edffa admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:11.772166 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a39325-3ba6-46a1-914e-a4aeb20edffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:11.772530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a39325-3ba6-46a1-914e-a4aeb20edffa admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:11.773202 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a39325-3ba6-46a1-914e-a4aeb20edffa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:02:11.773506 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a39325-3ba6-46a1-914e-a4aeb20edffa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:11.775139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a39325-3ba6-46a1-914e-a4aeb20edffa admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:11.787725 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1428/2843] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 22:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:02:11.792682 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02895588-878d-4b4e-88ca-99fe35766cbc None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:11.803226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02895588-878d-4b4e-88ca-99fe35766cbc None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:11.808889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419279-8e79-46b6-b3f3-7da0055aa909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:11.809544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419279-8e79-46b6-b3f3-7da0055aa909 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:11.809820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419279-8e79-46b6-b3f3-7da0055aa909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:11.810090 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39419279-8e79-46b6-b3f3-7da0055aa909 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:11.810730 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39419279-8e79-46b6-b3f3-7da0055aa909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:11.812656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39419279-8e79-46b6-b3f3-7da0055aa909 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:11.956242 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1416/2844] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 22:02:11 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:11.960437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a39325-3ba6-46a1-914e-a4aeb20edffa admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:11.973960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a39325-3ba6-46a1-914e-a4aeb20edffa admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:11.996897 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:12.034009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103a839-f980-451f-a7b9-ed4be1a471ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:12.034624 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103a839-f980-451f-a7b9-ed4be1a471ca admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:12.034903 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103a839-f980-451f-a7b9-ed4be1a471ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:12.035176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103a839-f980-451f-a7b9-ed4be1a471ca admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:12.035935 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103a839-f980-451f-a7b9-ed4be1a471ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:12.038470 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103a839-f980-451f-a7b9-ed4be1a471ca admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:12.170593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1429/2845] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 22:02:11 2022] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:02:12.174764 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419279-8e79-46b6-b3f3-7da0055aa909 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:12.186420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39419279-8e79-46b6-b3f3-7da0055aa909 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:12.191625 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62975c1-bdc9-4393-9a0c-ae86f3ee4890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:12.192257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62975c1-bdc9-4393-9a0c-ae86f3ee4890 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:12.192587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62975c1-bdc9-4393-9a0c-ae86f3ee4890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:12.192861 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62975c1-bdc9-4393-9a0c-ae86f3ee4890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:12.193515 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62975c1-bdc9-4393-9a0c-ae86f3ee4890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:12.195187 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62975c1-bdc9-4393-9a0c-ae86f3ee4890 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:12.196797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:12.206843 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1417/2846] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:12.211845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103a839-f980-451f-a7b9-ed4be1a471ca admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:12.225666 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103a839-f980-451f-a7b9-ed4be1a471ca admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:12.231006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cefd53-03d3-4f95-9268-b6ac782ee793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:12.236793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cefd53-03d3-4f95-9268-b6ac782ee793 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:12.236793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cefd53-03d3-4f95-9268-b6ac782ee793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:12.236793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cefd53-03d3-4f95-9268-b6ac782ee793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:12.236793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cefd53-03d3-4f95-9268-b6ac782ee793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:12.236793 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cefd53-03d3-4f95-9268-b6ac782ee793 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:12.246869 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1430/2847] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:12.251498 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62975c1-bdc9-4393-9a0c-ae86f3ee4890 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:12.262803 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62975c1-bdc9-4393-9a0c-ae86f3ee4890 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:12.267782 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c0a14-cd1e-4d2a-9ab7-0a2d28014672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:12.268451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c0a14-cd1e-4d2a-9ab7-0a2d28014672 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:12.268762 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c0a14-cd1e-4d2a-9ab7-0a2d28014672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:12.269097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c0a14-cd1e-4d2a-9ab7-0a2d28014672 admin admin] PATH_INFO: `/v3/projects/2f7cd8a329784fe4be61c2999811052a/users/71dd52032be54209864626590aa806a8/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:12.285062 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c0a14-cd1e-4d2a-9ab7-0a2d28014672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7cd8a329784fe4be61c2999811052a, user_id=71dd52032be54209864626590aa806a8, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:12.287808 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c0a14-cd1e-4d2a-9ab7-0a2d28014672 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:12.380421 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1418/2848] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:12 2022] PUT /identity/v3/projects/2f7cd8a329784fe4be61c2999811052a/users/71dd52032be54209864626590aa806a8/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:12.398085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341c903-3622-43d4-b4f8-2163431d1f99 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:12.398467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341c903-3622-43d4-b4f8-2163431d1f99 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:12.398941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341c903-3622-43d4-b4f8-2163431d1f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:12.431580 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f341c903-3622-43d4-b4f8-2163431d1f99 None None] MFA Rules not processed for user `71dd52032be54209864626590aa806a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:12.433099 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f341c903-3622-43d4-b4f8-2163431d1f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:12.502355 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1431/2849] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:12.507229 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c0a14-cd1e-4d2a-9ab7-0a2d28014672 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:12.570455 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c0a14-cd1e-4d2a-9ab7-0a2d28014672 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:12.575908 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bc593-0893-4bd9-99b0-d78ff15bd348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:12.576671 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bc593-0893-4bd9-99b0-d78ff15bd348 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:12.577063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bc593-0893-4bd9-99b0-d78ff15bd348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:12.577429 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66bc593-0893-4bd9-99b0-d78ff15bd348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:12.578181 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bc593-0893-4bd9-99b0-d78ff15bd348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:12.580197 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66bc593-0893-4bd9-99b0-d78ff15bd348 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:12.705667 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1419/2850] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 22:02:12 2022] POST /identity/v3/projects => generated 369 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:12.709828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341c903-3622-43d4-b4f8-2163431d1f99 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:12.721261 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341c903-3622-43d4-b4f8-2163431d1f99 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:12.780839 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b1f3f-3ff1-44e8-a51f-56bbe1d885ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:12.781481 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b1f3f-3ff1-44e8-a51f-56bbe1d885ec admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:12.781784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b1f3f-3ff1-44e8-a51f-56bbe1d885ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:12.782020 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b1f3f-3ff1-44e8-a51f-56bbe1d885ec admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:12.782671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b1f3f-3ff1-44e8-a51f-56bbe1d885ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:12.784662 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b1f3f-3ff1-44e8-a51f-56bbe1d885ec admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:12.867065 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1432/2851] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 22:02:12 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:12.871396 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bc593-0893-4bd9-99b0-d78ff15bd348 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:12.883063 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66bc593-0893-4bd9-99b0-d78ff15bd348 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:12.888649 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883042c8-2006-4805-9463-2f11d70ed99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:12.891577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883042c8-2006-4805-9463-2f11d70ed99f admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:12.891577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883042c8-2006-4805-9463-2f11d70ed99f admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:12.891577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883042c8-2006-4805-9463-2f11d70ed99f admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:12.891577 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883042c8-2006-4805-9463-2f11d70ed99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:12.892107 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883042c8-2006-4805-9463-2f11d70ed99f admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:12.904176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1420/2852] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:02:12.908651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b1f3f-3ff1-44e8-a51f-56bbe1d885ec admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:12.919075 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b1f3f-3ff1-44e8-a51f-56bbe1d885ec admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:12.925308 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a4260-13b8-45da-9ed5-166c201bd288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:12.925978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a4260-13b8-45da-9ed5-166c201bd288 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:12.926258 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a4260-13b8-45da-9ed5-166c201bd288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:12.926529 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51a4260-13b8-45da-9ed5-166c201bd288 admin admin] PATH_INFO: `/v3/projects/9bc25c7990f74207bd328071bf1d2430/users/f64b462ea3ed4e2f8ef2ae470c83b4cd/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:12.942870 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a4260-13b8-45da-9ed5-166c201bd288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc25c7990f74207bd328071bf1d2430, user_id=f64b462ea3ed4e2f8ef2ae470c83b4cd, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:12.945614 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51a4260-13b8-45da-9ed5-166c201bd288 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:13.055828 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:13.062496 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1433/2853] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:12 2022] PUT /identity/v3/projects/9bc25c7990f74207bd328071bf1d2430/users/f64b462ea3ed4e2f8ef2ae470c83b4cd/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:13.068793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883042c8-2006-4805-9463-2f11d70ed99f admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:13.080017 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883042c8-2006-4805-9463-2f11d70ed99f admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:13.155489 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af62d07-ea54-436f-9b5f-65a2d7e70223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:13.156138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af62d07-ea54-436f-9b5f-65a2d7e70223 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:13.156420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af62d07-ea54-436f-9b5f-65a2d7e70223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:13.160792 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af62d07-ea54-436f-9b5f-65a2d7e70223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:13.160792 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af62d07-ea54-436f-9b5f-65a2d7e70223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:13.160792 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af62d07-ea54-436f-9b5f-65a2d7e70223 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:13.169656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1421/2854] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:13.173952 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a4260-13b8-45da-9ed5-166c201bd288 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:13.186279 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51a4260-13b8-45da-9ed5-166c201bd288 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:13.191154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9c28c-2f94-47a1-9f18-b79064cd851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:13.191864 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9c28c-2f94-47a1-9f18-b79064cd851b admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:13.192144 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9c28c-2f94-47a1-9f18-b79064cd851b admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:13.192421 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9c28c-2f94-47a1-9f18-b79064cd851b admin admin] PATH_INFO: `/v3/projects/9bc25c7990f74207bd328071bf1d2430/users/f64b462ea3ed4e2f8ef2ae470c83b4cd/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:13.194413 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9c28c-2f94-47a1-9f18-b79064cd851b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc25c7990f74207bd328071bf1d2430, user_id=f64b462ea3ed4e2f8ef2ae470c83b4cd, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:13.197812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9c28c-2f94-47a1-9f18-b79064cd851b admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:13.209445 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1434/2855] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:13 2022] PUT /identity/v3/projects/9bc25c7990f74207bd328071bf1d2430/users/f64b462ea3ed4e2f8ef2ae470c83b4cd/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:13.272744 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cc6dd-fbcc-4abf-b21f-857626f65349 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:13.273054 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cc6dd-fbcc-4abf-b21f-857626f65349 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:13.273319 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847cc6dd-fbcc-4abf-b21f-857626f65349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:13.302924 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-847cc6dd-fbcc-4abf-b21f-857626f65349 None None] MFA Rules not processed for user `f64b462ea3ed4e2f8ef2ae470c83b4cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:13.304160 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-847cc6dd-fbcc-4abf-b21f-857626f65349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:13.340457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:13.383756 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1422/2856] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:13.395958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9c28c-2f94-47a1-9f18-b79064cd851b admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:13.398218 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-6cd9c28c-2f94-47a1-9f18-b79064cd851b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:13.462855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9c28c-2f94-47a1-9f18-b79064cd851b admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:13.466669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1ea5e-e667-4b2e-941c-d6fc4836c3ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:13.467282 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ea5e-e667-4b2e-941c-d6fc4836c3ea service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:13.467564 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ea5e-e667-4b2e-941c-d6fc4836c3ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:13.467838 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ea5e-e667-4b2e-941c-d6fc4836c3ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:13.477336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1ea5e-e667-4b2e-941c-d6fc4836c3ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:13.479277 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1ea5e-e667-4b2e-941c-d6fc4836c3ea service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:13.489128 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1435/2857] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:02:13.629963 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cc6dd-fbcc-4abf-b21f-857626f65349 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:13.631398 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-847cc6dd-fbcc-4abf-b21f-857626f65349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:13.643656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847cc6dd-fbcc-4abf-b21f-857626f65349 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:13.647403 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb69e4-3068-451d-a121-338e950a64db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:13.648024 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb69e4-3068-451d-a121-338e950a64db service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:13.648361 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb69e4-3068-451d-a121-338e950a64db service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:13.648818 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb69e4-3068-451d-a121-338e950a64db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:13.713311 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb69e4-3068-451d-a121-338e950a64db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:13.714893 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb69e4-3068-451d-a121-338e950a64db service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:13.724729 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1423/2858] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:02:19.280288 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1ea5e-e667-4b2e-941c-d6fc4836c3ea service cinder] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:19.348210 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1ea5e-e667-4b2e-941c-d6fc4836c3ea service cinder] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:19.353001 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:19.353685 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:19.353988 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:19.354259 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] PATH_INFO: `/v3/users/71dd52032be54209864626590aa806a8` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:19.355456 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=71dd52032be54209864626590aa806a8)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:19.357436 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:20.170784 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71dd52032be54209864626590aa806a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:20.181581 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71dd52032be54209864626590aa806a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:20.182346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71dd52032be54209864626590aa806a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:20.392332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71dd52032be54209864626590aa806a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:20.393039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71dd52032be54209864626590aa806a8'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:20.412434 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1436/2859] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:19 2022] DELETE /identity/v3/users/71dd52032be54209864626590aa806a8 => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:20.417669 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335ea5-0215-4483-9f5b-fa17b2715712 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:20.418259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335ea5-0215-4483-9f5b-fa17b2715712 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:20.418259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da335ea5-0215-4483-9f5b-fa17b2715712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:20.443212 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-da335ea5-0215-4483-9f5b-fa17b2715712 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:20.444355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-da335ea5-0215-4483-9f5b-fa17b2715712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:20.514313 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1424/2860] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:20.525368 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:20.527140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:20.538831 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:20.593129 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc0c6f-c9a6-404a-b205-28d9c055ddfc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:20.596852 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30de98-8a29-45de-a131-45ee467ebc43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:20.597471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30de98-8a29-45de-a131-45ee467ebc43 service neutron] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:20.597748 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30de98-8a29-45de-a131-45ee467ebc43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:20.598023 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30de98-8a29-45de-a131-45ee467ebc43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:20.608356 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30de98-8a29-45de-a131-45ee467ebc43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:20.613634 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30de98-8a29-45de-a131-45ee467ebc43 service neutron] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:20.621295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1437/2861] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:02:21.056935 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335ea5-0215-4483-9f5b-fa17b2715712 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:21.058812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-da335ea5-0215-4483-9f5b-fa17b2715712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:21.077190 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da335ea5-0215-4483-9f5b-fa17b2715712 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:21.082428 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:21.083088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:21.083367 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:21.083636 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] PATH_INFO: `/v3/projects/2f7cd8a329784fe4be61c2999811052a` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:21.085661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f7cd8a329784fe4be61c2999811052a)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:21.086817 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:21.214936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f7cd8a329784fe4be61c2999811052a', 'request_id': 'req-3f197a9c-e0bc-4d74-81c6-f800b70f6833'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:21.224420 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f7cd8a329784fe4be61c2999811052a', 'request_id': 'req-3f197a9c-e0bc-4d74-81c6-f800b70f6833'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:21.361098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f7cd8a329784fe4be61c2999811052a', 'request_id': 'req-3f197a9c-e0bc-4d74-81c6-f800b70f6833'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:21.362677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:21.373680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] The token cache is being invalidate because project 2f7cd8a329784fe4be61c2999811052a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:21.373976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:21.374687 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:21.376201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1425/2862] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:21 2022] DELETE /identity/v3/projects/2f7cd8a329784fe4be61c2999811052a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:21.380350 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30de98-8a29-45de-a131-45ee467ebc43 service neutron] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:21.390085 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30de98-8a29-45de-a131-45ee467ebc43 service neutron] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:21.480508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:21.481617 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:21.481977 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:21.482389 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] PATH_INFO: `/v3/users/f64b462ea3ed4e2f8ef2ae470c83b4cd` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:21.484741 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f64b462ea3ed4e2f8ef2ae470c83b4cd)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:21.488696 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:21.861442 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f64b462ea3ed4e2f8ef2ae470c83b4cd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:21.869154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f64b462ea3ed4e2f8ef2ae470c83b4cd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:21.872133 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f64b462ea3ed4e2f8ef2ae470c83b4cd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:21.972300 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f64b462ea3ed4e2f8ef2ae470c83b4cd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:21.973000 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-0877b1d4-e956-4c4c-a60d-cf27558295cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f64b462ea3ed4e2f8ef2ae470c83b4cd'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:21.996889 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1438/2863] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:21 2022] DELETE /identity/v3/users/f64b462ea3ed4e2f8ef2ae470c83b4cd => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:22.451097 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:22.452784 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:22.467030 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f197a9c-e0bc-4d74-81c6-f800b70f6833 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:22.527168 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:22.528266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:22.528266 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:22.528463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] PATH_INFO: `/v3/projects/9bc25c7990f74207bd328071bf1d2430` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:22.529526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc25c7990f74207bd328071bf1d2430)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:22.531443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:22.653524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc25c7990f74207bd328071bf1d2430', 'request_id': 'req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:22.663832 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc25c7990f74207bd328071bf1d2430', 'request_id': 'req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:22.778098 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc25c7990f74207bd328071bf1d2430', 'request_id': 'req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:22.790520 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] The token cache is being invalidate because project 9bc25c7990f74207bd328071bf1d2430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81953) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:22.790922 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:22.791628 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-feb51cbb-f5e5-4a4b-97f9-a37fe9875f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:22.793225 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1426/2864] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:22 2022] DELETE /identity/v3/projects/9bc25c7990f74207bd328071bf1d2430 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:22.798219 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ce30-09f2-45b5-8a0b-6ae9df2b4d22 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:22.798791 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ce30-09f2-45b5-8a0b-6ae9df2b4d22 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:22.798791 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41ce30-09f2-45b5-8a0b-6ae9df2b4d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:22.820053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-7f41ce30-09f2-45b5-8a0b-6ae9df2b4d22 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:22.821295 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7f41ce30-09f2-45b5-8a0b-6ae9df2b4d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:22.846948 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:22.906669 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1439/2865] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 22:02:22.914474 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31fd5-198a-4afe-aa18-3e1bcba64a4a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:22.914752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31fd5-198a-4afe-aa18-3e1bcba64a4a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:22.915056 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31fd5-198a-4afe-aa18-3e1bcba64a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:22.938539 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-09f31fd5-198a-4afe-aa18-3e1bcba64a4a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:22.940566 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-09f31fd5-198a-4afe-aa18-3e1bcba64a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:22.949234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1427/2866] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:22.953996 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41ce30-09f2-45b5-8a0b-6ae9df2b4d22 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:22.965156 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41ce30-09f2-45b5-8a0b-6ae9df2b4d22 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:22.969930 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522789d-ff66-4cd3-a03c-051428a805d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:22.970547 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522789d-ff66-4cd3-a03c-051428a805d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:22.970825 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522789d-ff66-4cd3-a03c-051428a805d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:22.971098 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522789d-ff66-4cd3-a03c-051428a805d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:22.971877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522789d-ff66-4cd3-a03c-051428a805d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81954) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:02:22.972198 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522789d-ff66-4cd3-a03c-051428a805d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:22.973840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522789d-ff66-4cd3-a03c-051428a805d8 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:22.987146 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1440/2867] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 22:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:02:22.992312 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31fd5-198a-4afe-aa18-3e1bcba64a4a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:23.004981 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31fd5-198a-4afe-aa18-3e1bcba64a4a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:23.010043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8419b2-7855-4b61-8ebb-52425b949eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:23.010700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8419b2-7855-4b61-8ebb-52425b949eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:23.011003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8419b2-7855-4b61-8ebb-52425b949eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:23.011269 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8419b2-7855-4b61-8ebb-52425b949eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:23.011860 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8419b2-7855-4b61-8ebb-52425b949eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:23.013862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8419b2-7855-4b61-8ebb-52425b949eb1 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:23.102949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1428/2868] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 22:02:22 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:23.107556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522789d-ff66-4cd3-a03c-051428a805d8 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:23.118575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522789d-ff66-4cd3-a03c-051428a805d8 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:23.177779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35b160-0488-44df-86c6-0769d7978e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:23.178441 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35b160-0488-44df-86c6-0769d7978e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:23.178723 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35b160-0488-44df-86c6-0769d7978e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:23.178999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d35b160-0488-44df-86c6-0769d7978e55 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:23.179647 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35b160-0488-44df-86c6-0769d7978e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:23.181734 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d35b160-0488-44df-86c6-0769d7978e55 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:23.289892 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1441/2869] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 22:02:23 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:23.294713 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8419b2-7855-4b61-8ebb-52425b949eb1 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:23.308992 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8419b2-7855-4b61-8ebb-52425b949eb1 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:23.313850 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59024a2-5df9-4999-b1e8-354f0f7eedbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:23.314465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59024a2-5df9-4999-b1e8-354f0f7eedbb admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:23.314742 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59024a2-5df9-4999-b1e8-354f0f7eedbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:23.316246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59024a2-5df9-4999-b1e8-354f0f7eedbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:23.316246 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59024a2-5df9-4999-b1e8-354f0f7eedbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:23.317609 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59024a2-5df9-4999-b1e8-354f0f7eedbb admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:23.330209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1429/2870] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:23.334724 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35b160-0488-44df-86c6-0769d7978e55 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:23.347315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d35b160-0488-44df-86c6-0769d7978e55 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:23.352335 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51634ebd-193a-4538-bd7f-379838ed895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:23.353054 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51634ebd-193a-4538-bd7f-379838ed895d admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:23.353285 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51634ebd-193a-4538-bd7f-379838ed895d admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:23.353562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51634ebd-193a-4538-bd7f-379838ed895d admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:23.354209 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51634ebd-193a-4538-bd7f-379838ed895d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:23.355814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51634ebd-193a-4538-bd7f-379838ed895d admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:23.367050 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1442/2871] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:23.371416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59024a2-5df9-4999-b1e8-354f0f7eedbb admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:23.383068 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59024a2-5df9-4999-b1e8-354f0f7eedbb admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:23.388789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5134b9-8245-4691-8fc7-e567b3e94884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:23.389465 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5134b9-8245-4691-8fc7-e567b3e94884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:23.389747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5134b9-8245-4691-8fc7-e567b3e94884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:23.390025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5134b9-8245-4691-8fc7-e567b3e94884 admin admin] PATH_INFO: `/v3/projects/2a157b9618b94dcba633095dda224e89/users/7d86436230464be8995453e0adc91be0/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:23.406999 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5134b9-8245-4691-8fc7-e567b3e94884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a157b9618b94dcba633095dda224e89, user_id=7d86436230464be8995453e0adc91be0, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:23.409743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5134b9-8245-4691-8fc7-e567b3e94884 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:23.514615 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1430/2872] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:23 2022] PUT /identity/v3/projects/2a157b9618b94dcba633095dda224e89/users/7d86436230464be8995453e0adc91be0/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:23.527297 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25525b6e-bea2-4f4e-9733-0f920d0e228d None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:23.527587 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25525b6e-bea2-4f4e-9733-0f920d0e228d None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:23.527835 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25525b6e-bea2-4f4e-9733-0f920d0e228d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:23.557346 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-25525b6e-bea2-4f4e-9733-0f920d0e228d None None] MFA Rules not processed for user `7d86436230464be8995453e0adc91be0`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:23.558834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-25525b6e-bea2-4f4e-9733-0f920d0e228d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:23.660609 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1443/2873] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:23.665069 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5134b9-8245-4691-8fc7-e567b3e94884 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:23.685885 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:23.738751 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5134b9-8245-4691-8fc7-e567b3e94884 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:23.744888 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e0e6f-c4e8-4709-9d1d-d9826d27078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:23.745511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e0e6f-c4e8-4709-9d1d-d9826d27078b admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:23.745793 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e0e6f-c4e8-4709-9d1d-d9826d27078b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:23.746058 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e0e6f-c4e8-4709-9d1d-d9826d27078b admin admin] PATH_INFO: `/v3/projects` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:23.746710 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e0e6f-c4e8-4709-9d1d-d9826d27078b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:23.748663 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e0e6f-c4e8-4709-9d1d-d9826d27078b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:23.842440 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1431/2874] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 22:02:23 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:02:23.846856 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25525b6e-bea2-4f4e-9733-0f920d0e228d None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:23.858606 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25525b6e-bea2-4f4e-9733-0f920d0e228d None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:23.880623 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:23.919860 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ea60-d3c1-47e7-b7c7-27f19c83afc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:23.920380 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ea60-d3c1-47e7-b7c7-27f19c83afc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:23.920682 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ea60-d3c1-47e7-b7c7-27f19c83afc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:23.920950 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ea60-d3c1-47e7-b7c7-27f19c83afc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:23.921577 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04ea60-d3c1-47e7-b7c7-27f19c83afc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:23.923461 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04ea60-d3c1-47e7-b7c7-27f19c83afc1 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:24.044251 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1444/2875] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 22:02:23 2022] POST /identity/v3/users => generated 300 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:24.048660 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e0e6f-c4e8-4709-9d1d-d9826d27078b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:24.061933 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e0e6f-c4e8-4709-9d1d-d9826d27078b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:24.066936 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cebcf-7915-4a49-a6cf-45ccb6867e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:24.067544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cebcf-7915-4a49-a6cf-45ccb6867e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:24.067819 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cebcf-7915-4a49-a6cf-45ccb6867e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:24.068086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cebcf-7915-4a49-a6cf-45ccb6867e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:24.068777 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cebcf-7915-4a49-a6cf-45ccb6867e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:24.070404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cebcf-7915-4a49-a6cf-45ccb6867e05 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:24.082389 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1432/2876] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:24.087048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ea60-d3c1-47e7-b7c7-27f19c83afc1 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:24.101391 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ea60-d3c1-47e7-b7c7-27f19c83afc1 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:24.108239 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ee163-582e-4cc6-a134-4100f358b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:24.109223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ee163-582e-4cc6-a134-4100f358b1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:24.109568 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ee163-582e-4cc6-a134-4100f358b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:24.109993 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ee163-582e-4cc6-a134-4100f358b1bc admin admin] PATH_INFO: `/v3/projects/6a8ad26942194c7c9240f31c1889bec8/users/4cbeb7eb73484e46a276fa03350b220f/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:24.128241 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ee163-582e-4cc6-a134-4100f358b1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8ad26942194c7c9240f31c1889bec8, user_id=4cbeb7eb73484e46a276fa03350b220f, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:24.130999 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ee163-582e-4cc6-a134-4100f358b1bc admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:24.244602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1445/2877] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:24 2022] PUT /identity/v3/projects/6a8ad26942194c7c9240f31c1889bec8/users/4cbeb7eb73484e46a276fa03350b220f/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:24.248970 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cebcf-7915-4a49-a6cf-45ccb6867e05 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:24.259370 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cebcf-7915-4a49-a6cf-45ccb6867e05 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:24.319394 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039d325-383e-4bc6-8b4c-386c022090ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:24.320012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039d325-383e-4bc6-8b4c-386c022090ad admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:24.320290 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039d325-383e-4bc6-8b4c-386c022090ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:24.320599 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039d325-383e-4bc6-8b4c-386c022090ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:24.321323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039d325-383e-4bc6-8b4c-386c022090ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:24.322867 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039d325-383e-4bc6-8b4c-386c022090ad admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:24.333838 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1433/2878] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:02:24.338845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ee163-582e-4cc6-a134-4100f358b1bc admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:24.350086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ee163-582e-4cc6-a134-4100f358b1bc admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:24.357668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec540f25-7e3c-40c8-902f-4e362549b724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:24.358351 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec540f25-7e3c-40c8-902f-4e362549b724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:24.358637 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec540f25-7e3c-40c8-902f-4e362549b724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:24.358915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec540f25-7e3c-40c8-902f-4e362549b724 admin admin] PATH_INFO: `/v3/projects/6a8ad26942194c7c9240f31c1889bec8/users/4cbeb7eb73484e46a276fa03350b220f/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:24.360912 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec540f25-7e3c-40c8-902f-4e362549b724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8ad26942194c7c9240f31c1889bec8, user_id=4cbeb7eb73484e46a276fa03350b220f, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:24.363552 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec540f25-7e3c-40c8-902f-4e362549b724 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:24.375182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1446/2879] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:24 2022] PUT /identity/v3/projects/6a8ad26942194c7c9240f31c1889bec8/users/4cbeb7eb73484e46a276fa03350b220f/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:24.385950 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a890-1a4a-45c0-a1b5-0ed7f14dbf5b None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:24.386233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a890-1a4a-45c0-a1b5-0ed7f14dbf5b None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:24.386513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8a890-1a4a-45c0-a1b5-0ed7f14dbf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:24.417379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-4da8a890-1a4a-45c0-a1b5-0ed7f14dbf5b None None] MFA Rules not processed for user `4cbeb7eb73484e46a276fa03350b220f`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:24.418600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4da8a890-1a4a-45c0-a1b5-0ed7f14dbf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:24.494984 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1434/2880] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:24.510314 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec540f25-7e3c-40c8-902f-4e362549b724 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:24.512262 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-ec540f25-7e3c-40c8-902f-4e362549b724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:24.576362 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec540f25-7e3c-40c8-902f-4e362549b724 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:24.580236 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee45821-6c55-4ab2-920f-05c2042e09e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:24.580901 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee45821-6c55-4ab2-920f-05c2042e09e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:24.581186 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee45821-6c55-4ab2-920f-05c2042e09e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:24.581464 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee45821-6c55-4ab2-920f-05c2042e09e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:24.592039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee45821-6c55-4ab2-920f-05c2042e09e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:24.593530 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee45821-6c55-4ab2-920f-05c2042e09e3 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:24.604448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1447/2881] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:02:24.693552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a890-1a4a-45c0-a1b5-0ed7f14dbf5b None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:24.707902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:24.759531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8a890-1a4a-45c0-a1b5-0ed7f14dbf5b None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:24.764270 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:24.764959 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:24.765237 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:24.765511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] PATH_INFO: `/v3/users/7d86436230464be8995453e0adc91be0` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:24.766658 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d86436230464be8995453e0adc91be0)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:24.768692 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:24.986376 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d86436230464be8995453e0adc91be0'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:24.993336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d86436230464be8995453e0adc91be0'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:24.994637 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d86436230464be8995453e0adc91be0'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:25.063844 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d86436230464be8995453e0adc91be0'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:25.078858 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d86436230464be8995453e0adc91be0'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:25.085315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1435/2882] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:24 2022] DELETE /identity/v3/users/7d86436230464be8995453e0adc91be0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:25.090467 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6368af-b876-4e04-83ec-b459801335e5 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:25.090984 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6368af-b876-4e04-83ec-b459801335e5 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:25.091107 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6368af-b876-4e04-83ec-b459801335e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:25.112736 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-2c6368af-b876-4e04-83ec-b459801335e5 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:25.113972 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2c6368af-b876-4e04-83ec-b459801335e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:25.173524 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1448/2883] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:25.184393 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:25.185961 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:25.247788 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dba11a-9490-4e5f-a0b5-7ec1a58c5d94 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:25.251665 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f0c5c-ae79-47cd-a1fe-9acf485922f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:25.252272 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f0c5c-ae79-47cd-a1fe-9acf485922f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:25.252587 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f0c5c-ae79-47cd-a1fe-9acf485922f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:25.252855 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f0c5c-ae79-47cd-a1fe-9acf485922f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:25.262511 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f0c5c-ae79-47cd-a1fe-9acf485922f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:25.263948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f0c5c-ae79-47cd-a1fe-9acf485922f8 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:25.274345 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1436/2884] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:02:25.766432 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6368af-b876-4e04-83ec-b459801335e5 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:25.768319 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-2c6368af-b876-4e04-83ec-b459801335e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:25.784330 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6368af-b876-4e04-83ec-b459801335e5 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:25.789905 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:25.790703 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:25.791553 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:25.792348 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] PATH_INFO: `/v3/projects/2a157b9618b94dcba633095dda224e89` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:25.793779 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a157b9618b94dcba633095dda224e89)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:25.796812 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:25.814960 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:25.920142 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a157b9618b94dcba633095dda224e89', 'request_id': 'req-854f2fa7-c424-48f1-ac1d-5a5ca5079409'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:25.925570 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a157b9618b94dcba633095dda224e89', 'request_id': 'req-854f2fa7-c424-48f1-ac1d-5a5ca5079409'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:25.998597 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a157b9618b94dcba633095dda224e89', 'request_id': 'req-854f2fa7-c424-48f1-ac1d-5a5ca5079409'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:26.016668 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] The token cache is being invalidate because project 2a157b9618b94dcba633095dda224e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:26.016964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:26.017633 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:26.019152 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1449/2885] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:25 2022] DELETE /identity/v3/projects/2a157b9618b94dcba633095dda224e89 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:26.023683 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f0c5c-ae79-47cd-a1fe-9acf485922f8 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:26.033797 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f0c5c-ae79-47cd-a1fe-9acf485922f8 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:26.066147 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:26.095008 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:26.099031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:26.099031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:26.099031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] PATH_INFO: `/v3/users/4cbeb7eb73484e46a276fa03350b220f` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:26.099031 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbeb7eb73484e46a276fa03350b220f)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:26.099551 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:26.360162 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbeb7eb73484e46a276fa03350b220f'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:26.367531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbeb7eb73484e46a276fa03350b220f'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:26.368245 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbeb7eb73484e46a276fa03350b220f'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:26.454602 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbeb7eb73484e46a276fa03350b220f'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:26.468012 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-fd9c2e9e-eda9-442b-bf3d-3ce04292dda5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbeb7eb73484e46a276fa03350b220f'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:26.474003 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1437/2886] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:26 2022] DELETE /identity/v3/users/4cbeb7eb73484e46a276fa03350b220f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:26.996822 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:26.998362 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:27.012593 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f2fa7-c424-48f1-ac1d-5a5ca5079409 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:27.091048 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:27.091695 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:27.091979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:27.092252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] PATH_INFO: `/v3/projects/6a8ad26942194c7c9240f31c1889bec8` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:27.093438 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8ad26942194c7c9240f31c1889bec8)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:27.095425 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:27.209062 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8ad26942194c7c9240f31c1889bec8', 'request_id': 'req-bb44c15c-e016-4990-a45d-9dcca74ca332'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:27.215602 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8ad26942194c7c9240f31c1889bec8', 'request_id': 'req-bb44c15c-e016-4990-a45d-9dcca74ca332'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:27.294797 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8ad26942194c7c9240f31c1889bec8', 'request_id': 'req-bb44c15c-e016-4990-a45d-9dcca74ca332'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:27.307380 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] The token cache is being invalidate because project 6a8ad26942194c7c9240f31c1889bec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:27.307664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:27.309913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-bb44c15c-e016-4990-a45d-9dcca74ca332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:27.310086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1450/2887] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:26 2022] DELETE /identity/v3/projects/6a8ad26942194c7c9240f31c1889bec8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:02:27.315093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3638ca-8e68-4a10-94f0-16c7d910a3d1 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:27.315578 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3638ca-8e68-4a10-94f0-16c7d910a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:27.315680 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3638ca-8e68-4a10-94f0-16c7d910a3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:27.335862 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-4f3638ca-8e68-4a10-94f0-16c7d910a3d1 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:27.337105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4f3638ca-8e68-4a10-94f0-16c7d910a3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:27.398836 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1438/2888] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:27.407384 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8121f-e96b-4b3c-a7f9-20cfc0e7efb7 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:27.407701 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8121f-e96b-4b3c-a7f9-20cfc0e7efb7 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:27.407978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8121f-e96b-4b3c-a7f9-20cfc0e7efb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:27.428989 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-a9e8121f-e96b-4b3c-a7f9-20cfc0e7efb7 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:27.430222 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a9e8121f-e96b-4b3c-a7f9-20cfc0e7efb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:27.439487 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1451/2889] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:27.444043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3638ca-8e68-4a10-94f0-16c7d910a3d1 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:27.454820 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3638ca-8e68-4a10-94f0-16c7d910a3d1 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:27.459557 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33c19-4346-4a06-a38b-74f8cdbd0691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:27.460169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33c19-4346-4a06-a38b-74f8cdbd0691 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:27.460451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33c19-4346-4a06-a38b-74f8cdbd0691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:27.460755 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da33c19-4346-4a06-a38b-74f8cdbd0691 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:27.461416 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33c19-4346-4a06-a38b-74f8cdbd0691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:02:27.461720 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33c19-4346-4a06-a38b-74f8cdbd0691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:27.463321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da33c19-4346-4a06-a38b-74f8cdbd0691 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:27.475399 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1439/2890] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 22:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:02:27.479964 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8121f-e96b-4b3c-a7f9-20cfc0e7efb7 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:27.489915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8121f-e96b-4b3c-a7f9-20cfc0e7efb7 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:27.495304 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749dd45-a770-466b-b597-1d466b068dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:27.495907 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749dd45-a770-466b-b597-1d466b068dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:27.496184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749dd45-a770-466b-b597-1d466b068dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:27.496452 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749dd45-a770-466b-b597-1d466b068dd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:27.497120 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749dd45-a770-466b-b597-1d466b068dd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:27.499015 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749dd45-a770-466b-b597-1d466b068dd7 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:27.599503 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1452/2891] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 22:02:27 2022] POST /identity/v3/projects => generated 409 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:27.603721 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33c19-4346-4a06-a38b-74f8cdbd0691 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:27.614239 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da33c19-4346-4a06-a38b-74f8cdbd0691 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:27.656789 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:27.678086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1364e3f-5a37-4f5b-a749-59f32c9f67ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:27.678695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1364e3f-5a37-4f5b-a749-59f32c9f67ad admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:27.678976 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1364e3f-5a37-4f5b-a749-59f32c9f67ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:27.679252 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1364e3f-5a37-4f5b-a749-59f32c9f67ad admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:27.679891 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1364e3f-5a37-4f5b-a749-59f32c9f67ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:27.682414 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1364e3f-5a37-4f5b-a749-59f32c9f67ad admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:27.817321 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1440/2892] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 22:02:27 2022] POST /identity/v3/users => generated 305 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:27.822651 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749dd45-a770-466b-b597-1d466b068dd7 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:27.829722 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:27.833826 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749dd45-a770-466b-b597-1d466b068dd7 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:27.838437 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55b3dc-de01-4875-ace2-e3774f15c0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:27.839063 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55b3dc-de01-4875-ace2-e3774f15c0fd admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:27.839338 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55b3dc-de01-4875-ace2-e3774f15c0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:27.839605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55b3dc-de01-4875-ace2-e3774f15c0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:27.840237 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55b3dc-de01-4875-ace2-e3774f15c0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:27.841877 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55b3dc-de01-4875-ace2-e3774f15c0fd admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:27.852830 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1453/2893] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:27.857972 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1364e3f-5a37-4f5b-a749-59f32c9f67ad admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:27.868781 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1364e3f-5a37-4f5b-a749-59f32c9f67ad admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:27.874216 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af7dc3-2a58-4539-8e75-52ad0b5d4388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:27.874826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7dc3-2a58-4539-8e75-52ad0b5d4388 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:27.875136 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7dc3-2a58-4539-8e75-52ad0b5d4388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:27.875407 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7dc3-2a58-4539-8e75-52ad0b5d4388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:27.876093 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af7dc3-2a58-4539-8e75-52ad0b5d4388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:27.877749 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af7dc3-2a58-4539-8e75-52ad0b5d4388 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:27.889558 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1441/2894] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:27.894677 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55b3dc-de01-4875-ace2-e3774f15c0fd admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:27.905598 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55b3dc-de01-4875-ace2-e3774f15c0fd admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:27.910268 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff301f-49fd-4cba-9af5-94b706890169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:27.910931 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff301f-49fd-4cba-9af5-94b706890169 admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:27.913049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff301f-49fd-4cba-9af5-94b706890169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:27.913049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff301f-49fd-4cba-9af5-94b706890169 admin admin] PATH_INFO: `/v3/projects/3d64764cd1964077bc5a80cf3e19ce3f/users/8acb9e7ea588455a9756be4ad3be065b/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:27.927264 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff301f-49fd-4cba-9af5-94b706890169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d64764cd1964077bc5a80cf3e19ce3f, user_id=8acb9e7ea588455a9756be4ad3be065b, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:27.929961 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff301f-49fd-4cba-9af5-94b706890169 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:28.029664 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1454/2895] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:27 2022] PUT /identity/v3/projects/3d64764cd1964077bc5a80cf3e19ce3f/users/8acb9e7ea588455a9756be4ad3be065b/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:28.042004 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73822a1e-3f91-4888-8d9b-7a60a9a05c78 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:28.042284 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73822a1e-3f91-4888-8d9b-7a60a9a05c78 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:28.042553 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73822a1e-3f91-4888-8d9b-7a60a9a05c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:28.074257 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-73822a1e-3f91-4888-8d9b-7a60a9a05c78 None None] MFA Rules not processed for user `8acb9e7ea588455a9756be4ad3be065b`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:28.075523 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-73822a1e-3f91-4888-8d9b-7a60a9a05c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:28.143975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1442/2896] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:28 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:28.148582 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff301f-49fd-4cba-9af5-94b706890169 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:28.210203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff301f-49fd-4cba-9af5-94b706890169 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:28.215457 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a94c71-625c-4d6d-9608-5f21cc320062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:28.216059 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a94c71-625c-4d6d-9608-5f21cc320062 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:28.216336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a94c71-625c-4d6d-9608-5f21cc320062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:28.216645 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a94c71-625c-4d6d-9608-5f21cc320062 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:28.217275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a94c71-625c-4d6d-9608-5f21cc320062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:28.219155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a94c71-625c-4d6d-9608-5f21cc320062 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:28.343573 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1455/2897] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 22:02:28 2022] POST /identity/v3/projects => generated 409 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:28.348153 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73822a1e-3f91-4888-8d9b-7a60a9a05c78 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:28.360315 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73822a1e-3f91-4888-8d9b-7a60a9a05c78 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:28.427412 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bf60a-90ba-48dc-a3ba-1a5960878729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:28.427964 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bf60a-90ba-48dc-a3ba-1a5960878729 admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:28.428244 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bf60a-90ba-48dc-a3ba-1a5960878729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:28.428556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bf60a-90ba-48dc-a3ba-1a5960878729 admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:28.429237 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bf60a-90ba-48dc-a3ba-1a5960878729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:28.431331 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090bf60a-90ba-48dc-a3ba-1a5960878729 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:28.556206 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1443/2898] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 22:02:28 2022] POST /identity/v3/users => generated 311 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:28.561178 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a94c71-625c-4d6d-9608-5f21cc320062 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:28.574025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a94c71-625c-4d6d-9608-5f21cc320062 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:28.586315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cca06e-13a1-4285-886b-35bb01196880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:28.586315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cca06e-13a1-4285-886b-35bb01196880 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:28.586315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cca06e-13a1-4285-886b-35bb01196880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:28.586315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cca06e-13a1-4285-886b-35bb01196880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:28.587052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cca06e-13a1-4285-886b-35bb01196880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:28.587052 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cca06e-13a1-4285-886b-35bb01196880 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:28.599397 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1456/2899] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:28.603902 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bf60a-90ba-48dc-a3ba-1a5960878729 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:28.614531 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bf60a-90ba-48dc-a3ba-1a5960878729 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:28.619540 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0b55f-0e6c-4255-820f-f545e4c08d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:28.620524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0b55f-0e6c-4255-820f-f545e4c08d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:28.620524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0b55f-0e6c-4255-820f-f545e4c08d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:28.620800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0b55f-0e6c-4255-820f-f545e4c08d70 admin admin] PATH_INFO: `/v3/projects/d46ff248e99941fa804065e82f483733/users/5313fa5715d04f0b9c08da51446bf323/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:28.638351 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0b55f-0e6c-4255-820f-f545e4c08d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46ff248e99941fa804065e82f483733, user_id=5313fa5715d04f0b9c08da51446bf323, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:28.641769 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0b55f-0e6c-4255-820f-f545e4c08d70 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:28.746874 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1444/2900] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:28 2022] PUT /identity/v3/projects/d46ff248e99941fa804065e82f483733/users/5313fa5715d04f0b9c08da51446bf323/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:02:28.751086 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cca06e-13a1-4285-886b-35bb01196880 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:28.762512 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cca06e-13a1-4285-886b-35bb01196880 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:28.828937 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0dcc3-a2b1-434f-a08f-ec13deb46265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:28.829559 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0dcc3-a2b1-434f-a08f-ec13deb46265 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:28.829840 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0dcc3-a2b1-434f-a08f-ec13deb46265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:28.830112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0dcc3-a2b1-434f-a08f-ec13deb46265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:28.830788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0dcc3-a2b1-434f-a08f-ec13deb46265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:28.832508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0dcc3-a2b1-434f-a08f-ec13deb46265 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:28.847140 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1457/2901] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:28.848427 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0b55f-0e6c-4255-820f-f545e4c08d70 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:28.859758 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0b55f-0e6c-4255-820f-f545e4c08d70 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:28.864689 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770effa-3887-480b-a5c7-0506ec7f82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:28.865379 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770effa-3887-480b-a5c7-0506ec7f82f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:28.865701 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770effa-3887-480b-a5c7-0506ec7f82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:28.865995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770effa-3887-480b-a5c7-0506ec7f82f1 admin admin] PATH_INFO: `/v3/projects/d46ff248e99941fa804065e82f483733/users/5313fa5715d04f0b9c08da51446bf323/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:28.868005 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770effa-3887-480b-a5c7-0506ec7f82f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46ff248e99941fa804065e82f483733, user_id=5313fa5715d04f0b9c08da51446bf323, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:28.871223 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770effa-3887-480b-a5c7-0506ec7f82f1 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:28.878476 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:28.883175 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1445/2902] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:28 2022] PUT /identity/v3/projects/d46ff248e99941fa804065e82f483733/users/5313fa5715d04f0b9c08da51446bf323/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:28.895887 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b304f3-eba1-481a-8379-2aa0c4aa4199 None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:28.896172 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b304f3-eba1-481a-8379-2aa0c4aa4199 None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:28.896448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b304f3-eba1-481a-8379-2aa0c4aa4199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:28.926221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-f7b304f3-eba1-481a-8379-2aa0c4aa4199 None None] MFA Rules not processed for user `5313fa5715d04f0b9c08da51446bf323`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:28.927435 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-f7b304f3-eba1-481a-8379-2aa0c4aa4199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:28.957969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:28.995542 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1458/2903] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:28 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:29.007065 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770effa-3887-480b-a5c7-0506ec7f82f1 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:29.008949 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-8770effa-3887-480b-a5c7-0506ec7f82f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:29.069507 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770effa-3887-480b-a5c7-0506ec7f82f1 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:29.074040 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3da59-4b44-4823-80f9-33ad1fdce5d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:29.074646 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3da59-4b44-4823-80f9-33ad1fdce5d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:29.074927 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3da59-4b44-4823-80f9-33ad1fdce5d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:29.075201 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3da59-4b44-4823-80f9-33ad1fdce5d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:29.084869 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3da59-4b44-4823-80f9-33ad1fdce5d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:29.086329 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3da59-4b44-4823-80f9-33ad1fdce5d6 service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:29.095889 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1446/2904] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:29 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:02:29.522101 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b304f3-eba1-481a-8379-2aa0c4aa4199 None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:29.532106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b304f3-eba1-481a-8379-2aa0c4aa4199 None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:29.535738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca4268-26ca-4096-b2df-cc12a1ae3e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:29.536340 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4268-26ca-4096-b2df-cc12a1ae3e6b service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:29.536653 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4268-26ca-4096-b2df-cc12a1ae3e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:29.536928 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca4268-26ca-4096-b2df-cc12a1ae3e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:29.595195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca4268-26ca-4096-b2df-cc12a1ae3e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:29.596678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca4268-26ca-4096-b2df-cc12a1ae3e6b service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:29.606489 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1459/2905] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:29 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 22:02:36.768176 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3da59-4b44-4823-80f9-33ad1fdce5d6 service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:36.831857 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3da59-4b44-4823-80f9-33ad1fdce5d6 service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:36.836526 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:36.837158 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:36.837437 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:36.837711 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] PATH_INFO: `/v3/users/8acb9e7ea588455a9756be4ad3be065b` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:36.839502 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8acb9e7ea588455a9756be4ad3be065b)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:36.841470 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:37.028716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8acb9e7ea588455a9756be4ad3be065b'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:37.036559 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8acb9e7ea588455a9756be4ad3be065b'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:37.037286 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8acb9e7ea588455a9756be4ad3be065b'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:37.100454 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8acb9e7ea588455a9756be4ad3be065b'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:37.113948 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8acb9e7ea588455a9756be4ad3be065b'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:37.124034 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1447/2906] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:36 2022] DELETE /identity/v3/users/8acb9e7ea588455a9756be4ad3be065b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:02:37.125493 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cabe1-fae8-401a-9363-ab56a6099d0e None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:37.125979 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cabe1-fae8-401a-9363-ab56a6099d0e None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:37.126139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cabe1-fae8-401a-9363-ab56a6099d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:37.146336 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-754cabe1-fae8-401a-9363-ab56a6099d0e None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:37.147557 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-754cabe1-fae8-401a-9363-ab56a6099d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:37.209934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1460/2907] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:37.220184 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:37.221656 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:37.249243 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:37.281773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45741d-a501-4b1e-9e03-3b8e54512169 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:37.285495 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157eb2a-82df-4dd7-bb42-85bf802fd49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:37.286100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157eb2a-82df-4dd7-bb42-85bf802fd49e service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:37.286382 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157eb2a-82df-4dd7-bb42-85bf802fd49e service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:37.286705 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157eb2a-82df-4dd7-bb42-85bf802fd49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:37.295851 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157eb2a-82df-4dd7-bb42-85bf802fd49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:37.297364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157eb2a-82df-4dd7-bb42-85bf802fd49e service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:37.308877 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1448/2908] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:02:37.773756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cabe1-fae8-401a-9363-ab56a6099d0e None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:37.775191 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-754cabe1-fae8-401a-9363-ab56a6099d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:37.789753 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cabe1-fae8-401a-9363-ab56a6099d0e None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:37.795545 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:37.799112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:37.799112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:37.799112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] PATH_INFO: `/v3/projects/3d64764cd1964077bc5a80cf3e19ce3f` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:37.799112 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d64764cd1964077bc5a80cf3e19ce3f)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:37.800420 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:37.901449 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d64764cd1964077bc5a80cf3e19ce3f', 'request_id': 'req-7323e894-90a3-48de-b326-aaa0551ecf13'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:37.907196 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d64764cd1964077bc5a80cf3e19ce3f', 'request_id': 'req-7323e894-90a3-48de-b326-aaa0551ecf13'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:37.908949 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:38.009106 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d64764cd1964077bc5a80cf3e19ce3f', 'request_id': 'req-7323e894-90a3-48de-b326-aaa0551ecf13'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:38.024320 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] The token cache is being invalidate because project 3d64764cd1964077bc5a80cf3e19ce3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:38.024857 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:38.026203 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:38.027894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1461/2909] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:37 2022] DELETE /identity/v3/projects/3d64764cd1964077bc5a80cf3e19ce3f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:38.032002 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157eb2a-82df-4dd7-bb42-85bf802fd49e service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:38.044043 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157eb2a-82df-4dd7-bb42-85bf802fd49e service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:38.109824 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:38.110473 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:38.110751 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:38.111025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] PATH_INFO: `/v3/users/5313fa5715d04f0b9c08da51446bf323` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:38.112209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5313fa5715d04f0b9c08da51446bf323)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:38.114179 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:38.364320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5313fa5715d04f0b9c08da51446bf323'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:38.371621 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5313fa5715d04f0b9c08da51446bf323'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:38.372357 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5313fa5715d04f0b9c08da51446bf323'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:38.447138 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5313fa5715d04f0b9c08da51446bf323'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:38.463804 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-a5f7fa88-9b88-413c-8a1e-4b7cab8c62f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5313fa5715d04f0b9c08da51446bf323'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:38.470323 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1449/2910] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:38 2022] DELETE /identity/v3/users/5313fa5715d04f0b9c08da51446bf323 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:38.928309 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:38.930066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:38.945733 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323e894-90a3-48de-b326-aaa0551ecf13 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:39.006009 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:39.006845 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:39.006958 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:39.007176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] PATH_INFO: `/v3/projects/d46ff248e99941fa804065e82f483733` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:39.008315 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46ff248e99941fa804065e82f483733)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:39.010332 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:39.191392 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46ff248e99941fa804065e82f483733', 'request_id': 'req-1c3b824b-581a-4696-b772-22ea7de8cc8c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:39.197886 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46ff248e99941fa804065e82f483733', 'request_id': 'req-1c3b824b-581a-4696-b772-22ea7de8cc8c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:39.263483 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46ff248e99941fa804065e82f483733', 'request_id': 'req-1c3b824b-581a-4696-b772-22ea7de8cc8c'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:39.276082 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] The token cache is being invalidate because project d46ff248e99941fa804065e82f483733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:39.276358 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:39.277066 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-1c3b824b-581a-4696-b772-22ea7de8cc8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:39.278575 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1462/2911] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:38 2022] DELETE /identity/v3/projects/d46ff248e99941fa804065e82f483733 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:39.283846 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbf07-1345-4816-b2ec-aecaf7d68127 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:39.284373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbf07-1345-4816-b2ec-aecaf7d68127 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:39.284373 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12bbf07-1345-4816-b2ec-aecaf7d68127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:39.305945 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-f12bbf07-1345-4816-b2ec-aecaf7d68127 None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:39.307747 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-f12bbf07-1345-4816-b2ec-aecaf7d68127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:39.349946 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:39.369214 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1450/2912] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:39.378603 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68624add-3436-4911-af0d-a48113a6494f None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:39.378894 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68624add-3436-4911-af0d-a48113a6494f None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:39.379176 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68624add-3436-4911-af0d-a48113a6494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:39.399765 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-68624add-3436-4911-af0d-a48113a6494f None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:39.401649 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-68624add-3436-4911-af0d-a48113a6494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:39.409611 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1463/2913] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:39.413916 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bbf07-1345-4816-b2ec-aecaf7d68127 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:39.424677 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12bbf07-1345-4816-b2ec-aecaf7d68127 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:39.429344 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcf21f-ad2d-48a0-be7f-875fc5e59b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:39.429955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcf21f-ad2d-48a0-be7f-875fc5e59b79 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:39.430232 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcf21f-ad2d-48a0-be7f-875fc5e59b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:39.430504 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcf21f-ad2d-48a0-be7f-875fc5e59b79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:39.431157 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcf21f-ad2d-48a0-be7f-875fc5e59b79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81953) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 22:02:39.431457 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcf21f-ad2d-48a0-be7f-875fc5e59b79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:39.433099 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcf21f-ad2d-48a0-be7f-875fc5e59b79 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:39.445594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1451/2914] 10.222.0.83 () {58 vars in 1153 bytes} [Mon Aug 29 22:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 22:02:39.449936 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68624add-3436-4911-af0d-a48113a6494f None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:39.459756 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68624add-3436-4911-af0d-a48113a6494f None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:39.465117 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b52659-ff43-42bc-b6ba-deebf9353087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:39.465771 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b52659-ff43-42bc-b6ba-deebf9353087 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:39.466051 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b52659-ff43-42bc-b6ba-deebf9353087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:39.466325 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b52659-ff43-42bc-b6ba-deebf9353087 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:39.466966 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b52659-ff43-42bc-b6ba-deebf9353087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:39.470269 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b52659-ff43-42bc-b6ba-deebf9353087 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:39.574418 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1464/2915] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 22:02:39 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:39.579161 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcf21f-ad2d-48a0-be7f-875fc5e59b79 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:39.595302 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcf21f-ad2d-48a0-be7f-875fc5e59b79 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:39.659324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bbd10-ec9b-40a6-8ff1-868949e706fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:39.659938 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bbd10-ec9b-40a6-8ff1-868949e706fe admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:39.660217 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bbd10-ec9b-40a6-8ff1-868949e706fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:39.660516 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bbd10-ec9b-40a6-8ff1-868949e706fe admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:39.661169 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bbd10-ec9b-40a6-8ff1-868949e706fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:39.663086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bbd10-ec9b-40a6-8ff1-868949e706fe admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:39.853139 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1452/2916] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 22:02:39 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:39.857883 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b52659-ff43-42bc-b6ba-deebf9353087 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:39.868694 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b52659-ff43-42bc-b6ba-deebf9353087 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:39.873915 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94be795-6048-45f3-9047-c51fb9dff405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:39.874556 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94be795-6048-45f3-9047-c51fb9dff405 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:39.874834 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94be795-6048-45f3-9047-c51fb9dff405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:39.875105 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94be795-6048-45f3-9047-c51fb9dff405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:39.875764 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94be795-6048-45f3-9047-c51fb9dff405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:39.877458 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94be795-6048-45f3-9047-c51fb9dff405 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:39.892019 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1465/2917] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 22:02:39.896544 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bbd10-ec9b-40a6-8ff1-868949e706fe admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:39.908463 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bbd10-ec9b-40a6-8ff1-868949e706fe admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:39.913424 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783581fc-efc9-4bc9-b86a-53a60d8ddbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:39.914051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783581fc-efc9-4bc9-b86a-53a60d8ddbce admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:39.914324 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783581fc-efc9-4bc9-b86a-53a60d8ddbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:39.914601 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783581fc-efc9-4bc9-b86a-53a60d8ddbce admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:39.915259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783581fc-efc9-4bc9-b86a-53a60d8ddbce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:39.916939 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783581fc-efc9-4bc9-b86a-53a60d8ddbce admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:39.933926 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1453/2918] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:39.938501 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94be795-6048-45f3-9047-c51fb9dff405 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:39.950184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94be795-6048-45f3-9047-c51fb9dff405 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:39.955124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf9bd5-52e0-4aed-8c5d-d71a9a6cf1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:39.955799 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf9bd5-52e0-4aed-8c5d-d71a9a6cf1af admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:39.956154 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf9bd5-52e0-4aed-8c5d-d71a9a6cf1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:39.956448 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf9bd5-52e0-4aed-8c5d-d71a9a6cf1af admin admin] PATH_INFO: `/v3/projects/4a359469404f4db2b626ab9649010a6b/users/46013029c8d84c5db48777d4bf05b388/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:39.982691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf9bd5-52e0-4aed-8c5d-d71a9a6cf1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a359469404f4db2b626ab9649010a6b, user_id=46013029c8d84c5db48777d4bf05b388, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:39.987132 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf9bd5-52e0-4aed-8c5d-d71a9a6cf1af admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:40.112041 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1466/2919] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:39 2022] PUT /identity/v3/projects/4a359469404f4db2b626ab9649010a6b/users/46013029c8d84c5db48777d4bf05b388/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:02:40.123716 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eafaf-c295-4430-b16d-28650ad97b1a None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:40.124167 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eafaf-c295-4430-b16d-28650ad97b1a None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:40.124443 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eafaf-c295-4430-b16d-28650ad97b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:40.155686 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-875eafaf-c295-4430-b16d-28650ad97b1a None None] MFA Rules not processed for user `46013029c8d84c5db48777d4bf05b388`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:40.157088 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-875eafaf-c295-4430-b16d-28650ad97b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:40.227451 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1454/2920] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:40.232372 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf9bd5-52e0-4aed-8c5d-d71a9a6cf1af admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:40.252591 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:40.305673 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf9bd5-52e0-4aed-8c5d-d71a9a6cf1af admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:40.311562 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3d251-75cd-4be9-b8ed-ed20a876990e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:40.312672 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3d251-75cd-4be9-b8ed-ed20a876990e admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:40.313025 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3d251-75cd-4be9-b8ed-ed20a876990e admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:40.313298 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3d251-75cd-4be9-b8ed-ed20a876990e admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:40.313934 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3d251-75cd-4be9-b8ed-ed20a876990e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:40.315841 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3d251-75cd-4be9-b8ed-ed20a876990e admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:40.445042 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1467/2921] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 22:02:40 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:40.449853 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eafaf-c295-4430-b16d-28650ad97b1a None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:40.460991 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eafaf-c295-4430-b16d-28650ad97b1a None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:40.500488 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:40.519513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21be904-bc10-486d-b147-0119d937d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:40.520159 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21be904-bc10-486d-b147-0119d937d86b admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:40.520436 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21be904-bc10-486d-b147-0119d937d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:40.520737 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21be904-bc10-486d-b147-0119d937d86b admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:40.521441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21be904-bc10-486d-b147-0119d937d86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:40.523341 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21be904-bc10-486d-b147-0119d937d86b admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:40.615404 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1455/2922] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 22:02:40 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 22:02:40.620223 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3d251-75cd-4be9-b8ed-ed20a876990e admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:40.631469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3d251-75cd-4be9-b8ed-ed20a876990e admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:40.636211 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88670152-bd93-4762-81bf-2866be56614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:40.636854 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88670152-bd93-4762-81bf-2866be56614a admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:40.637134 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88670152-bd93-4762-81bf-2866be56614a admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:40.637408 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88670152-bd93-4762-81bf-2866be56614a admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:40.638100 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88670152-bd93-4762-81bf-2866be56614a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:40.639704 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88670152-bd93-4762-81bf-2866be56614a admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:40.650978 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1468/2923] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:40.655996 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21be904-bc10-486d-b147-0119d937d86b admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:40.669123 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21be904-bc10-486d-b147-0119d937d86b admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:40.673938 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46e313-9cd5-4eae-9e9f-48312b68b2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:40.674552 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e313-9cd5-4eae-9e9f-48312b68b2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:40.674826 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e313-9cd5-4eae-9e9f-48312b68b2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:40.675092 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e313-9cd5-4eae-9e9f-48312b68b2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:40.675812 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46e313-9cd5-4eae-9e9f-48312b68b2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:40.677441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b46e313-9cd5-4eae-9e9f-48312b68b2f1 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:40.689461 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1456/2924] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:40.693961 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88670152-bd93-4762-81bf-2866be56614a admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:40.704334 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88670152-bd93-4762-81bf-2866be56614a admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:40.708971 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18c73d-5c36-417e-a642-c038d64cc41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:40.709619 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c73d-5c36-417e-a642-c038d64cc41f admin admin] REQUEST_METHOD: `PUT` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:40.709944 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c73d-5c36-417e-a642-c038d64cc41f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:40.710707 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18c73d-5c36-417e-a642-c038d64cc41f admin admin] PATH_INFO: `/v3/projects/d6bc074775ab4cd482a37211fe841d6a/users/4c9cc7019819402daeb90594593e5c2a/roles/23bfcdf883144a0b8740e12c6a6de7e3` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:40.726108 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18c73d-5c36-417e-a642-c038d64cc41f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6bc074775ab4cd482a37211fe841d6a, user_id=4c9cc7019819402daeb90594593e5c2a, role_id=23bfcdf883144a0b8740e12c6a6de7e3)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:40.729296 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18c73d-5c36-417e-a642-c038d64cc41f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:40.809742 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1469/2925] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:40 2022] PUT /identity/v3/projects/d6bc074775ab4cd482a37211fe841d6a/users/4c9cc7019819402daeb90594593e5c2a/roles/23bfcdf883144a0b8740e12c6a6de7e3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:02:40.820100 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed13bb9-c2f1-4d5d-a185-54766072eb52 None None] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:40.820405 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed13bb9-c2f1-4d5d-a185-54766072eb52 None None] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:40.820740 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed13bb9-c2f1-4d5d-a185-54766072eb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:40.848700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.auth.core [None req-0ed13bb9-c2f1-4d5d-a185-54766072eb52 None None] MFA Rules not processed for user `4c9cc7019819402daeb90594593e5c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81953) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:40.849898 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-0ed13bb9-c2f1-4d5d-a185-54766072eb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:40.912218 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1457/2926] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:40.917385 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18c73d-5c36-417e-a642-c038d64cc41f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:40.977480 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18c73d-5c36-417e-a642-c038d64cc41f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:40.982721 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf2d6-3e54-4233-9bcb-5ea60fed4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:40.983266 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf2d6-3e54-4233-9bcb-5ea60fed4585 admin admin] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:40.983539 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf2d6-3e54-4233-9bcb-5ea60fed4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:40.983804 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bf2d6-3e54-4233-9bcb-5ea60fed4585 admin admin] PATH_INFO: `/v3/projects` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:40.984465 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bf2d6-3e54-4233-9bcb-5ea60fed4585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:40.986364 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bf2d6-3e54-4233-9bcb-5ea60fed4585 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:41.079233 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1470/2927] 10.222.0.83 () {60 vars in 1153 bytes} [Mon Aug 29 22:02:40 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:41.083543 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed13bb9-c2f1-4d5d-a185-54766072eb52 None None] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:41.095066 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed13bb9-c2f1-4d5d-a185-54766072eb52 None None] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:41.151524 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a872fdd-3774-4d04-8ea8-2e042a3e1dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:41.152126 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872fdd-3774-4d04-8ea8-2e042a3e1dff admin admin] REQUEST_METHOD: `POST` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:41.152401 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872fdd-3774-4d04-8ea8-2e042a3e1dff admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:41.152700 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a872fdd-3774-4d04-8ea8-2e042a3e1dff admin admin] PATH_INFO: `/v3/users` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:41.153337 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a872fdd-3774-4d04-8ea8-2e042a3e1dff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:41.155231 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a872fdd-3774-4d04-8ea8-2e042a3e1dff admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:41.266685 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1458/2928] 10.222.0.83 () {60 vars in 1144 bytes} [Mon Aug 29 22:02:41 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 22:02:41.270801 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf2d6-3e54-4233-9bcb-5ea60fed4585 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:41.282291 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bf2d6-3e54-4233-9bcb-5ea60fed4585 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:41.287076 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa36c4-113f-418f-8dfb-dc43409acb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:41.287738 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa36c4-113f-418f-8dfb-dc43409acb09 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:41.288017 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa36c4-113f-418f-8dfb-dc43409acb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:41.288290 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa36c4-113f-418f-8dfb-dc43409acb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:41.288969 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa36c4-113f-418f-8dfb-dc43409acb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:41.290785 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efa36c4-113f-418f-8dfb-dc43409acb09 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:41.304910 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1471/2929] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:41.309653 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a872fdd-3774-4d04-8ea8-2e042a3e1dff admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:41.320596 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a872fdd-3774-4d04-8ea8-2e042a3e1dff admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:41.326029 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c15cc5-d873-4bb9-8c77-d34766ff9612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:41.326697 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c15cc5-d873-4bb9-8c77-d34766ff9612 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:41.326978 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c15cc5-d873-4bb9-8c77-d34766ff9612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:41.327281 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c15cc5-d873-4bb9-8c77-d34766ff9612 admin admin] PATH_INFO: `/v3/projects/b93b896ac529468fb2f69fc7f8a5a6fc/users/d697f0e4076043b6aea486ada34349a3/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:41.344938 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c15cc5-d873-4bb9-8c77-d34766ff9612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93b896ac529468fb2f69fc7f8a5a6fc, user_id=d697f0e4076043b6aea486ada34349a3, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:41.347654 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c15cc5-d873-4bb9-8c77-d34766ff9612 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:41.418355 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1459/2930] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:41 2022] PUT /identity/v3/projects/b93b896ac529468fb2f69fc7f8a5a6fc/users/d697f0e4076043b6aea486ada34349a3/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 22:02:41.422787 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa36c4-113f-418f-8dfb-dc43409acb09 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:41.432816 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa36c4-113f-418f-8dfb-dc43409acb09 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:41.468578 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:41.491954 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c5878-8534-4e8b-9cb7-28b805d2ba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:41.492605 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5878-8534-4e8b-9cb7-28b805d2ba19 admin admin] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:41.492882 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5878-8534-4e8b-9cb7-28b805d2ba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:41.493155 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c5878-8534-4e8b-9cb7-28b805d2ba19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:41.493798 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c5878-8534-4e8b-9cb7-28b805d2ba19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:41.495504 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c5878-8534-4e8b-9cb7-28b805d2ba19 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:41.505373 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1472/2931] 10.222.0.83 () {58 vars in 1122 bytes} [Mon Aug 29 22:02:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 22:02:41.509641 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c15cc5-d873-4bb9-8c77-d34766ff9612 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:41.520799 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c15cc5-d873-4bb9-8c77-d34766ff9612 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:41.525413 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b1c9c-09c9-4af4-baf4-4e22c35abbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:41.526672 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b1c9c-09c9-4af4-baf4-4e22c35abbb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:41.526957 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b1c9c-09c9-4af4-baf4-4e22c35abbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:41.527234 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b1c9c-09c9-4af4-baf4-4e22c35abbb4 admin admin] PATH_INFO: `/v3/projects/b93b896ac529468fb2f69fc7f8a5a6fc/users/d697f0e4076043b6aea486ada34349a3/roles/c0316e22a13a4034846c451753b4c14e` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:41.529192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b1c9c-09c9-4af4-baf4-4e22c35abbb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93b896ac529468fb2f69fc7f8a5a6fc, user_id=d697f0e4076043b6aea486ada34349a3, role_id=c0316e22a13a4034846c451753b4c14e)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:41.531973 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b1c9c-09c9-4af4-baf4-4e22c35abbb4 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:41.538453 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:41.543009 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1460/2932] 10.222.0.83 () {60 vars in 1483 bytes} [Mon Aug 29 22:02:41 2022] PUT /identity/v3/projects/b93b896ac529468fb2f69fc7f8a5a6fc/users/d697f0e4076043b6aea486ada34349a3/roles/c0316e22a13a4034846c451753b4c14e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:41.554365 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389831de-097f-41e0-b1d9-c9b967e23cbf None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:41.554648 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389831de-097f-41e0-b1d9-c9b967e23cbf None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:41.554918 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389831de-097f-41e0-b1d9-c9b967e23cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:41.583484 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-389831de-097f-41e0-b1d9-c9b967e23cbf None None] MFA Rules not processed for user `d697f0e4076043b6aea486ada34349a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:41.584773 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-389831de-097f-41e0-b1d9-c9b967e23cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:41.654640 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1473/2933] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:41.666192 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b1c9c-09c9-4af4-baf4-4e22c35abbb4 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:41.667895 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-cb1b1c9c-09c9-4af4-baf4-4e22c35abbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:41.725410 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b1c9c-09c9-4af4-baf4-4e22c35abbb4 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:41.729108 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592fbbc-7b90-4d1c-bc69-58c9273ba6ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:41.729708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592fbbc-7b90-4d1c-bc69-58c9273ba6ef service cinder] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:41.729986 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592fbbc-7b90-4d1c-bc69-58c9273ba6ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:41.730278 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592fbbc-7b90-4d1c-bc69-58c9273ba6ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:41.739120 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592fbbc-7b90-4d1c-bc69-58c9273ba6ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:41.740556 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592fbbc-7b90-4d1c-bc69-58c9273ba6ef service cinder] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:41.751125 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1461/2934] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:02:41.875139 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389831de-097f-41e0-b1d9-c9b967e23cbf None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:41.876671 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-389831de-097f-41e0-b1d9-c9b967e23cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:41.889551 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389831de-097f-41e0-b1d9-c9b967e23cbf None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:41.893122 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75a029-37ed-40aa-ba5b-8d1e35e7e707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf63df08ae14d09b5cbdb102d6609ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:41.893731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75a029-37ed-40aa-ba5b-8d1e35e7e707 service cinder] REQUEST_METHOD: `GET` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:41.894006 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75a029-37ed-40aa-ba5b-8d1e35e7e707 service cinder] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:41.894275 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75a029-37ed-40aa-ba5b-8d1e35e7e707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:41.953788 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75a029-37ed-40aa-ba5b-8d1e35e7e707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:41.955276 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75a029-37ed-40aa-ba5b-8d1e35e7e707 service cinder] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:41.964471 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1474/2935] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:02:46.302594 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592fbbc-7b90-4d1c-bc69-58c9273ba6ef service cinder] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:46.395273 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592fbbc-7b90-4d1c-bc69-58c9273ba6ef service cinder] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:46.401209 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:46.401911 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:46.402226 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:46.402493 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] PATH_INFO: `/v3/users/46013029c8d84c5db48777d4bf05b388` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:46.403741 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46013029c8d84c5db48777d4bf05b388)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:46.405773 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:46.602512 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46013029c8d84c5db48777d4bf05b388'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:46.609987 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46013029c8d84c5db48777d4bf05b388'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:46.610740 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46013029c8d84c5db48777d4bf05b388'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:46.683634 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46013029c8d84c5db48777d4bf05b388'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:46.701845 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46013029c8d84c5db48777d4bf05b388'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:46.708662 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1462/2936] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:46 2022] DELETE /identity/v3/users/46013029c8d84c5db48777d4bf05b388 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:46.714170 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6497e-4dfd-4800-a62f-f79d9ef9f37a None None] REQUEST_METHOD: `POST` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:46.714730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6497e-4dfd-4800-a62f-f79d9ef9f37a None None] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:46.714730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6497e-4dfd-4800-a62f-f79d9ef9f37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:46.735636 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.auth.core [None req-aae6497e-4dfd-4800-a62f-f79d9ef9f37a None None] MFA Rules not processed for user `19faba1f83d443dbaca1d7f5b1b4a452`. Rule list: `[]` (Enabled: `True`). {{(pid=81954) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 22:02:46.736913 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-aae6497e-4dfd-4800-a62f-f79d9ef9f37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:46.792224 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=100 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:46.804848 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1475/2937] 10.222.0.83 () {58 vars in 958 bytes} [Mon Aug 29 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 22:02:46.815622 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:46.817258 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:46.849105 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:46.883174 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3ba78-540d-481c-8ae5-8ab1376b0ca2 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:46.887995 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e9a4b-bfea-46c1-8ff6-b02092128272 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2adcc3ba3bdf4b92bd719f60e0b263ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:46.888703 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9a4b-bfea-46c1-8ff6-b02092128272 service neutron] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:46.889025 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9a4b-bfea-46c1-8ff6-b02092128272 service neutron] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:46.889322 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e9a4b-bfea-46c1-8ff6-b02092128272 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:46.899600 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e9a4b-bfea-46c1-8ff6-b02092128272 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:46.901129 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e9a4b-bfea-46c1-8ff6-b02092128272 service neutron] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:46.911188 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1463/2938] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:02:47.374349 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6497e-4dfd-4800-a62f-f79d9ef9f37a None None] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:47.375945 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-aae6497e-4dfd-4800-a62f-f79d9ef9f37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:47.390206 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6497e-4dfd-4800-a62f-f79d9ef9f37a None None] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:47.395546 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:47.396121 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:47.396395 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:47.396690 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] PATH_INFO: `/v3/projects/4a359469404f4db2b626ab9649010a6b` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:47.397803 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a359469404f4db2b626ab9649010a6b)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:47.400323 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:47.515855 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a359469404f4db2b626ab9649010a6b', 'request_id': 'req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:47.522182 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a359469404f4db2b626ab9649010a6b', 'request_id': 'req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:47.613252 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a359469404f4db2b626ab9649010a6b', 'request_id': 'req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:47.626289 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] The token cache is being invalidate because project 4a359469404f4db2b626ab9649010a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:47.626674 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:47.627388 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:47.629049 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1476/2939] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:47 2022] DELETE /identity/v3/projects/4a359469404f4db2b626ab9649010a6b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:47.637364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e9a4b-bfea-46c1-8ff6-b02092128272 service neutron] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:47.651164 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e9a4b-bfea-46c1-8ff6-b02092128272 service neutron] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:47.716975 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:47.717988 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:47.718336 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:47.718661 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] PATH_INFO: `/v3/users/4c9cc7019819402daeb90594593e5c2a` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:47.719880 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9cc7019819402daeb90594593e5c2a)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:47.721974 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:47.915471 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9cc7019819402daeb90594593e5c2a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:47.924827 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9cc7019819402daeb90594593e5c2a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:47.925584 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9cc7019819402daeb90594593e5c2a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:47.989708 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9cc7019819402daeb90594593e5c2a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:48.003546 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9cc7019819402daeb90594593e5c2a'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:48.015185 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1464/2940] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:47 2022] DELETE /identity/v3/users/4c9cc7019819402daeb90594593e5c2a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:48.515790 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:48.517469 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:48.531426 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e2ef-9be8-4302-b3cd-1f926d158a7f admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:48.594902 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:48.595686 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:48.596126 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:48.596528 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] PATH_INFO: `/v3/projects/d6bc074775ab4cd482a37211fe841d6a` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:48.597941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6bc074775ab4cd482a37211fe841d6a)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:48.599951 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:48.720217 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6bc074775ab4cd482a37211fe841d6a', 'request_id': 'req-96d7e81e-15be-4a46-9a19-00285cc90b98'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:48.726814 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6bc074775ab4cd482a37211fe841d6a', 'request_id': 'req-96d7e81e-15be-4a46-9a19-00285cc90b98'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:48.831691 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6bc074775ab4cd482a37211fe841d6a', 'request_id': 'req-96d7e81e-15be-4a46-9a19-00285cc90b98'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:48.844195 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] The token cache is being invalidate because project d6bc074775ab4cd482a37211fe841d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:48.844508 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:48.845180 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:48.846731 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1477/2941] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:48 2022] DELETE /identity/v3/projects/d6bc074775ab4cd482a37211fe841d6a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:48.851051 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:48.852541 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:48.866233 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dc0ab-9a2e-4fb8-b507-d71c483b1cd8 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:48.925904 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:48.948678 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:48.949800 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:48.950364 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:48.950876 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] PATH_INFO: `/v3/users/d697f0e4076043b6aea486ada34349a3` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:48.952901 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d697f0e4076043b6aea486ada34349a3)` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:48.956831 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:49.190220 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd697f0e4076043b6aea486ada34349a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:49.202794 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd697f0e4076043b6aea486ada34349a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:49.203695 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd697f0e4076043b6aea486ada34349a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:49.298308 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd697f0e4076043b6aea486ada34349a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:49.312752 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.notifications [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd697f0e4076043b6aea486ada34349a3'} {{(pid=81953) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:49.319293 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1465/2942] 10.222.0.83 () {58 vars in 1224 bytes} [Mon Aug 29 22:02:48 2022] DELETE /identity/v3/users/d697f0e4076043b6aea486ada34349a3 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:49.751084 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] Authenticating user token {{(pid=81954) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:02:49.755941 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.fernet_utils [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81954) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:02:49.768405 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7e81e-15be-4a46-9a19-00285cc90b98 admin admin] Validating token access rules against request {{(pid=81954) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:02:49.778558 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:02:49.842039 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '19faba1f83d443dbaca1d7f5b1b4a452', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f1c71f7fdbf248fba40d8efd925d9546', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81954) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:02:49.842678 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:02:49.842955 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:02:49.843221 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] PATH_INFO: `/v3/projects/b93b896ac529468fb2f69fc7f8a5a6fc` {{(pid=81954) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:02:49.844976 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93b896ac529468fb2f69fc7f8a5a6fc)` {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:02:49.846386 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] RBAC: Authorization granted {{(pid=81954) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:02:49.996124 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93b896ac529468fb2f69fc7f8a5a6fc', 'request_id': 'req-f2cf5fcd-efa4-4bfd-8366-5732975618ca'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:50.010956 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93b896ac529468fb2f69fc7f8a5a6fc', 'request_id': 'req-f2cf5fcd-efa4-4bfd-8366-5732975618ca'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:50.089026 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93b896ac529468fb2f69fc7f8a5a6fc', 'request_id': 'req-f2cf5fcd-efa4-4bfd-8366-5732975618ca'} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:50.101730 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] The token cache is being invalidate because project b93b896ac529468fb2f69fc7f8a5a6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81954) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 22:02:50.102053 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:50.102706 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG keystone.notifications [None req-f2cf5fcd-efa4-4bfd-8366-5732975618ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81954) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 22:02:50.104184 dv-cinder-854266-3-smb devstack@keystone.service[81954]: [pid: 81954|app: 0|req: 1478/2943] 10.222.0.83 () {58 vars in 1233 bytes} [Mon Aug 29 22:02:49 2022] DELETE /identity/v3/projects/b93b896ac529468fb2f69fc7f8a5a6fc => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 22:02:59.316086 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:03:00.098533 dv-cinder-854266-3-smb devstack@keystone.service[81954]: DEBUG dbcounter [-] [81954] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81954) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:03:37.362441 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] Authenticating user token {{(pid=81953) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 22:03:37.363833 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:03:37.432932 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d236a-d1f8-4c27-ba88-88b866ce7876 admin admin] Validating token access rules against request {{(pid=81953) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 22:03:37.493320 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e52017-6ab3-40f5-8bf4-09cce5f06cf2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dca09f6fe11f4b878dd11c4cb69ca7c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '59c475b2231c4f6b8f81b7977c5672cd', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81953) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 22:03:37.493955 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e52017-6ab3-40f5-8bf4-09cce5f06cf2 service placement] REQUEST_METHOD: `GET` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 22:03:37.494238 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e52017-6ab3-40f5-8bf4-09cce5f06cf2 service placement] SCRIPT_NAME: `/identity` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 22:03:37.494513 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e52017-6ab3-40f5-8bf4-09cce5f06cf2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81953) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 22:03:37.496259 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.fernet_utils [None req-16e52017-6ab3-40f5-8bf4-09cce5f06cf2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81953) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 22:03:37.507743 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e52017-6ab3-40f5-8bf4-09cce5f06cf2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 22:03:37.509335 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e52017-6ab3-40f5-8bf4-09cce5f06cf2 service placement] RBAC: Authorization granted {{(pid=81953) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 22:03:37.519772 dv-cinder-854266-3-smb devstack@keystone.service[81953]: [pid: 81953|app: 0|req: 1466/2944] 10.222.0.83 () {60 vars in 1365 bytes} [Mon Aug 29 22:03:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 22:03:47.515459 dv-cinder-854266-3-smb devstack@keystone.service[81953]: DEBUG dbcounter [-] [81953] Writing DB stats keystone:SELECT=58 {{(pid=81953) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}